TrackLLM

Tracking LLM API logprob responses

Currently Tracked (48)

Model	Provider
alpindale/goliath-120b	mancer/int4
anthracite-org/magnum-v4-72b	mancer/fp8
deepseek/deepseek-chat-v3-0324	crusoe/fp8
deepseek/deepseek-chat-v3-0324	fireworks
deepseek/deepseek-chat-v3.1	fireworks
deepseek/deepseek-chat-v3.1	gmicloud/fp8
deepseek/deepseek-r1-0528	crusoe/fp8
deepseek/deepseek-v3.2	deepseek
gryphe/mythomax-l2-13b	mancer/fp8
mancer/weaver	mancer/fp8
meta-llama/llama-3.1-8b-instruct	cerebras/fp16
meta-llama/llama-3.3-70b-instruct	cerebras/fp16
meta-llama/llama-3.3-70b-instruct	crusoe/bf16
meta-llama/llama-3.3-70b-instruct	fireworks/fp16
moonshotai/kimi-k2	moonshotai/fp8
moonshotai/kimi-k2	nebius/fp4
moonshotai/kimi-k2-0905	fireworks/fp8
moonshotai/kimi-k2-thinking	nebius/fp8
moonshotai/kimi-k2-thinking	parasail/int4
neversleep/llama-3.1-lumimaid-8b	mancer/fp16
neversleep/noromaid-20b	mancer/fp8
openai/chatgpt-4o-latest	openai
openai/gpt-3.5-turbo	openai
openai/gpt-3.5-turbo-0613	azure
openai/gpt-3.5-turbo-16k	azure
openai/gpt-3.5-turbo-16k	openai
openai/gpt-4o	azure
openai/gpt-4o	openai
openai/gpt-4o-2024-05-13	azure
openai/gpt-4o-2024-05-13	openai
openai/gpt-4o-2024-08-06	azure
openai/gpt-4o-2024-08-06	openai
openai/gpt-4o-2024-11-20	openai
openai/gpt-4o-mini	azure
openai/gpt-4o-mini	openai
openai/gpt-4o-mini-2024-07-18	openai
openai/gpt-4o:extended	openai
openai/gpt-oss-120b	crusoe
openai/gpt-oss-120b	crusoe/bf16
qwen/qwen2.5-vl-32b-instruct	fireworks
qwen/qwen3-235b-a22b-2507	cerebras
qwen/qwen3-32b	cerebras
qwen/qwen3-coder	fireworks
qwen/qwen3-next-80b-a3b-thinking	nebius/fp8
undi95/remm-slerp-l2-13b	mancer/fp8
z-ai/glm-4.5	mancer/fp8
z-ai/glm-4.6	cerebras
z-ai/glm-4.6	mancer/fp8

Previously Tracked (195)

Model	Provider	Last Query
01-ai/yi-large	fireworks	2025-07-22
agentica-org/deepcoder-14b-preview	chutes	2025-10-03
agentica-org/deepcoder-14b-preview:free	chutes	2025-10-03
arliai/qwq-32b-arliai-rpr-v1	chutes	2025-10-17
arliai/qwq-32b-arliai-rpr-v1:free	chutes	2025-10-17
cognitivecomputations/dolphin3.0-mistral-24b	chutes	2025-10-17
cognitivecomputations/dolphin3.0-mistral-24b:free	chutes	2025-10-17
cognitivecomputations/dolphin3.0-r1-mistral-24b	chutes	2025-10-04
cognitivecomputations/dolphin3.0-r1-mistral-24b:free	chutes	2025-10-04
deepseek/deepseek-chat	chutes	2025-10-17
deepseek/deepseek-chat	fireworks	2025-10-15
deepseek/deepseek-chat	nebius/fp8	2025-10-21
deepseek/deepseek-chat-v3-0324	chutes/fp8	2025-10-17
deepseek/deepseek-chat-v3-0324	deepseek/fp8	2025-08-21
deepseek/deepseek-chat-v3-0324	hyperbolic/fp8	2025-10-17
deepseek/deepseek-chat-v3-0324	klusterai	2025-07-17
deepseek/deepseek-chat-v3-0324	lambda/fp8	2025-09-25
deepseek/deepseek-chat-v3-0324	nebius/fp8	2025-10-21
deepseek/deepseek-chat-v3-0324:free	chutes/fp8	2025-10-17
deepseek/deepseek-chat-v3.1	byteplus	2025-12-06
deepseek/deepseek-chat-v3.1	chutes	2025-10-30
deepseek/deepseek-chat-v3.1	deepseek	2025-09-22
deepseek/deepseek-chat-v3.1	parasail/fp8	2025-12-10
deepseek/deepseek-chat:free	chutes	2025-07-21
deepseek/deepseek-r1	fireworks/fp8	2025-10-15
deepseek/deepseek-r1	lambda/fp8	2025-08-21
deepseek/deepseek-r1	nebius/base	2025-09-10
deepseek/deepseek-r1	nebius/fast	2025-09-10
deepseek/deepseek-r1-0528	chutes	2025-10-17
deepseek/deepseek-r1-0528	fireworks	2025-12-03
deepseek/deepseek-r1-0528	klusterai	2025-07-02
deepseek/deepseek-r1-0528	lambda/fp8	2025-09-25
deepseek/deepseek-r1-0528	nebius/fp8	2025-10-21
deepseek/deepseek-r1-0528-qwen3-8b	chutes	2025-10-17
deepseek/deepseek-r1-0528-qwen3-8b:free	chutes	2025-10-17
deepseek/deepseek-r1-0528:free	chutes	2025-10-17
deepseek/deepseek-r1-distill-llama-70b	chutes	2025-10-17
deepseek/deepseek-r1-distill-llama-70b	lambda/fp8	2025-09-25
deepseek/deepseek-r1-distill-llama-70b	nebius/fp8	2025-09-10
deepseek/deepseek-r1-distill-llama-70b:free	chutes	2025-10-17
google/gemma-2-9b-it	chutes	2025-10-17
google/gemma-2-9b-it:free	chutes	2025-10-17
google/gemma-3-12b-it	chutes/bf16	2025-10-17
google/gemma-3-12b-it:free	chutes/bf16	2025-10-06
google/gemma-3-27b-it	chutes/bf16	2025-10-17
google/gemma-3-27b-it	klusterai	2025-07-16
google/gemma-3-27b-it	nebius/fp8	2025-10-21
google/gemma-3-27b-it:free	chutes/bf16	2025-10-17
meta-llama/llama-3.1-405b-instruct	fireworks/fp8	2025-10-18
meta-llama/llama-3.1-405b-instruct	lambda/fp8	2025-08-20
meta-llama/llama-3.1-405b-instruct	nebius/fp8	2025-10-21
meta-llama/llama-3.1-70b-instruct	fireworks	2025-11-05
meta-llama/llama-3.1-70b-instruct	lambda/fp8	2025-08-20
meta-llama/llama-3.1-70b-instruct	nebius/fp8	2025-09-10
meta-llama/llama-3.1-8b-instruct	fireworks	2025-11-05
meta-llama/llama-3.1-8b-instruct	klusterai/fp8	2025-07-17
meta-llama/llama-3.1-8b-instruct	lambda/bf16	2025-09-25
meta-llama/llama-3.1-8b-instruct	nebius/fp8	2025-10-21
meta-llama/llama-3.2-11b-vision-instruct	lambda/bf16	2025-08-11
meta-llama/llama-3.2-3b-instruct	lambda/bf16	2025-08-20
meta-llama/llama-3.3-70b-instruct	crusoe/int8	2025-09-16
meta-llama/llama-3.3-70b-instruct	hyperbolic/fp8	2025-09-26
meta-llama/llama-3.3-70b-instruct	klusterai/fp8	2025-07-16
meta-llama/llama-3.3-70b-instruct	lambda/fp8	2025-09-26
meta-llama/llama-3.3-70b-instruct	nebius/fp8	2025-10-21
meta-llama/llama-4-maverick	klusterai/fp8	2025-07-17
meta-llama/llama-4-maverick	lambda/fp8	2025-09-25
meta-llama/llama-4-maverick:free	chutes/fp8	2025-07-15
meta-llama/llama-4-scout	klusterai	2025-07-16
meta-llama/llama-4-scout	lambda/fp8	2025-09-25
meta-llama/llama-4-scout:free	chutes/bf16	2025-07-15
meta-llama/llama-guard-3-8b	fireworks	2025-07-09
meta-llama/llama-guard-3-8b	nebius	2025-10-21
microsoft/mai-ds-r1	chutes/fp8	2025-10-17
microsoft/phi-4	nebius/fp8	2025-09-10
minimax/minimax-m1:extended	chutes	2025-07-01
minimax/minimax-m2	fireworks	2025-12-19
mistralai/devstral-small	nebius/fp8	2025-07-10
mistralai/devstral-small-2505	chutes	2025-10-17
mistralai/devstral-small-2505	nebius/fp8	2025-10-21
mistralai/devstral-small-2505:free	chutes	2025-10-17
mistralai/devstral-small:free	chutes	2025-07-10
mistralai/mistral-nemo	chutes	2025-10-17
mistralai/mistral-nemo	klusterai	2025-07-16
mistralai/mistral-nemo	nebius/fp8	2025-09-10
mistralai/mistral-nemo:free	chutes	2025-10-17
mistralai/mistral-small-24b-instruct-2501	chutes	2025-10-17
mistralai/mistral-small-24b-instruct-2501	klusterai	2025-07-16
mistralai/mistral-small-24b-instruct-2501:free	chutes	2025-10-17
mistralai/mistral-small-3.1-24b-instruct	chutes	2025-10-17
mistralai/mistral-small-3.1-24b-instruct	nebius/fp8	2025-09-10
mistralai/mistral-small-3.1-24b-instruct:free	chutes	2025-10-17
mistralai/mistral-small-3.2-24b-instruct	chutes	2025-10-17
mistralai/mistral-small-3.2-24b-instruct:free	chutes	2025-10-17
mistralai/mixtral-8x22b-instruct	fireworks	2025-10-18
mistralai/pixtral-12b	hyperbolic/bf16	2025-10-21
moonshotai/kimi-dev-72b:free	chutes/bf16	2025-10-17
moonshotai/kimi-k2	chutes/fp8	2025-09-05
moonshotai/kimi-k2	fireworks/fp8	2025-10-31
moonshotai/kimi-k2-0905	byteplus	2025-12-06
moonshotai/kimi-k2:free	chutes/fp8	2025-09-15
moonshotai/kimi-linear-48b-a3b-instruct	parasail/bf16	2025-12-11
moonshotai/kimi-vl-a3b-thinking	chutes	2025-10-04
moonshotai/kimi-vl-a3b-thinking:free	chutes	2025-10-04
nousresearch/deephermes-3-llama-3-8b-preview:free	chutes/bf16	2025-10-17
nousresearch/deephermes-3-mistral-24b-preview	chutes	2025-10-17
nousresearch/hermes-2-pro-llama-3-8b	lambda/bf16	2025-09-25
nousresearch/hermes-3-llama-3.1-405b	lambda/fp8	2025-09-25
nousresearch/hermes-3-llama-3.1-405b	nebius/fp8	2025-10-21
nousresearch/hermes-3-llama-3.1-70b	hyperbolic/fp8	2025-09-26
nousresearch/hermes-3-llama-3.1-70b	lambda/fp8	2025-09-26
nousresearch/hermes-4-405b	chutes/fp8	2025-10-17
nousresearch/hermes-4-405b	nebius/fp8	2025-10-21
nousresearch/hermes-4-70b	chutes	2025-10-17
nousresearch/hermes-4-70b	nebius/fp8	2025-10-21
nvidia/llama-3.1-nemotron-70b-instruct	lambda/fp8	2025-08-20
nvidia/llama-3.1-nemotron-ultra-253b-v1	nebius/fp8	2025-10-21
nvidia/llama-3.3-nemotron-super-49b-v1	nebius/fp8	2025-09-10
nvidia/llama-3.3-nemotron-super-49b-v1:free	chutes/bf16	2025-07-15
openai/gpt-4.1	openai	2025-09-24
openai/gpt-4.1-mini	openai	2025-09-24
openai/gpt-4.1-nano	openai	2025-09-24
openai/gpt-oss-120b	chutes	2025-08-19
openai/gpt-oss-120b	nebius/fp4	2025-10-21
openai/gpt-oss-20b	nebius/fp4	2025-10-21
qwen/qwen-2.5-72b-instruct	chutes/bf16	2025-09-29
qwen/qwen-2.5-72b-instruct	fireworks	2025-07-09
qwen/qwen-2.5-72b-instruct	nebius/fp8	2025-10-21
qwen/qwen-2.5-72b-instruct:free	chutes/bf16	2025-10-17
qwen/qwen-2.5-coder-32b-instruct	chutes	2025-10-17
qwen/qwen-2.5-coder-32b-instruct	hyperbolic/fp8	2025-10-17
qwen/qwen-2.5-coder-32b-instruct	lambda/bf16	2025-08-20
qwen/qwen-2.5-coder-32b-instruct	nebius/fp8	2025-09-10
qwen/qwen-2.5-coder-32b-instruct:free	chutes	2025-10-17
qwen/qwen-2.5-vl-7b-instruct	hyperbolic/bf16	2025-10-22
qwen/qwen-2.5-vl-7b-instruct	klusterai	2025-07-17
qwen/qwen2.5-vl-32b-instruct	chutes/bf16	2025-10-17
qwen/qwen2.5-vl-72b-instruct	chutes	2025-10-17
qwen/qwen2.5-vl-72b-instruct	hyperbolic	2025-10-22
qwen/qwen2.5-vl-72b-instruct	nebius/fp8	2025-10-21
qwen/qwen3-14b	nebius/fp8	2025-10-21
qwen/qwen3-14b:free	chutes	2025-10-17
qwen/qwen3-235b-a22b	klusterai/fp8	2025-07-16
qwen/qwen3-235b-a22b	nebius/fp8	2025-09-10
qwen/qwen3-235b-a22b-2507	chutes	2025-10-17
qwen/qwen3-235b-a22b-2507	nebius/fp8	2025-10-21
qwen/qwen3-235b-a22b:free	chutes	2025-10-17
qwen/qwen3-30b-a3b	chutes	2025-10-17
qwen/qwen3-30b-a3b	nebius/fp8	2025-10-21
qwen/qwen3-30b-a3b-instruct-2507	nebius/fp8	2025-10-21
qwen/qwen3-30b-a3b:free	chutes	2025-10-17
qwen/qwen3-32b	chutes	2025-10-17
qwen/qwen3-32b	lambda/fp8	2025-07-29
qwen/qwen3-32b	nebius/base	2025-10-21
qwen/qwen3-32b	nebius/fast	2025-10-21
qwen/qwen3-32b	nebius/fp8	2025-06-19
qwen/qwen3-32b:free	chutes	2025-07-21
qwen/qwen3-8b:free	chutes	2025-10-17
qwen/qwen3-coder	chutes	2025-10-17
qwen/qwen3-coder	chutes/fp8	2025-09-29
qwen/qwen3-coder	hyperbolic/fp8	2025-10-21
qwen/qwen3-coder	nebius/fp8	2025-10-21
qwen/qwq-32b	fireworks	2025-07-09
qwen/qwq-32b	hyperbolic/bf16	2025-08-30
qwen/qwq-32b	nebius/fp8	2025-10-21
qwen/qwq-32b:free	chutes/bf16	2025-07-21
rekaai/reka-flash-3:free	chutes/bf16	2025-07-21
sarvamai/sarvam-m:free	chutes	2025-08-04
sentientagi/dobby-mini-unhinged-plus-llama-3.1-8b	fireworks	2025-07-01
shisa-ai/shisa-v2-llama3.3-70b	chutes	2025-10-17
shisa-ai/shisa-v2-llama3.3-70b:free	chutes	2025-10-17
tencent/hunyuan-a13b-instruct	chutes/bf16	2025-10-04
tencent/hunyuan-a13b-instruct:free	chutes/bf16	2025-10-04
thedrummer/skyfall-36b-v2	chutes	2025-10-17
thudm/glm-4-32b:free	chutes	2025-08-03
thudm/glm-z1-32b	chutes	2025-10-17
thudm/glm-z1-32b:free	chutes	2025-08-12
tngtech/deepseek-r1t-chimera	chutes	2025-10-17
tngtech/deepseek-r1t-chimera:free	chutes	2025-10-17
x-ai/grok-2-1212	xai	2025-09-16
x-ai/grok-2-vision-1212	xai	2025-09-16
x-ai/grok-3	xai	2025-10-17
x-ai/grok-3	xai/fast	2025-10-17
x-ai/grok-3-beta	xai	2025-10-17
x-ai/grok-3-beta	xai/fast	2025-10-17
x-ai/grok-3-mini	xai	2025-10-17
x-ai/grok-3-mini	xai/fast	2025-10-17
x-ai/grok-3-mini-beta	xai	2025-10-17
x-ai/grok-3-mini-beta	xai/fast	2025-10-17
x-ai/grok-4	xai	2025-10-14
x-ai/grok-beta	xai	2025-07-03
x-ai/grok-code-fast-1	xai	2025-10-12
x-ai/grok-vision-beta	xai	2025-07-03
z-ai/glm-4.5	chutes/fp8	2025-10-17
z-ai/glm-4.5-air:free	chutes/bf16	2025-10-17