meta-llama

14 models, with 47 monitored endpoints (10 actively tracked, 37 no longer) across 18 providers. 4 of them show at least one detected change — the model version is nominally fixed, so the movement is in how it is served.

14
Models
47
Monitored endpoints
10
Actively tracked
5
Changes total
18
Providers

Models

Model Monitored endpoints Providers Changes Endpoints changed Last change
llama-3.2-3b-instruct 2 2 2 1/2 2026-10-01
llama-3.3-70b-instruct 15 14 1 1/15 2025-12-18
llama-3.1-8b-instruct 9 9 1 1/9 2026-07-26
llama-4-maverick 4 4 1 1/4 2025-07-10
llama-3.1-70b-instruct retired
5 retired · 1 not selected · 1 errors out
 5 5 — 0/5 —
llama-3.1-405b-instruct retired
3 retired
 3 3 — 0/3 —
llama-4-scout retired
3 retired · 2 not selected · 1 errors out
 3 3 — 0/3 —
llama-guard-3-8b retired
2 retired
 2 2 — 0/2 —
llama-3.2-11b-vision-instruct retired
1 retired
 1 1 — 0/1 —
llama-4-maverick:free retired
1 retired
 1 1 — 0/1 —
llama-4-scout:free retired
1 retired
 1 1 — 0/1 —
llama-guard-2-8b retired
1 retired
 1 1 — 0/1 —
llama-3.2-1b-instruct retired
1 retired
 0 0 — 0/0 —
llama-guard-4-12b errors out
1 errors out
 0 0 — 0/0 —
14 models · monitored since 2025-06-18

Timothée Chauvin, Erwan Le Merrer, François Taïani, Gilles Tredan (2026), "Log Probability Tracking of LLM APIs". ICLR 2026. https://arxiv.org/abs/2512.03816

Timothée Chauvin, Clément Lalanne, Erwan Le Merrer, Jean-Michel Loubes, François Taïani, Gilles Tredan (2026), "Token-Efficient Change Detection in LLM APIs". ICML 2026. https://arxiv.org/abs/2602.11083

@inproceedings{
chauvin2026log,
title={Log Probability Tracking of {LLM} {API}s},
author={Timothee Chauvin and Erwan Le Merrer and Francois Taiani and Gilles Tredan},
booktitle={The Fourteenth International Conference on Learning Representations},
year={2026},
url={https://openreview.net/forum?id=hFxivbAgVP}
}

@inproceedings{
chauvin2026tokenefficient,
title={Token-Efficient Change Detection in {LLM} {API}s},
author={Timothee Chauvin and Cl{\'e}ment Lalanne and Erwan Le Merrer and Jean-Michel Loubes and Francois Taiani and Gilles Tredan},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=7cMlZZYZT0}
}