google

49 models, with 45 monitored endpoints (22 actively tracked, 23 no longer) across 27 providers. 5 of them show at least one detected change — the model version is nominally fixed, so the movement is in how it is served.

49
Models
45
Monitored endpoints
22
Actively tracked
9
Changes total
27
Providers

Models

Model Monitored endpoints Providers Changes Endpoints changed Last change
gemma-4-26b-a4b-it 13 13 3 3/13 2026-10-06
gemma-3-27b-it 5 5 3 1/5 2026-03-19
gemma-4-31b-it 15 13 1 1/15 2026-08-13
gemma-3-4b-it retired
2 retired · 1 pending
2 2 1 1/2 2026-02-05
gemini-3.1-pro-preview 1 1 1 1/1 2026-09-05
gemma-3-12b-it 4 4 — 0/4 —
gemma-2-9b-it retired
1 retired
1 1 — 0/1 —
gemma-2-9b-it:free retired
1 retired
1 1 — 0/1 —
gemma-3-12b-it:free retired
1 retired
1 1 — 0/1 —
gemma-3-27b-it:free retired
1 retired
1 1 — 0/1 —
gemma-3n-e4b-it retired
1 retired
1 1 — 0/1 —
gemini-2.5-flash not selected
7 not selected
0 0 — 0/0 —
gemini-2.5-flash-image errors out
1 errors out
0 0 — 0/0 —
gemini-2.5-flash-lite retired
4 retired · 1 not selected
0 0 — 0/0 —
gemini-2.5-flash-lite:batch untrackable
2 untrackable
0 0 — 0/0 —
gemini-2.5-flash:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-2.5-pro errors out
3 errors out · 2 too expensive · 2 not selected
0 0 — 0/0 —
gemini-2.5-pro-preview errors out
4 errors out · 2 not selected · 1 too expensive
0 0 — 0/0 —
gemini-2.5-pro:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-3-flash-preview errors out
6 errors out
0 0 — 0/0 —
gemini-3-flash-preview:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-3-pro-image not selected
2 not selected
0 0 — 0/0 —
gemini-3-pro-image-preview not selected
2 not selected
0 0 — 0/0 —
gemini-3.1-flash-image errors out
2 errors out
0 0 — 0/0 —
gemini-3.1-flash-image-preview errors out
1 errors out
0 0 — 0/0 —
gemini-3.1-flash-lite not selected
8 not selected
0 0 — 0/0 —
gemini-3.1-flash-lite-image not selected
1 not selected · 1 errors out
0 0 — 0/0 —
gemini-3.1-flash-lite-preview not selected
2 not selected · 1 errors out
0 0 — 0/0 —
gemini-3.1-flash-lite:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-3.1-pro-preview-customtools not selected
1 not selected
0 0 — 0/0 —
gemini-3.1-pro-preview:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-3.5-flash errors out
7 errors out
0 0 — 0/0 —
gemini-3.5-flash-lite untrackable
5 untrackable · 3 errors out
0 0 — 0/0 —
gemini-3.5-flash-lite:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-3.5-flash:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-3.6-flash untrackable
4 untrackable · 3 errors out
0 0 — 0/0 —
gemini-3.6-flash:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-3.7-flash untrackable
3 untrackable · 3 errors out
0 0 — 0/0 —
gemini-3.7-flash:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-3.8-flash untrackable
3 untrackable · 3 errors out
0 0 — 0/0 —
gemini-3.8-flash:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-4-argon too expensive
6 too expensive
0 0 — 0/0 —
gemini-4-argon:batch untrackable
1 untrackable
0 0 — 0/0 —
gemini-nano-banana-2.1 too expensive
1 too expensive
0 0 — 0/0 —
gemma-2-27b-it errors out
1 errors out
0 0 — 0/0 —
gemma-4-26b-a4b-it:free free excluded
1 free excluded
0 0 — 0/0 —
gemma-4-31b-it:free free excluded
1 free excluded
0 0 — 0/0 —
lyria-3-clip-preview free excluded
1 free excluded
0 0 — 0/0 —
lyria-3-pro-preview free excluded
1 free excluded
0 0 — 0/0 —
49 models · monitored since 2025-06-26

Timothée Chauvin, Erwan Le Merrer, François Taïani, Gilles Tredan (2026), "Log Probability Tracking of LLM APIs". ICLR 2026. https://arxiv.org/abs/2512.03816

Timothée Chauvin, Clément Lalanne, Erwan Le Merrer, Jean-Michel Loubes, François Taïani, Gilles Tredan (2026), "Token-Efficient Change Detection in LLM APIs". ICML 2026. https://arxiv.org/abs/2602.11083

@inproceedings{
chauvin2026log,
title={Log Probability Tracking of {LLM} {API}s},
author={Timothee Chauvin and Erwan Le Merrer and Francois Taiani and Gilles Tredan},
booktitle={The Fourteenth International Conference on Learning Representations},
year={2026},
url={https://openreview.net/forum?id=hFxivbAgVP}
}

@inproceedings{
chauvin2026tokenefficient,
title={Token-Efficient Change Detection in {LLM} {API}s},
author={Timothee Chauvin and Cl{\'e}ment Lalanne and Erwan Le Merrer and Jean-Michel Loubes and Francois Taiani and Gilles Tredan},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=7cMlZZYZT0}
}