thedrummer

4 models, with 7 monitored endpoints (3 actively tracked, 4 no longer) across 3 providers. 0 of them show at least one detected change — the model version is nominally fixed, so the movement is in how it is served.

4
Models
7
Monitored endpoints
3
Actively tracked
0
Changes total
3
Providers

Models

Model Monitored endpoints Providers Changes Endpoints changed Last change
rocinante-12b retired
2 retired · 1 errors out
2 2 — 0/2 —
skyfall-36b-v2 2 2 — 0/2 —
unslopnemo-12b 2 2 — 0/2 —
cydonia-24b-v4.1 1 1 — 0/1 —
4 models · monitored since 2025-08-11

Timothée Chauvin, Erwan Le Merrer, François Taïani, Gilles Tredan (2026), "Log Probability Tracking of LLM APIs". ICLR 2026. https://arxiv.org/abs/2512.03816

Timothée Chauvin, Clément Lalanne, Erwan Le Merrer, Jean-Michel Loubes, François Taïani, Gilles Tredan (2026), "Token-Efficient Change Detection in LLM APIs". ICML 2026. https://arxiv.org/abs/2602.11083

@inproceedings{
chauvin2026log,
title={Log Probability Tracking of {LLM} {API}s},
author={Timothee Chauvin and Erwan Le Merrer and Francois Taiani and Gilles Tredan},
booktitle={The Fourteenth International Conference on Learning Representations},
year={2026},
url={https://openreview.net/forum?id=hFxivbAgVP}
}

@inproceedings{
chauvin2026tokenefficient,
title={Token-Efficient Change Detection in {LLM} {API}s},
author={Timothee Chauvin and Cl{\'e}ment Lalanne and Erwan Le Merrer and Jean-Michel Loubes and Francois Taiani and Gilles Tredan},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=7cMlZZYZT0}
}