nousresearch

7 models, with 13 monitored endpoints (0 actively tracked, 13 no longer) across 5 providers. 4 of them show at least one detected change — the model version is nominally fixed, so the movement is in how it is served.

7
Models
13
Monitored endpoints
0
Actively tracked
6
Changes total
5
Providers

Models

Model Monitored endpoints Providers Changes Endpoints changed Last change
hermes-4-405b retired
2 retired
 2 2 3 1/2 2025-10-15
hermes-3-llama-3.1-70b retired
3 retired · 1 not selected
 3 3 1 1/3 2025-07-16
hermes-3-llama-3.1-405b retired
2 retired · 1 not selected
 2 2 1 1/2 2025-07-17
deephermes-3-llama-3-8b-preview:free retired
1 retired
 1 1 1 1/1 2025-09-17
hermes-2-pro-llama-3-8b retired
2 retired
 2 2 — 0/2 —
hermes-4-70b retired
2 retired
 2 2 — 0/2 —
deephermes-3-mistral-24b-preview retired
1 retired
 1 1 — 0/1 —
7 models · monitored since 2025-06-26

Timothée Chauvin, Erwan Le Merrer, François Taïani, Gilles Tredan (2026), "Log Probability Tracking of LLM APIs". ICLR 2026. https://arxiv.org/abs/2512.03816

Timothée Chauvin, Clément Lalanne, Erwan Le Merrer, Jean-Michel Loubes, François Taïani, Gilles Tredan (2026), "Token-Efficient Change Detection in LLM APIs". ICML 2026. https://arxiv.org/abs/2602.11083

@inproceedings{
chauvin2026log,
title={Log Probability Tracking of {LLM} {API}s},
author={Timothee Chauvin and Erwan Le Merrer and Francois Taiani and Gilles Tredan},
booktitle={The Fourteenth International Conference on Learning Representations},
year={2026},
url={https://openreview.net/forum?id=hFxivbAgVP}
}

@inproceedings{
chauvin2026tokenefficient,
title={Token-Efficient Change Detection in {LLM} {API}s},
author={Timothee Chauvin and Cl{\'e}ment Lalanne and Erwan Le Merrer and Jean-Michel Loubes and Francois Taiani and Gilles Tredan},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=7cMlZZYZT0}
}