nousresearch/hermes-3-llama-3.1-70b

Served by Nextbit (fp8)
lt

hermes-3-llama-3.1-70b is served by 3 providers.

nextbit serves 17 models.

Tracking status

LTstalled — We tracked this endpoint's logprobs, but its recent queries all failed, so tracking stopped.
B3ITpending — This endpoint has not been evaluated for tracking yet.

Drift from baseline

Both signals measure how far this endpoint's behavior has moved from its reference period. LT tracks the average change in the returned tokens' log-probabilities (nats); B3IT tracks the total-variation distance of the border-input votes (0–1). Both should ideally be as close to 0 as possible. Dashed lines mark published changes, labeled with the level shift across them: for LT the mean drift over the 7 days after minus the 7 days before; for B3IT the total-variation shift its detector measured.

Hover a day on either lane, a change mark or an epoch line to read the data behind it.

Timothée Chauvin, Erwan Le Merrer, François Taïani, Gilles Tredan (2026), "Log Probability Tracking of LLM APIs". ICLR 2026. https://arxiv.org/abs/2512.03816

Timothée Chauvin, Clément Lalanne, Erwan Le Merrer, Jean-Michel Loubes, François Taïani, Gilles Tredan (2026), "Token-Efficient Change Detection in LLM APIs". ICML 2026. https://arxiv.org/abs/2602.11083

@inproceedings{
chauvin2026log,
title={Log Probability Tracking of {LLM} {API}s},
author={Timothee Chauvin and Erwan Le Merrer and Francois Taiani and Gilles Tredan},
booktitle={The Fourteenth International Conference on Learning Representations},
year={2026},
url={https://openreview.net/forum?id=hFxivbAgVP}
}

@inproceedings{
chauvin2026tokenefficient,
title={Token-Efficient Change Detection in {LLM} {API}s},
author={Timothee Chauvin and Cl{\'e}ment Lalanne and Erwan Le Merrer and Jean-Michel Loubes and Francois Taiani and Gilles Tredan},
booktitle={Forty-third International Conference on Machine Learning},
year={2026},
url={https://openreview.net/forum?id=7cMlZZYZT0}
}