Improve model card metadata and add prominent links to paper and code
Browse filesHi, I'm Niels from the community science team at Hugging Face.
This PR improves the model card for Toto-2.0-1B by:
1. Adding `datasets` metadata to link the model to the `Datadog/BOOM` and `Salesforce/GIFT-Eval` datasets.
2. Adding prominent links to the paper, GitHub repository, and project blog at the top of the README.
3. Mentioning the paper authors in the description.
4. Formally linking the model to the research paper "Toto 2.0: Time Series Forecasting Enters the Scaling Era" (arXiv:2605.20119).
Please review and merge if this looks good to you!
README.md
CHANGED
|
@@ -1,4 +1,9 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
tags:
|
| 3 |
- time-series-forecasting
|
| 4 |
- foundation-models
|
|
@@ -9,63 +14,65 @@ tags:
|
|
| 9 |
- observability
|
| 10 |
- safetensors
|
| 11 |
- pytorch_model_hub_mixin
|
| 12 |
-
license: apache-2.0
|
| 13 |
-
pipeline_tag: time-series-forecasting
|
| 14 |
thumbnail: https://web-assets.dd-static.net/42588/1778691695-toto-2-hero.png
|
| 15 |
model-index:
|
| 16 |
- name: Toto-2.0-1B
|
| 17 |
results:
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
---
|
| 64 |
|
| 65 |
# Toto-2.0-1B
|
| 66 |
|
|
|
|
|
|
|
| 67 |
Toto (Time Series Optimized Transformer for [Observability](https://www.datadoghq.com/knowledge-center/observability/)) is a family of time series foundation models for multivariate forecasting developed by [Datadog](https://www.datadoghq.com/). Toto 2.0 is the current generation, featuring u-ฮผP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family.
|
| 68 |
|
|
|
|
|
|
|
| 69 |
The family sets a new state of the art on three forecasting benchmarks: [BOOM](https://huggingface.co/spaces/Datadog/BOOM), our observability benchmark; [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the standard general-purpose benchmark; and the recent contamination-resistant [TIME](https://arxiv.org/abs/2602.12147) benchmark.
|
| 70 |
|
| 71 |
## ๐ Performance
|
|
@@ -136,12 +143,12 @@ All five Toto 2.0 sizes share the same training recipe; pick a size based on you
|
|
| 136 |
|
| 137 |
<figure>
|
| 138 |
<img src="assets/architecture.png" alt="Overview of the Toto 2.0 architecture.">
|
| 139 |
-
<figcaption>A decoder-only patched transformer whose attention layers alternate between time-axis (causal) and variate-axis (full) views of the input. Toto 2.0 adds <b>contiguous patch masking (CPM)</b> for single-pass parallel decoding, a <b>quantile output head</b> trained with pinball loss, a robust arcsinh input scaler, residual MLP patch projections, and is trained with NorMuon. See the <a href="
|
| 140 |
</figure>
|
| 141 |
|
| 142 |
## ๐ Additional Resources
|
| 143 |
|
| 144 |
-
- [Technical Report](https://
|
| 145 |
- [Blog Post](https://www.datadoghq.com/blog/ai/toto-2/)
|
| 146 |
- [GitHub Repository](https://github.com/DataDog/toto)
|
| 147 |
- [Toto 2.0 Collection](https://huggingface.co/collections/Datadog/toto-20) โ all five base checkpoints
|
|
@@ -160,4 +167,4 @@ All five Toto 2.0 sizes share the same training recipe; pick a size based on you
|
|
| 160 |
primaryClass={cs.LG},
|
| 161 |
url={https://arxiv.org/abs/2605.20119},
|
| 162 |
}
|
| 163 |
-
```
|
|
|
|
| 1 |
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
pipeline_tag: time-series-forecasting
|
| 4 |
+
datasets:
|
| 5 |
+
- Datadog/BOOM
|
| 6 |
+
- Salesforce/GIFT-Eval
|
| 7 |
tags:
|
| 8 |
- time-series-forecasting
|
| 9 |
- foundation-models
|
|
|
|
| 14 |
- observability
|
| 15 |
- safetensors
|
| 16 |
- pytorch_model_hub_mixin
|
|
|
|
|
|
|
| 17 |
thumbnail: https://web-assets.dd-static.net/42588/1778691695-toto-2-hero.png
|
| 18 |
model-index:
|
| 19 |
- name: Toto-2.0-1B
|
| 20 |
results:
|
| 21 |
+
- task:
|
| 22 |
+
type: time-series-forecasting
|
| 23 |
+
dataset:
|
| 24 |
+
name: BOOM
|
| 25 |
+
type: BOOM
|
| 26 |
+
metrics:
|
| 27 |
+
- type: CRPS
|
| 28 |
+
value: 0.349
|
| 29 |
+
name: CRPS
|
| 30 |
+
- type: MASE
|
| 31 |
+
value: 0.582
|
| 32 |
+
name: MASE
|
| 33 |
+
source:
|
| 34 |
+
url: https://huggingface.co/spaces/Datadog/BOOM
|
| 35 |
+
name: BOOM ๐ฅ Observability Time-Series Forecasting Leaderboard
|
| 36 |
+
- task:
|
| 37 |
+
type: time-series-forecasting
|
| 38 |
+
dataset:
|
| 39 |
+
name: GIFT-Eval
|
| 40 |
+
type: GIFT-Eval
|
| 41 |
+
metrics:
|
| 42 |
+
- type: CRPS
|
| 43 |
+
value: 0.478
|
| 44 |
+
name: CRPS
|
| 45 |
+
- type: MASE
|
| 46 |
+
value: 0.699
|
| 47 |
+
name: MASE
|
| 48 |
+
source:
|
| 49 |
+
url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
|
| 50 |
+
name: GIFT-Eval Time Series Forecasting Leaderboard
|
| 51 |
+
- task:
|
| 52 |
+
type: time-series-forecasting
|
| 53 |
+
dataset:
|
| 54 |
+
name: TIME
|
| 55 |
+
type: TIME
|
| 56 |
+
metrics:
|
| 57 |
+
- type: CRPS
|
| 58 |
+
value: 0.537
|
| 59 |
+
name: CRPS
|
| 60 |
+
- type: MASE
|
| 61 |
+
value: 0.643
|
| 62 |
+
name: MASE
|
| 63 |
+
source:
|
| 64 |
+
url: https://huggingface.co/spaces/Real-TSF/TIME-leaderboard
|
| 65 |
+
name: TIME Benchmark Leaderboard
|
| 66 |
---
|
| 67 |
|
| 68 |
# Toto-2.0-1B
|
| 69 |
|
| 70 |
+
[**Technical Report**](https://huggingface.co/papers/2605.20119) | [**GitHub**](https://github.com/DataDog/toto) | [**Blog Post**](https://www.datadoghq.com/blog/ai/toto-2/)
|
| 71 |
+
|
| 72 |
Toto (Time Series Optimized Transformer for [Observability](https://www.datadoghq.com/knowledge-center/observability/)) is a family of time series foundation models for multivariate forecasting developed by [Datadog](https://www.datadoghq.com/). Toto 2.0 is the current generation, featuring u-ฮผP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family.
|
| 73 |
|
| 74 |
+
The model was introduced in the paper [Toto 2.0: Time Series Forecasting Enters the Scaling Era](https://huggingface.co/papers/2605.20119) by Emaad Khwaja, Chris Lettieri, Gerald Woo, Eden Belouadah, Marc Cenac, Guillaume Jarry, Enguerrand Paquin, Xunyi Zhao, Viktoriya Zhukov, Othmane Abou-Amal, Chenghao Liu, Ameet Talwalkar, and David Asker.
|
| 75 |
+
|
| 76 |
The family sets a new state of the art on three forecasting benchmarks: [BOOM](https://huggingface.co/spaces/Datadog/BOOM), our observability benchmark; [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the standard general-purpose benchmark; and the recent contamination-resistant [TIME](https://arxiv.org/abs/2602.12147) benchmark.
|
| 77 |
|
| 78 |
## ๐ Performance
|
|
|
|
| 143 |
|
| 144 |
<figure>
|
| 145 |
<img src="assets/architecture.png" alt="Overview of the Toto 2.0 architecture.">
|
| 146 |
+
<figcaption>A decoder-only patched transformer whose attention layers alternate between time-axis (causal) and variate-axis (full) views of the input. Toto 2.0 adds <b>contiguous patch masking (CPM)</b> for single-pass parallel decoding, a <b>quantile output head</b> trained with pinball loss, a robust arcsinh input scaler, residual MLP patch projections, and is trained with NorMuon. See the <a href="https://huggingface.co/papers/2605.20119">technical report</a> for details.</figcaption>
|
| 147 |
</figure>
|
| 148 |
|
| 149 |
## ๐ Additional Resources
|
| 150 |
|
| 151 |
+
- [Technical Report](https://huggingface.co/papers/2605.20119)
|
| 152 |
- [Blog Post](https://www.datadoghq.com/blog/ai/toto-2/)
|
| 153 |
- [GitHub Repository](https://github.com/DataDog/toto)
|
| 154 |
- [Toto 2.0 Collection](https://huggingface.co/collections/Datadog/toto-20) โ all five base checkpoints
|
|
|
|
| 167 |
primaryClass={cs.LG},
|
| 168 |
url={https://arxiv.org/abs/2605.20119},
|
| 169 |
}
|
| 170 |
+
```
|