nielsr HF Staff commited on
Commit
7d25ca9
ยท
verified ยท
1 Parent(s): e03823d

Improve model card metadata and add prominent links to paper and code

Browse files

Hi, I'm Niels from the community science team at Hugging Face.

This PR improves the model card for Toto-2.0-1B by:
1. Adding `datasets` metadata to link the model to the `Datadog/BOOM` and `Salesforce/GIFT-Eval` datasets.
2. Adding prominent links to the paper, GitHub repository, and project blog at the top of the README.
3. Mentioning the paper authors in the description.
4. Formally linking the model to the research paper "Toto 2.0: Time Series Forecasting Enters the Scaling Era" (arXiv:2605.20119).

Please review and merge if this looks good to you!

Files changed (1) hide show
  1. README.md +57 -50
README.md CHANGED
@@ -1,4 +1,9 @@
1
  ---
 
 
 
 
 
2
  tags:
3
  - time-series-forecasting
4
  - foundation-models
@@ -9,63 +14,65 @@ tags:
9
  - observability
10
  - safetensors
11
  - pytorch_model_hub_mixin
12
- license: apache-2.0
13
- pipeline_tag: time-series-forecasting
14
  thumbnail: https://web-assets.dd-static.net/42588/1778691695-toto-2-hero.png
15
  model-index:
16
  - name: Toto-2.0-1B
17
  results:
18
- - task:
19
- type: time-series-forecasting
20
- dataset:
21
- name: BOOM
22
- type: BOOM
23
- metrics:
24
- - name: CRPS
25
- type: CRPS
26
- value: 0.349
27
- - name: MASE
28
- type: MASE
29
- value: 0.582
30
- source:
31
- name: BOOM ๐Ÿ’ฅ Observability Time-Series Forecasting Leaderboard
32
- url: https://huggingface.co/spaces/Datadog/BOOM
33
- - task:
34
- type: time-series-forecasting
35
- dataset:
36
- name: GIFT-Eval
37
- type: GIFT-Eval
38
- metrics:
39
- - name: CRPS
40
- type: CRPS
41
- value: 0.478
42
- - name: MASE
43
- type: MASE
44
- value: 0.699
45
- source:
46
- name: GIFT-Eval Time Series Forecasting Leaderboard
47
- url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
48
- - task:
49
- type: time-series-forecasting
50
- dataset:
51
- name: TIME
52
- type: TIME
53
- metrics:
54
- - name: CRPS
55
- type: CRPS
56
- value: 0.537
57
- - name: MASE
58
- type: MASE
59
- value: 0.643
60
- source:
61
- name: TIME Benchmark Leaderboard
62
- url: https://huggingface.co/spaces/Real-TSF/TIME-leaderboard
63
  ---
64
 
65
  # Toto-2.0-1B
66
 
 
 
67
  Toto (Time Series Optimized Transformer for [Observability](https://www.datadoghq.com/knowledge-center/observability/)) is a family of time series foundation models for multivariate forecasting developed by [Datadog](https://www.datadoghq.com/). Toto 2.0 is the current generation, featuring u-ฮผP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family.
68
 
 
 
69
  The family sets a new state of the art on three forecasting benchmarks: [BOOM](https://huggingface.co/spaces/Datadog/BOOM), our observability benchmark; [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the standard general-purpose benchmark; and the recent contamination-resistant [TIME](https://arxiv.org/abs/2602.12147) benchmark.
70
 
71
  ## ๐Ÿ“Š Performance
@@ -136,12 +143,12 @@ All five Toto 2.0 sizes share the same training recipe; pick a size based on you
136
 
137
  <figure>
138
  <img src="assets/architecture.png" alt="Overview of the Toto 2.0 architecture.">
139
- <figcaption>A decoder-only patched transformer whose attention layers alternate between time-axis (causal) and variate-axis (full) views of the input. Toto 2.0 adds <b>contiguous patch masking (CPM)</b> for single-pass parallel decoding, a <b>quantile output head</b> trained with pinball loss, a robust arcsinh input scaler, residual MLP patch projections, and is trained with NorMuon. See the <a href="#-additional-resources">technical report</a> for details.</figcaption>
140
  </figure>
141
 
142
  ## ๐Ÿ”— Additional Resources
143
 
144
- - [Technical Report](https://arxiv.org/abs/2605.20119)
145
  - [Blog Post](https://www.datadoghq.com/blog/ai/toto-2/)
146
  - [GitHub Repository](https://github.com/DataDog/toto)
147
  - [Toto 2.0 Collection](https://huggingface.co/collections/Datadog/toto-20) โ€” all five base checkpoints
@@ -160,4 +167,4 @@ All five Toto 2.0 sizes share the same training recipe; pick a size based on you
160
  primaryClass={cs.LG},
161
  url={https://arxiv.org/abs/2605.20119},
162
  }
163
- ```
 
1
  ---
2
+ license: apache-2.0
3
+ pipeline_tag: time-series-forecasting
4
+ datasets:
5
+ - Datadog/BOOM
6
+ - Salesforce/GIFT-Eval
7
  tags:
8
  - time-series-forecasting
9
  - foundation-models
 
14
  - observability
15
  - safetensors
16
  - pytorch_model_hub_mixin
 
 
17
  thumbnail: https://web-assets.dd-static.net/42588/1778691695-toto-2-hero.png
18
  model-index:
19
  - name: Toto-2.0-1B
20
  results:
21
+ - task:
22
+ type: time-series-forecasting
23
+ dataset:
24
+ name: BOOM
25
+ type: BOOM
26
+ metrics:
27
+ - type: CRPS
28
+ value: 0.349
29
+ name: CRPS
30
+ - type: MASE
31
+ value: 0.582
32
+ name: MASE
33
+ source:
34
+ url: https://huggingface.co/spaces/Datadog/BOOM
35
+ name: BOOM ๐Ÿ’ฅ Observability Time-Series Forecasting Leaderboard
36
+ - task:
37
+ type: time-series-forecasting
38
+ dataset:
39
+ name: GIFT-Eval
40
+ type: GIFT-Eval
41
+ metrics:
42
+ - type: CRPS
43
+ value: 0.478
44
+ name: CRPS
45
+ - type: MASE
46
+ value: 0.699
47
+ name: MASE
48
+ source:
49
+ url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
50
+ name: GIFT-Eval Time Series Forecasting Leaderboard
51
+ - task:
52
+ type: time-series-forecasting
53
+ dataset:
54
+ name: TIME
55
+ type: TIME
56
+ metrics:
57
+ - type: CRPS
58
+ value: 0.537
59
+ name: CRPS
60
+ - type: MASE
61
+ value: 0.643
62
+ name: MASE
63
+ source:
64
+ url: https://huggingface.co/spaces/Real-TSF/TIME-leaderboard
65
+ name: TIME Benchmark Leaderboard
66
  ---
67
 
68
  # Toto-2.0-1B
69
 
70
+ [**Technical Report**](https://huggingface.co/papers/2605.20119) | [**GitHub**](https://github.com/DataDog/toto) | [**Blog Post**](https://www.datadoghq.com/blog/ai/toto-2/)
71
+
72
  Toto (Time Series Optimized Transformer for [Observability](https://www.datadoghq.com/knowledge-center/observability/)) is a family of time series foundation models for multivariate forecasting developed by [Datadog](https://www.datadoghq.com/). Toto 2.0 is the current generation, featuring u-ฮผP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family.
73
 
74
+ The model was introduced in the paper [Toto 2.0: Time Series Forecasting Enters the Scaling Era](https://huggingface.co/papers/2605.20119) by Emaad Khwaja, Chris Lettieri, Gerald Woo, Eden Belouadah, Marc Cenac, Guillaume Jarry, Enguerrand Paquin, Xunyi Zhao, Viktoriya Zhukov, Othmane Abou-Amal, Chenghao Liu, Ameet Talwalkar, and David Asker.
75
+
76
  The family sets a new state of the art on three forecasting benchmarks: [BOOM](https://huggingface.co/spaces/Datadog/BOOM), our observability benchmark; [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the standard general-purpose benchmark; and the recent contamination-resistant [TIME](https://arxiv.org/abs/2602.12147) benchmark.
77
 
78
  ## ๐Ÿ“Š Performance
 
143
 
144
  <figure>
145
  <img src="assets/architecture.png" alt="Overview of the Toto 2.0 architecture.">
146
+ <figcaption>A decoder-only patched transformer whose attention layers alternate between time-axis (causal) and variate-axis (full) views of the input. Toto 2.0 adds <b>contiguous patch masking (CPM)</b> for single-pass parallel decoding, a <b>quantile output head</b> trained with pinball loss, a robust arcsinh input scaler, residual MLP patch projections, and is trained with NorMuon. See the <a href="https://huggingface.co/papers/2605.20119">technical report</a> for details.</figcaption>
147
  </figure>
148
 
149
  ## ๐Ÿ”— Additional Resources
150
 
151
+ - [Technical Report](https://huggingface.co/papers/2605.20119)
152
  - [Blog Post](https://www.datadoghq.com/blog/ai/toto-2/)
153
  - [GitHub Repository](https://github.com/DataDog/toto)
154
  - [Toto 2.0 Collection](https://huggingface.co/collections/Datadog/toto-20) โ€” all five base checkpoints
 
167
  primaryClass={cs.LG},
168
  url={https://arxiv.org/abs/2605.20119},
169
  }
170
+ ```