sft_robodojo_eefabs_sana_pixel_320x512_mot49500_aligned_f33fps8

Final RoboDojo ARX-X5 MoT SFT checkpoint: epoch 10, optimizer step 36,180. Original training run: sft_robodojo_mot_eefabs_sana_pixel_320x512_pretrained_s49500_aligned_f33fps8.

Model and initialization

Both video and action experts were initialized by weight-only transfer from the regular MoT pretrained checkpoint epoch 9, step 49,500. SFT used the native MoT policy and a fresh optimizer/scheduler. The donor is available at logits/sana_policy_pretrained_mot_e9s49500.

• Model: SanaRWMMoTAttnResPolicy_5B_P1_D36.
• Layout: direct Sana Pixel 2x2 RGB canvas, height 320 x width 512, with 160x256 tiles. Head view is top-left, wrists are below, and top-right is black.
• RoPE: aligned; action_state_as_context=false.
• One canvas prompt, with a separate caption embedder for each expert.
• Absolute robot-base EEF targets only, action mode ratio [0, 1, 0]; joint slots are masked.
• Rotation: column 6D representation. XYZ and gripper use q01/q99 statistics; rotation uses fixed min=-1/max=1 normalization. The included normalization artifact applies to initial state and action targets.

Training

All 3,500 episodes; 33 source rows at 25 Hz. Configured video_fps=8 uses stride 4: source rows 0,4,...,32 give 9 sampled RGB frames, 2 latent frames, and 32 dense action rows per window. Latent shape is [128, 2, 10, 16]. Video latents were read from the precomputed cache, including freeze-padded tail windows.

8 nodes x 4 GPUs x 16 samples/GPU = global batch 512; accumulation 1. 10 epochs, AdamW learning rate 1e-4, cosine decay, 2,000 warmup steps, weight decay 1e-4, gradient norm clip 1, action loss weight 1.

Video/action flow shifts 5/1, standard flow shift without token-count scaling. Timestep loss weighting is OpenWAM, with min_weight=0.1. Exact settings are archived in config.yaml and training_manifest.json.

Frozen training revision: 0928354f8505a61c1ffb21b338c4e00612d3e010, plus the source overlay identified by manifest SHA256 d93766d1c93649bf5e41bb2a2ce99cae778c9ca586cb344c513dd0b9d96d88e8.

W&B training run. Slurm job 59121 completed with exit code 0.

Files

• model/pytorch_model_fsdp.bin: full native MoT state dictionary, including video and action experts.
• metadata.pth: saved epoch/step and checkpoint metadata.
• config.yaml: exact frozen source configuration used for SFT.
• normalization/robodojo_arx_x5_model_fps_25_f33_normalization.json: normalization artifact used for training.
• training_manifest.json: initialization, sampling, layout and training provenance.
• upload_metadata.json: file hashes and upload provenance.

This is a model-weight export; optimizer checkpoint files are not included. The archived config preserves original local paths and the original training run name.