Instructions to use armanakbari4/g1_fdmV2_allTasks_1250 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use armanakbari4/g1_fdmV2_allTasks_1250 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("armanakbari4/g1_fdmV2_allTasks_1250", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
g1_fdmV2_allTasks_1250 โ LingBot-VA G1 multi-task transformer (step 1250)
Fine-tuned transformer for LingBot-VA on Unitree G1 (Dex1), joint 5-task
post-train on JingwuLuo/all_tasks_lerobot (300 episodes across 5 tasks).
- Base:
robbyant/lingbot-va-base - Post-training: 300 demos / 5 tasks (one multi-task fine-tune), lr 1e-5,
FDM v2 recipe โ mutually-exclusive per-microstep regime (rank-synced coin
fdm_prob=0.5: FDM video-only L_fdm Eq.13lambda_fdm=1.0OR standard IDM L_dyn+L_inv; one forward, one backward). - Optimizer step 1250 of a 5000-step schedule โ early/partial checkpoint (the run stopped at 1250 before completion). Useful for early eval; expect better with a finished 5000-step run.
- This repo contains only
transformer/โvae/,text_encoder/,tokenizer/are unchanged fromrobbyant/lingbot-va-base.
Tasks covered (instruction strings used during training)
| slug | instruction |
|---|---|
open_lid_add_potato |
Open the pot's lid and put the potato inside the pot. |
pick_red_bottle |
Pick up the red bottle |
pick_and_move_bottle |
Pick the pink object and put it on the cross mark. |
put_carrot_n_cup |
Pick up the carrot and put it inside the blue cup, then put the cup on the cross mark. |
put_cup_n_broccoli |
Pick the pink object and put it in the orange basket, then pick up the broccoli and put it inside the pink object. |
Assemble an eval-ready checkpoint
hf download robbyant/lingbot-va-base --local-dir lingbot-va-base
hf download armanakbari4/g1_fdmV2_allTasks_1250 --local-dir alltasks_1250_dl
mkdir -p g1_alltasks_1250
ln -sf $(realpath alltasks_1250_dl/transformer) g1_alltasks_1250/transformer
ln -sf $(realpath lingbot-va-base/vae) g1_alltasks_1250/vae
ln -sf $(realpath lingbot-va-base/text_encoder) g1_alltasks_1250/text_encoder
ln -sf $(realpath lingbot-va-base/tokenizer) g1_alltasks_1250/tokenizer
Serve with CONFIG_NAME=g1_alltasks MODEL_PATH=g1_alltasks_1250. Use the same
instruction string per task as the training table above.
transformer/config.json has attn_mode: torch (inference-ready).
- Downloads last month
- -