Skip to content

[Group6] Submission #120

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 77 commits into
base: main
Choose a base branch
from
Open

[Group6] Submission #120

wants to merge 77 commits into from

Conversation

k-makihara
Copy link

Summary

  • group6 提出用のセットアップ & 評価手順を追加/整備
  • 評価スクリプト/関連モジュールの更新
  • Isaac-GR00T をサブモジュール化し、コミット固定

Changes (code)

  • New: simpler_env/evaluation/evaluate.py
  • Update: simpler_env/evaluation/bridge_tasks.py
  • Update: simpler_env/evaluation/evaluate_bridge.py
  • Update: simpler_env/evaluation/random_envs.py
  • Update: simpler_env/policies/gr00t/gr00t_model.py
  • Submodule: Isaac-GR00T を追加（pinned to 4ea96a16b15cfdbbd787b6b4f519a12687281330）

Sync with upstream/benchmark-v2

  • 基準ブランチ: benchmark-v2
  • 同期日: 2025-10-03 (JST)
  • 取り込み元: upstream/benchmark-v2

WASABI Checkpoints (必須)

  • : s3://airoa-fm-development-competition/group6/simpler_checkpoint

How to Run

詳細手順は simpler_env_miniconda.mdを参照

WidowX（Bridge）:

python scripts/gr00t/evaluate_bridge.py \
  --ckpt-path /path/to/checkpoint-group6

Google Robot（Fractal）:

python scripts/gr00t/evaluate_fractal.py \
  --ckpt-path /path/to/checkpoint-group6

YN35 and others added 30 commits August 7, 2025 09:11
@YN35
from simpler-openvla
768f808
@YN35
stable run
fea2468
@YN35
stable run
b6eb6eb
@YN35
add bridge
f027da6
@YN35
openpiはコードを書き換えないといけ無さそう
e8bce20
@YN35
rt1 ok
019e4d2
@YN35
環境実装完了
2f40c11
@Penrose0v0
Init bridge challenge
6e832d2
@Penrose0v0
Changed name bridge -> widowx
be712c4
@Penrose0v0
Added control_freq
1a4c74a
@Penrose0v0
Init readme
99d3aab
@shu-morikuni-weblab
Merge pull request #23 from airoa-org/feature/benchmark-v2-widowx
f7ee715 
Feature/benchmark v2 widowx
@YN35
Merge branch 'benchmark-v2' into dev/benchmark-v2-fractal
acb4155
@YN35
Merge pull request #24 from airoa-org/dev/benchmark-v2-fractal
c2293e6 
Dev/benchamrk-v2-fractal
@YN35
add docs
21e206d
@Penrose0v0
Fixed readme bug
7aed573
@Penrose0v0
To save summary
871c20b
@YN35
add episode_xy
ef55fe7
Modified task definition
ca7f901
Randomized episode & Added success time cost record
53f3ddf
@YN35
add object pos randomizer
d0677b8
@YN35
add all randomizer
2c4ce0a
@YN35
fix randomizer
ee0f3a3
@shu-morikuni-weblab
Merge pull request #27 from airoa-org/dev/benchmark-v2-fractal-random
f000b60 
Dev/benchmark v2 fractal random
@YN35
Merge branch 'benchmark-v2' into feature/benchmark-v2-widowx
3743c4d
@shu-morikuni-weblab
Merge pull request #28 from airoa-org/feature/benchmark-v2-widowx
6bdd844 
Feature/benchmark v2 widowx
@YN35
good logging
1fa849b
@shu-morikuni-weblab
Merge pull request #29 from airoa-org/dev/benchmark-v2-logging-improve
a8f8212 
good logging
Changed csv into json
34d28e3
Record "episode_id" -> "trial_id"
a5229dc
shu-morikuni-weblab and others added 29 commits September 19, 2025 13:54
@shu-morikuni-weblab
Merge pull request #40 from airoa-org/update-docs
4507f21 
update readme
@YN35
スコア計算追加（仮）
8d0b404
Fixed bridge tasks max time setting
4d1993a
Added early stopping script & Modified output video fps
f9c7b7e
Debugged widowx task1 grasp steps
d8ad8c4
@shu-morikuni-weblab
Merge pull request #41 from airoa-org/dev/benchmarkv2-fix-videosave
005d356 
Dev/benchmarkv2 fix videosave
Debugged with merging
8cedcd5
Merge remote-tracking branch 'origin/benchmark-v2' into dev/benchmark…
f1695ce 
…-v2/score
Merge remote-tracking branch 'origin/benchmark-v2' into dev/benchmark…
a053c60 
…-v2/early-stopping
@shu-morikuni-weblab
Merge pull request #43 from airoa-org/dev/benchmark-v2/score
c653c44 
Dev/benchmark v2/score
Init openpi google robot challenge script
7b61435
Able to set control_freq & Fixed max_time
9647a26
@YN35
add grasped and has_contact to stats
a8d2cc6
@shu-morikuni-weblab
Merge pull request #45 from airoa-org/benchmarkv2-add-stats
c91abde 
add grasped and has_contact to stats
Merge branch 'benchmark-v2' into dev/benchmark-v2/early-stopping
f8c6b7c
Changed success_threshold_s from 3 to 5 [s]
1f45d11
@shu-morikuni-weblab
Merge pull request #47 from airoa-org/dev/benchmark-v2/early-stopping
b9ba996 
Dev/benchmark v2/early stopping
@hiroking0523
Add/update evaluate_bridge.py & evaluate_fractal.py for group6/benchm…
09ee773 
…ark-v2
@hiroking0523
評価用スクリプトと関連モジュールの更新
834cceb
@hiroking0523
成功率を出力するように変更
e13b681
@hiroking0523
Add Isaac-GR00T as submodule pinned to 4ea96a1
fba4b9e
@YN35
fix _run_single_evaluation
bc7f706
@hiroking0523
Add Isaac-GR00T as submodule pinned to 4ea96a1
d56bd53
@hiroking0523
コピー用のdata_configとembodiment_tagsを配置
d0dab9e
@hiroking0523
data_configを一意に指定
b8c1d3a
@hiroking0523
環境構築〜実行の手順書
af4852d
@hiroking0523
Merge upstream/benchmark-v2 into group6-benchmark-v2 (keep ours for b…
7861f2b 
…ridge_tasks.py)
@YN35
fix random_envs
e951ac2
@k-makihara
Merge branch 'benchmark-v2' into group6/benchmark-v2
290597a
@xuanlinli17
Copy link
Collaborator

Could you fork the repo? It's hard to merge to main... Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@k-makihara @xuanlinli17 @YN35 @Penrose0v0 @shu-morikuni-weblab @hiroking0523