Skip to content

Comments

Add K1 RL training#2216

Open
oleflb wants to merge 1 commit intoHULKs:mainfrom
oleflb:k1-rl
Open

Add K1 RL training#2216
oleflb wants to merge 1 commit intoHULKs:mainfrom
oleflb:k1-rl

Conversation

@oleflb
Copy link
Contributor

@oleflb oleflb commented Feb 18, 2026

Why? What?

Adds the stuff I had in my private K1 RL repo to our public codebase.
The training code is in a working state, but has not yet been tested on physical hardware.

Fixes #

ToDo / Known Issues

If this is a WIP describe which problems are to be fixed.

Ideas for Next Iterations (Not This PR)

If there are some improvements that could be done in a next iteration, describe them here.

How to Test

Describe how to test your changes. (For the reviewer)

Copy link
Contributor

@alexschmander alexschmander left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two small cleanups.
How do we want to handle this PR? Since I cannot really comment on the content of the training setup, should we simply merge it without further review?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These meshes are duplicated. Twice actually.
Two instances in here tools/machine-learning/konerl/model/meshes and tools/machine-learning/konerl/model/meshes/robot, and then the one in tools/mujoco-simulator/mujoco-simulator/K1/meshes. Can we reduce this to a single instance or at the very least only to one instance in each tool folder.

Comment on lines +9 to +15
from mjlab.managers.observation_manager import ObservationManager
from mjlab.scene import Scene
from scipy.spatial.transform import Rotation as R

from konerl.k1_config import ZERO_POSE
from konerl.tasks.k1_velocity_tracking.env_cfg import k1_rough_env_cfg
from konerl.tasks.k1_velocity_tracking.observations import make_observation_cfg
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are unused imports here.

@alexschmander
Copy link
Contributor

Also, the pyproject.toml seems to have escaped a pepsi format 😉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: Request for Review

Development

Successfully merging this pull request may close these issues.

2 participants