Skip to content

Conversation

Copy link

Copilot AI commented Dec 1, 2025

autotrain saves models to {cwd}/{project_name}/, ignoring params.output_dir. The SLURM script ran from an unspecified directory, so models were saved elsewhere.

Changes

  • train_smollm.slurm: cd to checkpoints directory before running autotrain
  • config_smollm3.yaml: Added documentation explaining autotrain's output behavior
# Before: autotrain runs from unspecified cwd
autotrain --config "$CONFIG_PATH"

# After: cd to parent of expected output dir first
mkdir -p "$(dirname "$CHECKPOINT_DIR")"
cd "$(dirname "$CHECKPOINT_DIR")"
autotrain --config "$CONFIG_PATH"
# Creates: {checkpoints_dir}/{project_name}/

💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

…train

Co-authored-by: AmitMY <5757359+AmitMY@users.noreply.github.com>
Copilot AI changed the title [WIP] Update output directory handling in tokenizer pipeline Fix autotrain output directory: cd to checkpoints dir before training Dec 1, 2025
Copilot AI requested a review from AmitMY December 1, 2025 14:12
Copilot finished work on behalf of AmitMY December 1, 2025 14:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants