v0.5.0

• Features:

  • Mean and cummulative metrics can now be logged by WandbLogger wrapper.
  • Support for automatically running multiple samples/trials of same experiment via num_samples config parameter.
  • Configs named .beobench.yml will be automatically parsed when Beobench is run in directory containing such a config. This allows users to set e.g. wandb API keys without referring to the config in every Beobench command call.
  • Configs from experiments now specify the Beobench version used. When trying to rerun an experiment this version will be checked, and an error thrown if there is a mismatch between installed and requested version.
  • Add improved high-level API for getting started. This uses the CLI arguments --method, --gym and --env. Example usage: beobench run --method ppo --gym sinergym --env Eplus-5Zone-hot-continuous-v1 (#55).

• Improvements:

  • Add CITATION.cff file to make citing software easier.
  • By default, docker builds of experiment images are now skipped if an image with tag corresponding to installed Beobench version already exists.
  • Remove outdated guides and add yaml configuration description from docs (#38, #76, #78).
  • Add support for logging multidimensional actions to wandb.
  • Add support for logging summary metrics on every env reset to wandb.
  • Energym config now uses name argument like other integrations (#34).

• Fixes:

  • Updated BOPTEST integration to work with current version of Beobench.