Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hypersweeper does not provide config_id #12

Closed
LukasFehring opened this issue May 17, 2024 · 1 comment
Closed

Hypersweeper does not provide config_id #12

LukasFehring opened this issue May 17, 2024 · 1 comment

Comments

@LukasFehring
Copy link
Collaborator

  • HyperSweeper version: Any
  • Python version: Any
  • Operating System: Any

Description

When executing Hyperband using SMAC, each config has a consistent config_id attribute. The serialized configuration used by the hypersweeper does not seem to provide that configid. To start execution based on the lower fidelity results, this should probably be adapted, to provide an easy way of continuing execution.

Steps/Code to Reproduce

Located at /hydra_plugins/hypersweeper/hypersweeper_sweeper.py we can see that the configuration_id is disregarded

info, terminate = self.optimizer.ask()
configs.append(info.config)
@TheEimer
Copy link
Contributor

This is not trivial since this kind of information is pretty unique to SMAC... but if SMAC just counts up, it matches the hypersweeper one anyway and as far as I can see that's the case. I'm not including these since I'm not creating a different log loop just for this one SMAC value. SMAC logs everything on its own anyway, I don't see the big benefit of so much code overhead.

@TheEimer TheEimer closed this as not planned Won't fix, can't repro, duplicate, stale Sep 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants