Skip to content

Have the ability to rerun all benchmarks in a batch way for top entries only. #417

@msaroufim

Description

@msaroufim

This one is kinda tricky, we need to be versioning evals a bit better and update old measurements in the database without deleting them, it makes it safer for us to update evals and bulk problems

We can also just choose to run this once when a competition concludes but operationally this is very helpful

Would like to have this be part of the popcorn-cli admin commands

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions