Skip to content

Judging

Ashwin Ramaswami edited this page Jan 29, 2019 · 6 revisions

Admin - judging management

Bulk import hacks

Go to "bulk import hacks" and copy-and-paste your csv file from devpost here. Make sure you don't include the header column. image

Table is a numeric attribute and stored in the "_id" column of the database. It auto-increments and cannot be changed.

View hacks

image

Create judges

Make sure you create judges only using the "Bulk create users" functionality. If you do it directly through Cognito, a corresponding "Judge" entry in the DB will not be created and the judge won't show up in the judge table! image

View judges

You can view judges on the judge table. You can also edit their verticals here. If a judge is assigned to a vertical(s), they will get hacks from that vertical to review. image

Setup before tournament

Make sure you input which vertical maps to which grand prize over here: https://github.com/TreeHacks/application-portal/blob/62c3b8413523046ea5fa9ef20c5179242215bc71/src/constants.ts#L39

export const VERTICALS_TO_CATEGORIES = {
  "health": "Health Grand Prize",
  "safety": "Security Grand Prize",
  "awareness": "Energy Grand Prize",
  // Required for unit tests:
  "test1": "test1",
  "test2": "test2",
  "test3": "test3"
}

Export

You can click "export as JSON" and the judges will export, ready to be fed into the judging Python scripts! Format is an array of items like this:

[
    {
        "_id": 2,
        "categories": [
            "1"
        ],
        "title": "title1",
        "devpostUrl": "https://google.com",
        "reviews": [
            {
                "reader": {
                    "id": "abcdef-asdajsd-sadas-j76e2dd9",
                    "email": "judge@treehacks.com"
                },
                "creativity": 1,
                "technicalComplexity": 1,
                "socialImpact": 3,
                "comments": "asdasdad"
            }
        ],
        "__v": 1
    },
]

Judges

Login

Login at https://root.treehacks.com

Review

Judges can review. They can also skip a hack if they don't want to review it. Once a hack has 3 reviews, it's no longer displayed in the queue or "number remaining". image

TODO

  • TODO: show stats such as # of applications reviewed on the judges table.
  • TODO: show stats such as average ranking on the hacks table.
  • TODO: allow judges to enter a custom table number on the judge review table.
Clone this wiki locally