Skip to content

Commit

Permalink
Merge pull request #16 from Eve-ning/deploy
Browse files Browse the repository at this point in the history
Bump model to use 10K Dataset
  • Loading branch information
Eve-ning authored Feb 17, 2023
2 parents f060758 + 82bf0c4 commit 7eb1760
Show file tree
Hide file tree
Showing 17 changed files with 505 additions and 12,364 deletions.
6 changes: 5 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,15 +6,19 @@ opal is an accuracy-prediction model.
It uses Neural Collaborative Filtering to learn associations between user and maps, then using those associations to
predict new scores never before seen.

**Performance Error Graph**
![Performance Graph](models/V2_2023_01/error.png)

## Project Status

Currently, it's in its early access, that means, it'll have many problems!

However, we're working on it to minimize these issues o wo)b


## Dataset Used

I used the top 1K mania users data from https://data.ppy.sh.
I used the top 10K mania users data from https://data.ppy.sh.
After preprocessing, we use
- 1m scores for training
- 120k scores for validation and testing each
Expand Down
11 changes: 6 additions & 5 deletions models/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,15 +2,16 @@

**See below on how to load the model.**

| Model | MAE | RMSE | Error Distribution |
|------------|-------|-------|--------------------------------|
| V1_2022_11 | 0.96% | 1.59% | ![Error](V1_2022_11/error.png) |
| Model | R2 | MAE | RMSE | Error Distribution |
|------------|--------|-------|-------|--------------------------------|
| V2_2023_01 | 77.77% | 1.23% | 1.90% | ![Error](V2_2023_01/error.png) |

**Note: V1 is deprecated due to incompatibility with new model signature.**
## Limitations

The model cannot ...
- predict maps not played by at least 50 players within the top 1k
- predict players not in the top 1k
- predict maps not played by at least 50 players within the top 10k
- predict players not in the top 10k
- predict players who have not played at least 50 unique ranked maps in that year.

The predictive power (i.e. accuracy) is dependent on the number of players associated with each map.
Expand Down
408 changes: 0 additions & 408 deletions models/V1_2022_11/analysis.ipynb

This file was deleted.

Binary file not shown.
Binary file removed models/V1_2022_11/error.png
Binary file not shown.
Loading

0 comments on commit 7eb1760

Please sign in to comment.