Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make the db always use utf8mb4_unicode_ci #17

Closed

Conversation

EXtremeExploit
Copy link
Member

@EXtremeExploit EXtremeExploit commented Nov 28, 2022

latin1_german1_ci doesn't support characters that allocate more than 2 bytes apparently, even less 4 which is for unicode ones, but utf8mb4_unicode_ci does!. I am not sure why the default language for every other string in the db is not 4 bytes unicode, or why it is polish/latin, ig it was a fast decision to allow for some special characters but not all?, still. drafting as if thats the case then i guess it should be A LOT BETTER to directly switch the default language to utf8mb4_unicode_ci to not allow for this to happen again

closes #9

@Tanza3D
Copy link
Member

Tanza3D commented Nov 28, 2022

if it helps, the database on osekai seems to use utf8mb4_bin by default for the entire database. can confirm though that the notes field is latin1_german1_ci, infact most of them are, but this seems fine in most cases?
image
image
the tables themselves are kind of all over the place too, might be worth just picking one specific one for us to use and going through all these changing them.

@Tanza3D
Copy link
Member

Tanza3D commented Nov 28, 2022

if we do the latter i'd have to do it

@minusQuantumNeko minusQuantumNeko added the Code For Issues or Pull Requests related to code label Nov 28, 2022
@EXtremeExploit EXtremeExploit changed the title Make notes use utf8mb4_unicode_ci encoding Make the db always use utf8mb4_unicode_ci Nov 28, 2022
@EXtremeExploit
Copy link
Member Author

i close this as its not using the new .sql templated and if problem ever comes i might open a new pr for it, but for the time being, its useless now

osekai-team pushed a commit that referenced this pull request Sep 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Code For Issues or Pull Requests related to code size/L
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Special characters not working in Note section for beatmaps
3 participants