Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add translator text transformation tests #565

Merged
merged 11 commits into from
Jan 28, 2024
Merged

add translator text transformation tests #565

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
5bbbe72
Copy functions from JapaneseUtil
toasted-nutbread Jan 21, 2024
52a5f5b
Remove JapaneseUtil
toasted-nutbread Jan 21, 2024
59fd9ed
Update usages of JapaneseUtil functions
toasted-nutbread Jan 21, 2024
2d71abb
add tests
StefanVukovic99 Jan 23, 2024
e0ff55f
Copy functions from JapaneseUtil
toasted-nutbread Jan 21, 2024
51d1d22
Remove JapaneseUtil
toasted-nutbread Jan 21, 2024
e5c6994
Update usages of JapaneseUtil functions
toasted-nutbread Jan 21, 2024
1185860
Merge branch 'master' into text-transformation-tests
StefanVukovic99 Jan 27, 2024
bea7c56
Merge remote-tracking branch 'toasted-nutbread/japanese-util-refactor…
StefanVukovic99 Jan 27, 2024
a262149
Merge branch 'master' into text-transformation-tests
djahandarie Jan 28, 2024
197b746
Merge branch 'master' into text-transformation-tests
StefanVukovic99 Jan 28, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
309 changes: 309 additions & 0 deletions test/data/anki-note-builder-test-results.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2903,5 +2903,314 @@
"url": "<a href=\"url:\">url:</a>"
}
]
},
{
"name": "Test text transformations - convertNumericCharacters",
"results": [
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "39",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "３９",
"frequencies": "",
"furigana": "<ruby>３９<rt>さんきゅう</rt></ruby>",
"furigana-plain": "３９[さんきゅう]",
"glossary": "<div style=\"text-align: left;\"><i>(Test Dictionary 2)</i> sankyuu definition</div>",
"glossary-brief": "<div style=\"text-align: left;\">sankyuu definition</div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\">sankyuu definition</div>",
"part-of-speech": "Unknown",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "さんきゅう",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefix39cloze-suffix",
"sentence-furigana": "cloze-prefix39cloze-suffix",
"tags": "",
"url": "<a href=\"url:\">url:</a>"
}
]
},
{
"name": "Test text transformations - convertAlphabeticCharacters",
"results": [
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "utsu",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "打つ",
"frequencies": "<ul style=\"text-align: left;\"><li>Test Dictionary 2: 2</li><li>Test Dictionary 2: 6</li><li>Test Dictionary 2: 10</li><li>Test Dictionary 2: sixteen</li><li>Test Dictionary 2: twenty-two (22)</li><li>Test Dictionary 2: 28</li></ul>",
"furigana": "<ruby>打<rt>う</rt></ruby>つ",
"furigana-plain": "打[う]つ",
"glossary": "<div style=\"text-align: left;\"><i>(vt, Test Dictionary 2)</i> <ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"glossary-brief": "<div style=\"text-align: left;\"><ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\"><i>(vt)</i> <ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"part-of-speech": "Godan verb",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "うつ",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefixutsucloze-suffix",
"sentence-furigana": "cloze-prefixutsucloze-suffix",
"tags": "vt",
"url": "<a href=\"url:\">url:</a>"
},
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "utsu",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "打つ",
"frequencies": "<ul style=\"text-align: left;\"><li>Test Dictionary 2: 2</li><li>Test Dictionary 2: 6</li><li>Test Dictionary 2: 10</li><li>Test Dictionary 2: sixteen</li><li>Test Dictionary 2: twenty-two (22)</li><li>Test Dictionary 2: 28</li></ul>",
"furigana": "<ruby>打<rt>う</rt></ruby>つ",
"furigana-plain": "打[う]つ",
"glossary": "<div style=\"text-align: left;\"><i>(vt, Test Dictionary 2)</i> <ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"glossary-brief": "<div style=\"text-align: left;\"><ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\"><i>(vt)</i> <ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"part-of-speech": "Godan verb",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "うつ",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefixutsucloze-suffix",
"sentence-furigana": "cloze-prefixutsucloze-suffix",
"tags": "vt",
"url": "<a href=\"url:\">url:</a>"
}
]
},
{
"name": "Test text transformations - convertKatakanaToHiragana",
"results": [
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "ウツ",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "打つ",
"frequencies": "<ul style=\"text-align: left;\"><li>Test Dictionary 2: 2</li><li>Test Dictionary 2: 6</li><li>Test Dictionary 2: 10</li><li>Test Dictionary 2: sixteen</li><li>Test Dictionary 2: twenty-two (22)</li><li>Test Dictionary 2: 28</li></ul>",
"furigana": "<ruby>打<rt>う</rt></ruby>つ",
"furigana-plain": "打[う]つ",
"glossary": "<div style=\"text-align: left;\"><i>(vt, Test Dictionary 2)</i> <ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"glossary-brief": "<div style=\"text-align: left;\"><ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\"><i>(vt)</i> <ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"part-of-speech": "Godan verb",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "うつ",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefixウツcloze-suffix",
"sentence-furigana": "cloze-prefixウツcloze-suffix",
"tags": "vt",
"url": "<a href=\"url:\">url:</a>"
},
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "ウツ",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "打つ",
"frequencies": "<ul style=\"text-align: left;\"><li>Test Dictionary 2: 2</li><li>Test Dictionary 2: 6</li><li>Test Dictionary 2: 10</li><li>Test Dictionary 2: sixteen</li><li>Test Dictionary 2: twenty-two (22)</li><li>Test Dictionary 2: 28</li></ul>",
"furigana": "<ruby>打<rt>う</rt></ruby>つ",
"furigana-plain": "打[う]つ",
"glossary": "<div style=\"text-align: left;\"><i>(vt, Test Dictionary 2)</i> <ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"glossary-brief": "<div style=\"text-align: left;\"><ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\"><i>(vt)</i> <ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"part-of-speech": "Godan verb",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "うつ",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefixウツcloze-suffix",
"sentence-furigana": "cloze-prefixウツcloze-suffix",
"tags": "vt",
"url": "<a href=\"url:\">url:</a>"
}
]
},
{
"name": "Test text transformations - convertHiraganaToKatakana",
"results": [
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "てきすと",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "テキスト",
"frequencies": "",
"furigana": "テキスト",
"furigana-plain": "テキスト",
"glossary": "<div style=\"text-align: left;\"><i>(n, Test Dictionary 2)</i> <ul><li>text definition 1</li><li>text definition 2</li></ul></div>",
"glossary-brief": "<div style=\"text-align: left;\"><ul><li>text definition 1</li><li>text definition 2</li></ul></div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\"><i>(n)</i> <ul><li>text definition 1</li><li>text definition 2</li></ul></div>",
"part-of-speech": "Noun",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "テキスト",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefixてきすとcloze-suffix",
"sentence-furigana": "cloze-prefixてきすとcloze-suffix",
"tags": "n",
"url": "<a href=\"url:\">url:</a>"
}
]
},
{
"name": "Test text transformations - convertHalfWidthCharacters, convertKatakanaToHiragana",
"results": [
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "ｳﾂ",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "打つ",
"frequencies": "<ul style=\"text-align: left;\"><li>Test Dictionary 2: 2</li><li>Test Dictionary 2: 6</li><li>Test Dictionary 2: 10</li><li>Test Dictionary 2: sixteen</li><li>Test Dictionary 2: twenty-two (22)</li><li>Test Dictionary 2: 28</li></ul>",
"furigana": "<ruby>打<rt>う</rt></ruby>つ",
"furigana-plain": "打[う]つ",
"glossary": "<div style=\"text-align: left;\"><i>(vt, Test Dictionary 2)</i> <ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"glossary-brief": "<div style=\"text-align: left;\"><ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\"><i>(vt)</i> <ul><li>utsu definition 1</li><li>utsu definition 2</li></ul></div>",
"part-of-speech": "Godan verb",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "うつ",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefixｳﾂcloze-suffix",
"sentence-furigana": "cloze-prefixｳﾂcloze-suffix",
"tags": "vt",
"url": "<a href=\"url:\">url:</a>"
},
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "ｳﾂ",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "打つ",
"frequencies": "<ul style=\"text-align: left;\"><li>Test Dictionary 2: 2</li><li>Test Dictionary 2: 6</li><li>Test Dictionary 2: 10</li><li>Test Dictionary 2: sixteen</li><li>Test Dictionary 2: twenty-two (22)</li><li>Test Dictionary 2: 28</li></ul>",
"furigana": "<ruby>打<rt>う</rt></ruby>つ",
"furigana-plain": "打[う]つ",
"glossary": "<div style=\"text-align: left;\"><i>(vt, Test Dictionary 2)</i> <ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"glossary-brief": "<div style=\"text-align: left;\"><ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\"><i>(vt)</i> <ul><li>utsu definition 3</li><li>utsu definition 4</li></ul></div>",
"part-of-speech": "Godan verb",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "うつ",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefixｳﾂcloze-suffix",
"sentence-furigana": "cloze-prefixｳﾂcloze-suffix",
"tags": "vt",
"url": "<a href=\"url:\">url:</a>"
}
]
},
{
"name": "Test text transformations - collapseEmphaticSequences",
"results": [
{
"audio": "",
"clipboard-image": "",
"clipboard-text": "",
"cloze-body": "すっっごーーい",
"cloze-prefix": "cloze-prefix",
"cloze-suffix": "cloze-suffix",
"conjugation": "",
"dictionary": "Test Dictionary 2",
"document-title": "title",
"expression": "凄い",
"frequencies": "",
"furigana": "<ruby>凄<rt>すご</rt></ruby>い",
"furigana-plain": "凄[すご]い",
"glossary": "<div style=\"text-align: left;\"><i>(adj-i, Test Dictionary 2)</i> sugoi definition</div>",
"glossary-brief": "<div style=\"text-align: left;\">sugoi definition</div>",
"glossary-no-dictionary": "<div style=\"text-align: left;\"><i>(adj-i)</i> sugoi definition</div>",
"part-of-speech": "I-adjective",
"pitch-accents": "No pitch accent data",
"pitch-accent-graphs": "No pitch accent data",
"pitch-accent-positions": "No pitch accent data",
"phonetic-transcriptions": "",
"reading": "すごい",
"screenshot": "",
"search-query": "fullQuery",
"selection-text": "",
"sentence": "cloze-prefixすっっごーーいcloze-suffix",
"sentence-furigana": "cloze-prefixすっっごーーいcloze-suffix",
"tags": "adj-i",
"url": "<a href=\"url:\">url:</a>"
}
]
}
]
6 changes: 3 additions & 3 deletions test/data/database-test-cases.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@
"ipa": 1
},
"terms": {
"total": 25
"total": 27
}
}
},
Expand All @@ -36,7 +36,7 @@
{
"kanji": 2,
"kanjiMeta": 6,
"terms": 25,
"terms": 27,
"termMeta": 39,
"tagMeta": 15,
"media": 6
Expand All @@ -45,7 +45,7 @@
"total": {
"kanji": 2,
"kanjiMeta": 6,
"terms": 25,
"terms": 27,
"termMeta": 39,
"tagMeta": 15,
"media": 6
Expand Down
4 changes: 3 additions & 1 deletion test/data/dictionaries/valid-dictionary1/term_bank_1.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -339,5 +339,7 @@
101, "P E1"
],
["のたまう", "のたまう", "v5", "v5", 1, ["notamau definition"], 15, ""],
["のたもうた", "のたもうた", "", "", 1, [["のたまう", ["past"]]], 16, ""]
["のたもうた", "のたもうた", "", "", 1, [["のたまう", ["past"]]], 16, ""],
["３９", "さんきゅう", "", "", 1, ["sankyuu definition"], 17, ""],
["凄い", "すごい", "adj-i", "adj-i", 1, ["sugoi definition"], 18, ""]
]
Loading
Loading