You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We could add more of the ます/polite inflection forms. This would be pretty simple, we'd just need to extend the section where we already do that for ません, ました, and ませんでした (WiktionaryPreprocessor.java#L607).
しましょう is currently tokenized as し#ましょ#う, but it should be a single token (polite volitional infl.).
The text was updated successfully, but these errors were encountered:
We could add more of the ます/polite inflection forms. This would be pretty simple, we'd just need to extend the section where we already do that for ません, ました, and ませんでした (WiktionaryPreprocessor.java#L607).
しましょう
is currently tokenized asし#ましょ#う
, but it should be a single token (polite volitional infl.).The text was updated successfully, but these errors were encountered: