vavi-speech

Text to Speech (JSAPI) engines for Java and Japanese phonemeizers

Staus

Type	Description	Staus	SPI Status	Quality	Comment
AquesTalk	JNI	✅	✅	😐	32bit only
AquesTalk	JNA	✅	✅	😐	32bit only
AquesTalk2	JNI	-	-		mac: intel only
AquesTalk10	JNA	✅	✅	😐	mac: intel only
Google Cloud Text To Speech	Google Cloud Text To Speech	✅	✅	👑
Rococoa	Rococoa, JNA	✅	✅	😃
FreeTTS	FreeTTS	-	✅	💩	not included (test only)

Kanji to Kana converter

Type	Description	Staus	Quality	Comment
Kromoji		✅	😐	number, alphabet
Sen		✅	😐	number, alphabet
Sudachi		✅	😐	助詞(は,へ), number, alphabet
YahooJapan Furigana	Web	✅	😐	助詞(は,へ)
YahooJapan MA	Web	-
Goo Furigana	Web	✅	😐	助詞(は,へ)
Rococoa		✅	😃	数字+助数詞

selected by aquestalk10.properties

Yakuwarigo Converter

name	type	status	qyality	comment
simple	SimpleConverter	✅	💩
ojosama	YakuearigoConverter	✅	😐
zundamon	YakuearigoConverter	🚧

Install

meven

• https://jitpack.io/#umjammer/vavi-speech

AquesTalk10

• place AquesTalk10.framework into ~/Library/Frameworks
• create symbolic link AquesTalk10.framework/AquesTalk as AquesTalk10.framework/AquesTalk10
• write aquesTalk10DevKey into local.properties

Google Cloud Text To Speech

• get token as json
• set environment variable "GOOGLE_APPLICATION_CREDENTIALS" your_json_path

Sen

$ git clone https://gitlab.com/umjammer/sen.git
$ mvn install

• set $SEN/src/main/home as sen.home in local.properties
• edit aquestalk10.properties like below

$ cat src/test/resources/aquestalk10.properties
phonemer=vavi.speech.phoneme.SenJaPhonemer

Sudachi

$ cd vavi-speech
$ curl -o sudachi-dictionary-20210802-full.zip http://sudachi.s3-website-ap-northeast-1.amazonaws.com/sudachidict/sudachi-dictionary-20210802-full.zip
$ tar zxvf sudachi-dictionary-20210802-full.zip src/test/resources/sudachi/

• edit aquestalk10.properties like below

$ cat src/test/resources/aquestalk10.properties
phonemer=vavi.speech.phoneme.SudachiJaPhonemer

goo to hiragana

• register by github account
  • https://labs.goo.ne.jp/jp/apiregister/
• set key to 'local.properties'
• edit aquestalk10.properties like below

$ cat src/test/resources/aquestalk10.properties
phonemer=vavi.speech.phoneme.GooFuriganaJaPhonemer

yahoo! japan

• https://e.developer.yahoo.co.jp/dashboard/
• set client id to 'local.properties'
• edit aquestalk10.properties like below

$ cat src/test/resources/aquestalk10.properties
phonemer=vavi.speech.phoneme.YahooJapanJaPhonemer

Kuromoji

• default
• edit aquestalk10.properties like below

$ cat src/test/resources/aquestalk10.properties
phonemer=vavi.speech.phoneme.KuromojiJaPhonemer

a3rt

• https://a3rt.recruit.co.jp/product/proofreadingAPI/registered/
• set client id by email into 'local.properties'

References

• https://www.a-quest.com/archive/manual/siyo_onseikigou.pdf
• https://github.com/Luigi-Pizzolito/English2KanaTransliteration

TODO

• implement parameters
• implement voices
• implement audio queues (using org.jvoicexml in FreeTTS, see freetts package also)
• speech.properties
• engine
  • watson
  • https://github.com/festvox/festival
  • voicevox -> vavi-speech2
• jsapi source -> independent project
• auto load aques framework (jna)
• https://www.google.co.jp/ime/cgiapi.html
• text analytics + nicotalk character emotion -> vavi-speech2 (wip)
• tacotron2
• yakuwarigo modifier
  • お嬢様言葉 done
    • remaining some unit tests
    • extract rules as json (done)
  • ずんだもん (wip)
• unify japanese tokenizer (lucene-gosen?)
• AVSpeechSynthesizer needs obj-c block
• access private
  • reflection -> JEP 193: Variable Handles https://qiita.com/yoshioterada/items/319ed0dec4b847d2b1ed <= 17
  • https://github.com/FabricMC/access-widener

Morphological Analyzer

• https://mocobeta.github.io/janome/
• https://developer.yahoo.co.jp/webapi/jlp/ma/v1/parse.html
• https://github.com/neubig/kytea
• https://github.com/google/sentencepiece
  • https://github.com/levyfan/sentencepiece-jni
  • https://github.com/keigohtr/apitore-sdk-java
• https://github.com/oyahiroki/nlp4j
• https://github.com/lucene-gosen/lucene-gosen
• https://github.com/ikawaha/kagome

NLP

• https://emorynlp.github.io/nlp4j/
• https://opennlp.apache.org/

Alphabet -> Kana dictionary

• https://fastapi.metacpan.org/source/MASH/Lingua-JA-Yomi-0.01/lib/Lingua/JA
• https://github.com/KEINOS/google-ime-user-dictionary-ja-en

Kanji -> Kana

• chawan (faded away from the internet)
• open jtalk njd* -> Gyutan
• http://kakasi.namazu.org/index.html.ja
• https://github.com/nicolas-raoul/kakasi-java (predecessor of jakaroma)
• https://github.com/nicolas-raoul/jakaroma (engine is kuromoji)
• mac cocoa (done)
• unidic

Romaji -> Kana

• https://icu.unicode.org/home
• https://github.com/andree-surya/moji4j

Proofreading

• https://developer.yahoo.co.jp/webapi/jlp/kousei/v2/kousei.html