Generated dictionary sometimes includes word twice, once followed by a period

[tbroadley]

For example, here.

[tbroadley]

Minimal Markdown example that causes this bug:

misspellig.

* lowercase

The following does not trigger the bug:

misspellig.

* Uppercase

It seems to be a bug in either remark-retext or retext itself. In the first case, the period is included as a child to the WordNode object that contains "misspellig". In the second case, the period is a child of the SentenceNode that contains the WordNode.

[a2937]

Hmm on the personal tiny spellchecker I made; I just flat out removed most punctuation from words that needed spellchecked. Could we do something like this here?

[a2937]

While removing periods, exclamation marks, and question mark nodes from words that need spellchecked ; it could probably be helpful here?

[tbroadley]

True, that would solve this problem. I'm hesitant to have spellchecker-cli preprocess text too heavily before passing it into Retext. For example, if we removed punctuation, that might conflict with one or more Retext plugins. I have an open issue for adding support for more Retext plugins to spellchecker-cli: #18

I'd rather resolve this issue by fixing the underlying issue in Retext or remark-retext.