Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Various places in the code are using isWORDCHAR to match the continuation in an identifier. This mostly works, but the two sets are not identical, and the proper thing to do is to match continuation characters. The infrastructure was lacking this macro that would make it easy to do the right thing. This commit adds the infrastructure, leaving it to future commits to use it.
A reasonably complete list of characters that differ between the two sets is:
MIDDLE DOT
GREEK YPOGEGRAMMENI
GREEK ANO TELEIA
COMBINING CYRILLIC HUNDRED THOUSANDS SIGN
COMBINING CYRILLIC MILLIONS SIGN
ARMENIAN MODIFIER LETTER LEFT HALF RING
ARMENIAN EMPHASIS MARK
NEW TAI LUE THAM DIGIT ONE
COMBINING PARENTHESES OVERLAY
COMBINING ENCLOSING CIRCLE
COMBINING ENCLOSING CIRCLE BACKSLASH
COMBINING ENCLOSING SCREEN
COMBINING ENCLOSING UPWARD POINTING TRIANGLE
MANDAIC LETTER AZ
ESTIMATED SYMBOL
CIRCLED LATIN CAPITAL LETTERs A..Z
VERTICAL TILDE
KATAKANA MIDDLE DOT
COMBINING CYRILLIC TEN MILLIONS SIGN
COMBINING CYRILLIC THOUSAND MILLIONS SIGN
ARABIC LIGATURE SHADDA WITH DAMMATAN ISOLATED FORM ARABIC LIGATURE SHADDA WITH SUPERSCRIPT ALEF ISOLATED FORM ARABIC LIGATURE SALLALLAHOU ALAYHE WASALLAM
ARABIC LIGATURE JALLAJALALOUHOU
ARABIC FATHATAN ISOLATED FORM
ARABIC DAMMATAN ISOLATED FORM
ARABIC KASRATAN ISOLATED FORM
ARABIC FATHA ISOLATED FORM
ARABIC DAMMA ISOLATED FORM
ARABIC KASRA ISOLATED FORM
ARABIC SHADDA ISOLATED FORM
ARABIC SUKUN ISOLATED FORM
HALFWIDTH KATAKANA MIDDLE DOT
SQUARED LATIN CAPITAL LETTER A
SQUARED LATIN CAPITAL LETTER Z
NEGATIVE CIRCLED LATIN CAPITAL LETTERs A..Z
NEGATIVE SQUARED LATIN CAPITAL LETTERs A..Z