As Scala is using Scala meta for parsing, and not a JavaCC / Antlr Grammar, it doesn't work on top of the base tokenizers / token filters, which means base functionality such as support for CPD-OFF / CPD-ON has to be built specially for this tokenizer, which is currently missing.
As Scala is using Scala meta for parsing, and not a JavaCC / Antlr Grammar, it doesn't work on top of the base tokenizers / token filters, which means base functionality such as support for
CPD-OFF / CPD-ONhas to be built specially for this tokenizer, which is currently missing.