Skip to content

Interpreter.DetectIdentifiers can not find non-ascii identifier in expression #269

@littepointR

Description

@littepointR

My test code is:

var identifiersInfo    = interpreter.DetectIdentifiers("中文");
var identifiers        = identifiersInfo.Identifiers.ToArray();
var unknownIdentifiers = identifiersInfo.UnknownIdentifiers.ToArray();
var referenceTypes     = identifiersInfo.Types.ToArray();
Console.WriteLine("Chinese --> ");
Console.WriteLine($"identifiers.Count = {identifiers.Length}");
Console.WriteLine($"unknownIdentifiers.Count = {unknownIdentifiers.Length}");
Console.WriteLine($"referenceTypes.Count = {referenceTypes.Length}");


var identifiersInfo    = interpreter.DetectIdentifiers("日本語");
var identifiers        = identifiersInfo.Identifiers.ToArray();
var unknownIdentifiers = identifiersInfo.UnknownIdentifiers.ToArray();
var referenceTypes     = identifiersInfo.Types.ToArray();
Console.WriteLine("Japanese --> ");
Console.WriteLine($"identifiers.Count = {identifiers.Length}");
Console.WriteLine($"unknownIdentifiers.Count = {unknownIdentifiers.Length}");
Console.WriteLine($"referenceTypes.Count = {referenceTypes.Length}");


var identifiersInfo    = interpreter.DetectIdentifiers("русский язык");
var identifiers        = identifiersInfo.Identifiers.ToArray();
var unknownIdentifiers = identifiersInfo.UnknownIdentifiers.ToArray();
var referenceTypes     = identifiersInfo.Types.ToArray();
Console.WriteLine("Russian --> ");
Console.WriteLine($"identifiers.Count = {identifiers.Length}");
Console.WriteLine($"unknownIdentifiers.Count = {unknownIdentifiers.Length}");
Console.WriteLine($"referenceTypes.Count = {referenceTypes.Length}");

and ouput:

Chinese -->
identifiers.Count = 0
unknownIdentifiers.Count = 0
referenceTypes.Count = 0
Japanese -->
identifiers.Count = 0
unknownIdentifiers.Count = 0
referenceTypes.Count = 0
Russian -->
identifiers.Count = 0
unknownIdentifiers.Count = 0
referenceTypes.Count = 0

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions