Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

• Other pull requests

@kecookier, do you care about the UTF-8 encoding validity of JSON string? Do we just need to align with Spark's behavior? cc @wang-zhun

@philo-he We don't need UTF-8 validity, we just need to be consistent with Spark.
For example, get_json_object(concat('{"a": "1", "b": "', string(unhex(hex(129))), '"}'), '$.a') compared to Gluten returning null, Spark returning 1 is more in line with our expectations

@philo-he Thanks. Just keep it consistent with Spark.

Has opened one thread in velox to discuss this issue: facebookincubator/velox#10639. If velox accepts this change, we can close this pr.

@wang-zhun, can you validate this pr with your cases? We can merge this one if CI passes and no issue is on your side.

@philo-he Thank you, I’ve verified that this patch is effective for my scenario.

before

now

@kecookier, could you approve this pr if you have no comment?

Thanks.