Internally, we pass the filename string to std::fopen which, under Windows, may not be interpreted as UTF-8. It depends.

Instead of converting to UTF8, which might not work well, I recommend you replace the call to fopen by _wfopen internally, thus avoiding the conversion.

Have a look at

You could just copy paste this old code, and replace fopen by _wfopen.

Instead of converting to UTF8, which might not work well, I recommend you replace the call to fopen by _wfopen internally, thus avoiding the conversion.

Have a look at

simdjson/include/simdjson/padded_string-inl.h

Line 134 in 235dbc5

inline simdjson_result<padded_string> padded_string::load(std::string_view filename) noexcept {

You could just copy paste this old code, and replace fopen by _wfopen.

i was thinking of this approach but was not sure if it was the right way.

Looks good to me.

@Nelson-numerical-software could you review since you created the issue?

Looks good to me.

@Nelson-numerical-software could you review since you created the issue?

Thanks for this works ! It is good for me too