Since we've switched to allow_partial_failures=true by default, bugs are not immediately reported when they cause a csv spec test or yaml test to fail. All we see in opened CI issues is a data mismatch, typically with fewer data in the results than expected. Then we need to dig in the logs to find the actual root cause - if it was logged.
To regain proper visibility, we should update EsqlSpecTestCase so that it asserts no partial failures in the result. And do something similar for yaml tests.
Since we've switched to
allow_partial_failures=trueby default, bugs are not immediately reported when they cause a csv spec test or yaml test to fail. All we see in opened CI issues is a data mismatch, typically with fewer data in the results than expected. Then we need to dig in the logs to find the actual root cause - if it was logged.To regain proper visibility, we should update EsqlSpecTestCase so that it asserts no partial failures in the result. And do something similar for yaml tests.