Description

This PR changes the rest/warehouse/raw-data endpoint to stream its response using chunked transfer encoding.

The endpoint now uses unbuffered MySQL queries (PDO::MYSQL_ATTR_USE_BUFFERED_QUERY is set to false).

The endpoint now returns the entire result set rather than just a number of rows limited by the rest_raw_row_limit setting in portal_settings.ini. This PR removes that setting and the rest/warehouse/raw-data/limit endpoint since these are no longer needed.

For the Jobs realm, a request for multiple days of data is now run as multiple single-day queries to improve performance.

Motivation and Context

This PR makes it possible to obtain the entire result set while gaining the performance improvement from #1780 / #1800. This improves the responsiveness and simplifies the code in the xdmod-data API (see ubccr/xdmod-data#19).

By using unbuffered MySQL queries, the PHP memory usage is also reduced.

Tests performed

This PR updates the regression tests to account for the fact that the entire result set is returned.

I also set up my xdmod-dev port with this branch, ran the script from https://github.com/ubccr/xdmod-xsede/pull/436 with the --time argument, and confirmed there are no differences or duplicates.

Checklist:

• The pull request description is suitable for a Changelog entry
• The milestone is set correctly on the pull request
• The appropriate labels have been added to the pull request