Description

This PR adds regression tests of the warehouse/raw-data REST endpoint.

It also removes some of the integration tests that were made redundant by the new regression tests.

Tests for the SUPREMM realm will be added in ubccr/xdmod-supremm#354.

Motivation and Context

There will be upcoming PRs (e.g., #1779, #1780) that modify the warehouse/raw-data endpoint, and the new tests from this PR will help catch any unintended changes to the response data.

Tests performed

In a Docker container running tools-ext-01.ccr.xdmod.org/xdmod-10.5.0-x86_64:rockylinux8.5-0.3:

1. Run export XDMOD_TEST_MODE=fresh_install
2. Run the following commands:

   export COMPOSER_ALLOW_SUPERUSER=1
   export XDMOD_REALMS='jobs,storage,cloud'
   export XDMOD_IS_CORE=yes
   export XDMOD_INSTALL_DIR=/xdmod
   openssl genrsa -rand /proc/cpuinfo:/proc/dma:/proc/filesystems:/proc/interrupts:/proc/ioports:/proc/uptime 2048 > /etc/pki/tls/private/localhost.key
   /usr/bin/openssl req -new -key /etc/pki/tls/private/localhost.key -x509 -sha256 -days 365 -set_serial $RANDOM -extensions v3_req -out /etc/pki/tls/certs/localhost.crt -subj "/C=XX/L=Default City/O=Default Company Ltd"
   git clone https://github.com/ubccr/xdmod /xdmod
   sed -i 's/\$phpunit /$phpunit --debug /' /xdmod/tests/regression/runtests.sh
   cd /xdmod
   composer install
   mkdir ~/phpunit
   mkdir /tmp/screenshots
   ~/bin/buildrpm xdmod
   ./tests/ci/bootstrap.sh
   ./tests/ci/validate.sh
   composer install --no-progress
   mv ./configuration/organization.json ./configuration/organization.json.old
   mv ./configuration/portal_settings.ini ./configuration/portal_settings.ini.old
   cp /etc/xdmod/portal_settings.ini ./configuration/portal_settings.ini
   cp /etc/xdmod/organization.json ./configuration/organization.json
   ./tests/ci/scripts/qa-test-setup.sh
   sed -i 's/\$phpunit /$phpunit --debug /' /xdmod/tests/unit/runtests.sh
   /xdmod/tests/unit/runtests.sh > /unit-before.txt
   sed -i 's/\$phpunit /$phpunit --debug /' /xdmod/tests/component/runtests.sh
   /xdmod/tests/component/runtests.sh > /component-before.txt
   sed -i 's/\$phpunit /$phpunit --debug /' /xdmod/tests/regression/runtests.sh
   /xdmod/tests/regression/runtests.sh > /regression-before.txt
   cd /xdmod/tests/integration
   ../../vendor/bin/phpunit --testsuite default --group UserAdminTest.createUsers --debug > /integration-before.txt
   ../../vendor/bin/phpunit --testsuite default --exclude-group UserAdminTest.createUsers --debug >> /integration-before.txt
   cd /xdmod
   git clone https://github.com/aaronweeden/xdmod -b add-raw-data-regression-tests /xdmod-new
   unalias rm
   rm -r /xdmod/tests
   cp -r /xdmod{-new,}/tests
   sed -i 's/\$phpunit /$phpunit --debug /' /xdmod/tests/unit/runtests.sh
   /xdmod/tests/unit/runtests.sh > /unit-after.txt
   sed -i 's/\$phpunit /$phpunit --debug /' /xdmod/tests/component/runtests.sh
   /xdmod/tests/component/runtests.sh > /component-after.txt
   sed -i 's/\$phpunit /$phpunit --debug /' /xdmod/tests/regression/runtests.sh
   /xdmod/tests/regression/runtests.sh > /regression-after.txt
   cd /xdmod/tests/integration
   ../../vendor/bin/phpunit --testsuite default --group UserAdminTest.createUsers --debug > /integration-after.txt
   ../../vendor/bin/phpunit --testsuite default --exclude-group UserAdminTest.createUsers --debug >> /integration-after.txt
   unalias mv
   for file in /regression-{before,after}.txt; do
       for test in {testChartSettings,testChartFilters,testCsvExport}; do
           for realm in {Jobs,Cloud,Storage}; do
               sed -i "s/$test with data set.*$realm.*/$test $realm/" $file;
           done;
       done;
       sort $file > $file.tmp;
       mv $file.tmp $file;
   done
   

3. Compare /unit-{before,after}.txt and make sure the only differences are user hashes and amount of time the tests ran.
4. Compare /component-{before,after}.txt and make sure the only differences are test name hashes and amount of time the tests ran.
5. Compare /integration-{before,after}.txt and make sure the differences are correct:
   1. Different random values for ControllerTest::testEnumTargetAddresses.
   2. The testGetRawData tests have been removed in which the test data start with success_0, success_16500, and success_fields_and_filters.
   3. The last group of tests:
      1. Takes a few seconds less.
      2. Uses ~80 fewer MB.
      3. 787 tests -> 784 tests.
      4. 571156 assertions -> 7141 assertions.
6. Compare /regression-{before,after}.txt and make sure the differences are correct:
   1. Different dots at the top.
   2. One extra line each starting with 'Configuration', 'OK', 'PHPUnit', 'Runtime', and 'Time' (evidencing the new group of tests).
   3. Four new lines for WarehouseRawDataTest::testGetRawData.
7. Repeat in a new container with export XDMOD_TEST_MODE=upgrade.

Checklist:

• The pull request description is suitable for a Changelog entry
• The milestone is set correctly on the pull request
• The appropriate labels have been added to the pull request