CI on Linux (all packages, all tests, Eloquent/bionic):

CI on Linux (all packages, all tests, Eloquent/bionic):

For comparison, a build before this PR (all packages, all tests, Eloquent/bionic):

@ros-pull-request-builder retest this please

@mjcarroll correctly pointed out that https://ci.ros2.org/job/ci_linux/10124/testReport/junit/(root)/test_rclcpp/gtest_spin__rmw_connext_cpp_gtest_missing_result/ looks suspiciously like a regression from this patch. I wasn't able to reproduce locally, but I think it needs more looking into.

After doing a bit of debugging here, it turns out that there are some accesses to the TimerBase object that don't go through the Clock constructor, so they never get a new entry in the global mutex map assigned. I'm not sure how that can happen (the TimerBase constructor takes a rclcpp::Clock::SharedPtr), but it seems to be the cause of the crash we are seeing in CI. Needs more investigation.

Thanks to some help from @hidmic, I think we've solved the crash. Here is another CI on Linux (all packages, all tests, Eloquent/Bionic), to be sure:

There are 194 failures in the Linux build. If I filter out all of the flake8 and pep257 ones, that leaves me with the following list:

    projectroot.test_publisher_subscriber__rclpy__rmw_connext_cpp__rmw_cyclonedds_cpp
    projectroot.test_publisher_subscriber__rclpy__rclcpp__rmw_connext_cpp__rmw_cyclonedds_cpp
    projectroot.test_publisher_subscriber__rclcpp__rclpy__rmw_connext_cpp__rmw_cyclonedds_cpp
    projectroot.test_publisher_subscriber__rclcpp__rmw_connext_cpp__rmw_cyclonedds_cpp
    projectroot.test_events__rmw_cyclonedds_cpp
    rcl.TestEventFixture__rmw_cyclonedds_cpp.test_pubsub_deadline_missed
    rcl.TestEventFixture__rmw_cyclonedds_cpp.test_pubsub_liveliness_kill_pub
    test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[WStrings]
    test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[WStrings]
    test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[WStrings]
    test_communication.TestPublisherSubscriberAfterShutdown.test_processes_finished_gracefully[WStrings]

I believe that the WString interoperability with Connext is a known issue, so we can ignore those. That leaves us with:

    rcl.TestEventFixture__rmw_cyclonedds_cpp.test_pubsub_deadline_missed
    rcl.TestEventFixture__rmw_cyclonedds_cpp.test_pubsub_liveliness_kill_pub

But if memory serves correctly, the Cyclone version in Eloquent didn't support liveliness or deadline. So overall, I think we're pretty good to go here. I'm going to run one last CI on the other platforms, then go ahead and merge this.

• Linux-aarch64
• macOS
• Windows

Windows "failed" because it had too many test failures. But I honestly don't know what I should expect for failures there. Here's a Windows CI run without this patch:

• Windows

While we could potentially slip this into Eloquent, I think it is too risky given that Eloquent is going EOL in 4-6 weeks. I'm just going to close this out; the fix is in Foxy and later.