The Pipeline run fails only with 'ParallelRunStep' using ML SDK for python and returns an error message:

from azureml.data.dataset_type_definitions import PromoteHeadersBehavior
File "", line 988, in _find_and_load
File "", line 149, in enter
File "", line 94, in acquire
frozen_importlib._DeadlockError: deadlock detected by _ModuleLock('azureml.data.dataset_type_definitions')
File "driver/amlbi_main.py", line 136, in
main()
File "driver/amlbi_main.py", line 113, in main
boot(driver_dir)
File "driver/amlbi_main.py", line 54, in boot
booter.start()
File "driver/azureml_user/parallel_run/boot.py", line 301, in start
self.start_sys_main()
File "driver/azureml_user/parallel_run/boot.py", line 208, in start_sys_main
self.run(cmd)
File "driver/azureml_user/parallel_run/boot.py", line 170, in run
raise Exception(stderr)

This is a known issue and occurs intermittently. Azure Machine Learning Product Team actively investigating to find the root cause and fix.