Apache Iceberg version
0.5.0 (latest release)
Please describe the bug 🐞
I'm actually using the 0.6.0rc4 version, but that shouldn't matter in this case.
During the ingestion process, I'm running parallel jobs with the following code:
# Create a namespace if it doesn't exist
try:
catalog.create_namespace(ns_name)
self.logger.info(f"Namespace '{ns_name}' created")
except NamespaceAlreadyExistsError:
self.logger.info(f"Namespace '{ns_name}' already exists")
The first call goes through as expected since no namespace currently exists. But the second parallel call fails and throws both 404 and 409:
self._handle_non_200_response(exc, {404: NoSuchNamespaceError, 409: NamespaceAlreadyExistsError})
The expected behavior is to only throw 409 since 404 NoSuchNamespaceError doesn't make sense in the context of namespace creation.