Describe the bug, including details regarding any error messages, version, and platform.

We have an internal application that is using the arrow::RecordBatchReader with a Python generator (but in C++). Right now, when the Python generator raises an error, the stack trace disappears (e.g. in our code base we just see:

Python exception: AssertionError

without the stack trace.

I am not super familiar with C++ or the code, but I think the problem can be traced to this function:

which calls into

where we only attach the exception type name and no other information. My C++ is not very good, but how hard would it be to actually attach the full Python stacktrace inside the message whenever we hit a Python exception?

Component(s)

Python