Followup to ARROW-5178. See discussion on #4704. 

Reporter: Neal Richardson / @nealrichardson

_{Note: This issue was originally created as ARROW-5761. Please see the migration documentation for further details.}