Skip to content

Fix Unicode issues in pip install (try 2)#7574

Closed
uranusjr wants to merge 13 commits into
pypa:masterfrom
uranusjr:pr-7138-rebase
Closed

Fix Unicode issues in pip install (try 2)#7574
uranusjr wants to merge 13 commits into
pypa:masterfrom
uranusjr:pr-7138-rebase

Conversation

@uranusjr

@uranusjr uranusjr commented Jan 8, 2020

Copy link
Copy Markdown
Member

Supersedes and closes #7138. Any suggestion on how to improve the test cases (check that files are actually installed and recorded correctly, probably) would be much welcomed.

I also included an xfail test for installing from source. It fails right now because Setuptools has the exact same problem generating the record for egg-info. Need to fix that as well. See pypa/setuptools#1399.

Comment thread news/7574.bugfix Outdated
Comment thread src/pip/_internal/operations/install/wheel.py Outdated
Comment thread tests/functional/test_install_wheel.py Outdated
@uranusjr

uranusjr commented Jan 9, 2020

Copy link
Copy Markdown
Member Author

So it seems create_basic_wheel_for_package() doesn’t take non-ASCII file names well either 🤔🤔🤔

@uranusjr uranusjr mentioned this pull request Jan 9, 2020
@pradyunsg

Copy link
Copy Markdown
Member

Let's rebase this today, and see if more issues prop up. :

uranusjr and others added 7 commits January 10, 2020 10:17
Co-authored-by: Julien Malard <julien.malard@mail.mcgill.ca>
So installing from source means we need setuptools to also correctly
open csv. Will need to file a PR for that to make this work.
Co-Authored-By: Xavier Fernandez <xav.fernandez@gmail.com>
This conveys the semantic meanings better, and let us include
less-generic logic in the function, e.g. always opening with UTF-8.
@uranusjr

uranusjr commented Jan 10, 2020

Copy link
Copy Markdown
Member Author

Everything is terrible and I doubt my life choices. Seriously asking: Can we let non-ASCII file names remain broken on Python 2, and fix this only for Python 3?

@pfmoore

pfmoore commented Jan 10, 2020

Copy link
Copy Markdown
Member

Seriously asking: Can we let non-ASCII file names remain broken on Python 2, and fix this only for Python 3?

Honestly, I'd be fine with this, One of the major reasons for the Python 3 compatibility break was to allow us to have sane Unicode handling, so "sorry, but you need Python 3 if you want proper Unicode support" seems a completely reasonable stance for us to take IMO.

@pypa/pip-committers does anyone have a problem with this?

@pradyunsg

Copy link
Copy Markdown
Member

I'm 100% on board.

@BrownTruck

Copy link
Copy Markdown
Contributor

Hello!

I am an automated bot and I have noticed that this pull request is not currently able to be merged. If you are able to either merge the master branch into this pull request or rebase this pull request against master then it will be eligible for code review and hopefully merging!

@BrownTruck BrownTruck added the needs rebase or merge PR has conflicts with current master label Apr 2, 2020
@pypa pypa locked as resolved and limited conversation to collaborators Aug 30, 2020
@uranusjr uranusjr deleted the pr-7138-rebase branch September 28, 2020 14:36
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

needs rebase or merge PR has conflicts with current master

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants