feat: allow loading of native certificate store by tdejager · Pull Request #5013 · prefix-dev/pixi

tdejager · 2025-12-01T09:13:03Z

Description

uv allows loading of the system certificate instead of the ones provided by default for rustls. This changes the code to have a native_certs configuration option (global) and CLI options so that one can opt-in to the system store. This all still uses rustls under the hood. This was apparently a much-requested feature for uv. Luckily we can just change the client construction implementation and enable this for both conda and PyPI network requests.

I used a different name and construction and deviated from uv here, because we have different requirements. We have both native-tls (conda-forge) builds, and non-native tls. So I added the option for the use to be able to choose, what root certificates to load. For example, when running pixi install --help, you get:

...
      --tls-root-certs <TLS_ROOT_CERTS>
          Which TLS root certificates to use: 'webpki' (bundled Mozilla roots), 'native' (system store), or 'all' (both)

          [env: PIXI_TLS_ROOT_CERTS=]

There is also a corresponding pixi_config global setting. That can be set if need be.

By default the rustls version uses only "webpki", and the native-tls uses the system store, for rustls you can use "webpki", "native" or "all". For the native-tls version the methods, tls_built_in_webpki_certs and tls_built_in_native_certs should not be available, i.e. these are only available for rustls. So we give a warning in this case that these options will be ignored. See: https://docs.rs/reqwest/latest/reqwest/struct.ClientBuilder.html#method.tls_built_in_webpki_certs

However, and this is a question for @baszalmstra, I feel these will actually be available on our native-tls build; because of uv ensuring that both features are enabled, as they support only rustls and in the case of a conda-forge build, both features will be on. Not sure what do here but opted to go for the "most correct" approach. wdyt?

Fixes #4896

How Has This Been Tested?

I have a script made in scripts/test_native_cert.py and corresponding pixi tasks to check if this works. Run pixi r build-release and pixi run test-native-certs to verify. This sets up a PyPI registry ngnix docker with a generated CA we add this to the system store to see if we can connect with it.

Maybe the OP of the issue could give it a go as well.

AI Disclosure

This PR contains AI-generated content.
- I have tested any AI-generated content in my PR.
- I take responsibility for any AI-generated content in my PR.

Tools: Claude Opus 4.5

Checklist:

I have performed a self-review of my own code
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have added sufficient tests to cover my changes.
I have verified that changes that would impact the JSON schema have been made in schema/model.py.

baszalmstra

Nice, how do we deal with this on conda-forge where we use nativetls instead?

crates/pixi_config/src/lib.rs

tdejager · 2025-12-01T09:47:09Z

Nice, how do we deal with this on conda-forge where we use nativetls instead?

Hmm maybe we should remove it for those builds, as this config does not make sense. Wdyt?

baszalmstra · 2025-12-01T09:50:45Z

maybe we could have a config called tls-certs which is webpki or native. And we have different defaults based on the selected feature?

Co-authored-by: Bas Zalmstra <4995967+baszalmstra@users.noreply.github.com>

tdejager · 2025-12-01T10:57:21Z

Excellent suggestion!

…

On Mon, Dec 1, 2025 at 10:51 AM Bas Zalmstra ***@***.***> wrote: *baszalmstra* left a comment (prefix-dev/pixi#5013) <#5013 (comment)> maybe we could have a config called tls-certs which is webpki or native. And we have different defaults based on the selected feature? — Reply to this email directly, view it on GitHub <#5013 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AADF4XU7TYND3OFWR3O2C4T37QFQZAVCNFSM6AAAAACNU3W7P2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTKOJVGU4TAMZYG4> . You are receiving this because you authored the thread.Message ID: ***@***.***>

tdejager · 2025-12-01T13:44:15Z

maybe we could have a config called tls-certs which is webpki or native. And we have different defaults based on the selected feature?

I implemented a version of this @baszalmstra but an open question still remains :)

crates/pixi_config/src/lib.rs

baszalmstra · 2025-12-02T15:05:55Z

scripts/test_native_certs.py

baszalmstra · 2025-12-02T15:07:38Z

However, and this is a question for @baszalmstra, I feel these will actually be available on our native-tls build; because of uv ensuring that both features are enabled, as they support only rustls and in the case of a conda-forge build, both features will be on. Not sure what do here but opted to go for the "most correct" approach. wdyt?

Makes sense to me, we can always change this later.

jamblejoe · 2025-12-02T21:38:42Z

OP here. I ran test_native_certs.py successfully and got

./target/release/pixi run python scripts/test_native_certs.py --pixi-bin ./target/release/pixi
╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ TLS Root Certs Feature Test                                                                                                                                                                                               │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
Test directory: /var/folders/hv/3wt4f9r11dz935gtp9fjmsgm0000gp/T/pixi-native-certs-3nx9vq14
Setting up mkcert CA...
The local CA is already installed in the system trust store! 👍
Warning: "certutil" is not available, so the CA can't be automatically installed in Firefox! ⚠️
Install "certutil" with "brew install nss" and re-run "mkcert -install" 👈

✓ mkcert CA installed in system trust store
Generating certificates...
Note: the local CA is not installed in the Firefox trust store.
Run "mkcert -install" for certificates to be trusted automatically ⚠️

Created a new certificate valid for the following names 📜
 - "localhost"
 - "127.0.0.1"

The certificate is at "/var/folders/hv/3wt4f9r11dz935gtp9fjmsgm0000gp/T/pixi-native-certs-3nx9vq14/cert.pem" and the key at "/var/folders/hv/3wt4f9r11dz935gtp9fjmsgm0000gp/T/pixi-native-certs-3nx9vq14/key.pem" ✅

It will expire on 2 March 2028 🗓

✓ Certificates generated
Creating test package...
✓ Test package created
Creating PyPI simple index...
✓ Simple index created
Starting HTTPS PyPI server...
✓ PyPI server running at https://localhost:62686
Creating test pixi project...
✓ Test project created
╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Running Tests                                                                                                                                                                                                             │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

Test A: With tls-root-certs=webpki (should FAIL)
The CA is NOT in webpki-roots, so this should fail

✓ Test A PASSED: Got expected certificate error

Test B: With tls-root-certs=native (should SUCCEED)
The CA IS in the system trust store, so this should work

✓ Test B PASSED: Install succeeded with native certs
╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Test Summary                                                                                                                                                                                                              │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
All tests PASSED!

The tls-root-certs feature is working correctly:
  - tls-root-certs=webpki: Uses webpki-roots (mkcert CA not trusted)
  - tls-root-certs=native: Uses system store (mkcert CA trusted)
Cleaned up test directory

tdejager · 2025-12-03T08:20:45Z

OP here. I ran test_native_certs.py successfully and got

./target/release/pixi run python scripts/test_native_certs.py --pixi-bin ./target/release/pixi
╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ TLS Root Certs Feature Test                                                                                                                                                                                               │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
Test directory: /var/folders/hv/3wt4f9r11dz935gtp9fjmsgm0000gp/T/pixi-native-certs-3nx9vq14
Setting up mkcert CA...
The local CA is already installed in the system trust store! 👍
Warning: "certutil" is not available, so the CA can't be automatically installed in Firefox! ⚠️
Install "certutil" with "brew install nss" and re-run "mkcert -install" 👈

✓ mkcert CA installed in system trust store
Generating certificates...
Note: the local CA is not installed in the Firefox trust store.
Run "mkcert -install" for certificates to be trusted automatically ⚠️

Created a new certificate valid for the following names 📜
 - "localhost"
 - "127.0.0.1"

The certificate is at "/var/folders/hv/3wt4f9r11dz935gtp9fjmsgm0000gp/T/pixi-native-certs-3nx9vq14/cert.pem" and the key at "/var/folders/hv/3wt4f9r11dz935gtp9fjmsgm0000gp/T/pixi-native-certs-3nx9vq14/key.pem" ✅

It will expire on 2 March 2028 🗓

✓ Certificates generated
Creating test package...
✓ Test package created
Creating PyPI simple index...
✓ Simple index created
Starting HTTPS PyPI server...
✓ PyPI server running at https://localhost:62686
Creating test pixi project...
✓ Test project created
╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Running Tests                                                                                                                                                                                                             │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

Test A: With tls-root-certs=webpki (should FAIL)
The CA is NOT in webpki-roots, so this should fail

✓ Test A PASSED: Got expected certificate error

Test B: With tls-root-certs=native (should SUCCEED)
The CA IS in the system trust store, so this should work

✓ Test B PASSED: Install succeeded with native certs
╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Test Summary                                                                                                                                                                                                              │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
All tests PASSED!

The tls-root-certs feature is working correctly:
  - tls-root-certs=webpki: Uses webpki-roots (mkcert CA not trusted)
  - tls-root-certs=native: Uses system store (mkcert CA trusted)
Cleaned up test directory

Would you be able to check if with the version of pixi compiled from this branch you are able to reach your index? :)

…recognize-uv_native_tls-env

tdejager added 3 commits December 1, 2025 09:29

feat: allow loading of native certificate store

b293728

fix: clippy

6214242

fix: missing code for uv version

65c3708

tdejager requested review from baszalmstra and wolfv December 1, 2025 09:13

fix: test script

dfa91cf

baszalmstra reviewed Dec 1, 2025

View reviewed changes

crates/pixi_config/src/lib.rs Outdated Show resolved Hide resolved

fix: ignore from typecheck

87c0593

tdejager and others added 2 commits December 1, 2025 11:41

Update crates/pixi_config/src/lib.rs

9d4ba93

Co-authored-by: Bas Zalmstra <4995967+baszalmstra@users.noreply.github.com>

feat: cli docs changes

7a25bdf

tdejager added 3 commits December 1, 2025 14:17

feat: now has value for choosing what root certificates to use

359324f

feat: update CLI documenation

d28ba10

feat: add pixi configuration

a5e486c

fix: remove unused dependency

9cc974a

baszalmstra reviewed Dec 2, 2025

View reviewed changes

crates/pixi_config/src/lib.rs Show resolved Hide resolved

scripts/test_native_certs.py

Copy link

Contributor

baszalmstra Dec 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Crazy

tdejager marked this pull request as ready for review December 3, 2025 09:18

tdejager and others added 2 commits December 3, 2025 16:17

feat: done

be4959c

Merge branch 'main' into feature/pix-1314-pixis-internal-uv-does-not-…

326149c

…recognize-uv_native_tls-env

baszalmstra self-requested a review December 3, 2025 15:36

baszalmstra approved these changes Dec 3, 2025

View reviewed changes

tdejager merged commit ccc3fcc into prefix-dev:main Dec 3, 2025
42 checks passed

baszalmstra mentioned this pull request Dec 5, 2025

bug: connection reset by peer (os error 104) behind corporate firewall #4435

Closed

2 tasks

BrewTestBot mentioned this pull request Dec 9, 2025

pixi 0.61.0 Homebrew/homebrew-core#257919

Merged

baszalmstra mentioned this pull request Dec 10, 2025

0.61.0: a number of tests started failing offline due to accessing https://conda-mapping.prefix.dev/hash-v0/ #5101

Closed

ukmo-ccbunney mentioned this pull request Dec 11, 2025

pixi self-update not using custom TLS settings? #5117

Closed

2 tasks

benmoss mentioned this pull request Jan 7, 2026

fix: change TlsRootCerts to select All by default #5244

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: allow loading of native certificate store#5013

feat: allow loading of native certificate store#5013
tdejager merged 13 commits intoprefix-dev:mainfrom
tdejager:feature/pix-1314-pixis-internal-uv-does-not-recognize-uv_native_tls-env

tdejager commented Dec 1, 2025 •

edited

Loading

Uh oh!

baszalmstra left a comment

Uh oh!

Uh oh!

tdejager commented Dec 1, 2025

Uh oh!

baszalmstra commented Dec 1, 2025

Uh oh!

tdejager commented Dec 1, 2025 via email

Uh oh!

tdejager commented Dec 1, 2025 •

edited

Loading

Uh oh!

Uh oh!

baszalmstra Dec 2, 2025

Uh oh!

baszalmstra commented Dec 2, 2025

Uh oh!

jamblejoe commented Dec 2, 2025 •

edited

Loading

Uh oh!

tdejager commented Dec 3, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

tdejager commented Dec 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

How Has This Been Tested?

AI Disclosure

Checklist:

Uh oh!

baszalmstra left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

tdejager commented Dec 1, 2025

Uh oh!

baszalmstra commented Dec 1, 2025

Uh oh!

tdejager commented Dec 1, 2025 via email

Uh oh!

tdejager commented Dec 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

baszalmstra Dec 2, 2025

Choose a reason for hiding this comment

Uh oh!

baszalmstra commented Dec 2, 2025

Uh oh!

jamblejoe commented Dec 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

tdejager commented Dec 3, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

tdejager commented Dec 1, 2025 •

edited

Loading

tdejager commented Dec 1, 2025 •

edited

Loading

jamblejoe commented Dec 2, 2025 •

edited

Loading