Skip to content

[Feature Request]: Include keyrings.google-artifactregistry-auth in Python SDK container #32123

@baeminbo

Description

@baeminbo

What would you like to happen?

I want to use Python packages in private repository in [Google Artifact Repository](https://cloud.google.com/artifact-registry/docs/python/authentication. It requires keyrings.google-artifactregistry-auth to run pip install <package> --extra-index-url <location>-python.pkg.dev/<project>/<repository>/simple.

To run Dataflow job with private packages, currently I should create a custom container that installs keyrings.google-artifactregistry-auth. [1] is an example of Dockerfile for this.

For convenience, can we pre-install the package in Python SDK containers?

[1]

FROM apache/beam_python3.11_sdk:2.58.0

RUN pip install keyrings.google-artifactregistry-auth

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions