deltaio/delta-docker repository overview

Delta Lake is an open-source storage framework that enables building a Lakehouse architecture⁠ with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, Ruby, and Python.

⁠Docker Versions

⁠References

• See the Delta Lake Documentation⁠ for details.
• See the Quick Start Guide⁠ to get started with Scala, Java and Python.
• See the Delta Lake Docker⁠ to get started with a Docker with Python, Spark (PySpark, Scala), Jupyter, Rust, and ROAPI.
  • See the Delta Lake DockerHub⁠ to download the docker directly.
• See delta.io⁠ for more information
  • Join us on Slack⁠, LinkedIn⁠, Groups⁠
• Note, this repo is one of many Delta Lake repositories in the delta.io⁠ organizations including connectors⁠, delta⁠, delta-rs⁠, delta-sharing⁠, kafka-delta-ingest⁠, and website⁠.

The following are some of the more popular Delta Lake integrations, refer to delta.io/integrations⁠ for the complete list:

• Apache Spark™⁠: This connector allows Apache Spark™ to read from and write to Delta Lake.
• Apache Flink⁠: This connector allows Apache Flink to write to Delta Lake.
• PrestoDB⁠: This connector allows PrestoDB to read from Delta Lake.
• Trino⁠: This connector allows Trino to read from and write to Delta Lake.
• Apache Hive⁠: This connector allows Apache Hive to read from Delta Lake.
• Delta Rust API⁠: This library allows Rust (with Python and Ruby bindings) low level access to Delta tables and is intended to be used with data processing frameworks like datafusion, ballista, rust-dataframe, vega, etc.