This is an example Swift application to show how to use Apache Spark Connect Swift Client library.
Prepare Spark Connect Server via running Docker image.
docker run --rm -p 15002:15002 apache/spark:4.1.1 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"Build an application Docker image.
$ docker build -t apache/spark-connect-swift:pi .
$ docker images apache/spark-connect-swift:pi
IMAGE ID DISK USAGE CONTENT SIZE EXTRA
apache/spark-connect-swift:pi cae3fd3b9833 550MB 128MBRun pi docker image.
$ docker run --rm -e SPARK_REMOTE=sc://host.docker.internal:15002 apache/spark-connect-swift:pi
Pi is roughly 3.1434711434711433Run from source code.
$ swift run
...
Pi is roughly 3.143995143995144