Skip to content

MiguelElGallo/evsnow

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

137 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

EvSnow

EvSnow streams events from Azure Event Hubs into Snowflake with checkpointing, configuration validation, and observability.

Tests CI/CD Pipeline Documentation codecov

Read the hosted docs at https://miguelelgallo.github.io/evsnow/.

Quick Start

Use TOML for pipeline shape and .env for secrets or local credentials:

git clone https://github.com/MiguelElGallo/evsnow.git
cd evsnow
uv sync

For the smallest complete path, start with First run. It walks through one Event Hub, one Snowflake target, validation, a dry run, and a three-message arrival proof.

If the tutorial tells you an object is missing, use only the setup page you need:

Setup pages assume commands are run from the repo root.

If the Event Hub and Snowflake objects already exist, create the local runtime files and validate them:

cp config/evsnow.example.toml config/evsnow.toml
cp .env.example .env

uv run evsnow validate-config --config-file config/evsnow.toml --env-file .env

Continue only when validation completes without warnings.

The full configuration surface is documented in Parameter reference.

Documentation Development

uv sync --group docs --locked
uv run zensical build --clean --strict
uv run zensical serve

The Zensical source lives in docs/, and the generated site is written to site/. The GitHub Pages workflow deploys the site from main.

License

See LICENSE for details.

About

Load events from Azure Eventhubs to Snowflake tables

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors