What is Streambased?
Streambased provides a unique solution for real-time data analytics by projecting Kafka data into Iceberg at query time without copying or batch processing. This approach eliminates the traditional pipeline bottlenecks that cause data freshness lag and operational complexity.
The platform creates a unified logical view that combines Kafka's real-time streaming capabilities with Iceberg's analytical querying power. Organizations can query data milliseconds after it lands in Kafka using standard SQL through any Iceberg-compatible engine or BI tool, maintaining governance policies across both systems.
Features
- Zero-Copy Architecture: Projects Kafka data into Iceberg at query time without background copying or batch processing
- Real-time Data Freshness: Makes Kafka data queryable in Iceberg milliseconds after arrival, eliminating batch window delays
- Unified Governance: Carries Kafka's metadata, schema rules, and access controls directly into Iceberg views
- Standard SQL Interface: Works with any Iceberg-compatible engine or JDBC/ODBC BI tool without requiring new query languages
- Simplified Operations: Eliminates compaction jobs, snapshot cleanup, and repartition rewrites by keeping data in Kafka
Use Cases
- Dashboard and Reporting with live data synchronization
- Machine Learning and AI feature store updates with fresh data
- Data Science exploration combining real-time streams with historical data
- Unified data governance across streaming and analytical systems
- Real-time analytics without pipeline maintenance overhead
