🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

Serverless multi-protocol + multi-destination event collection system.

Adapter for dbt that executes dbt pipelines on Apache Flink

📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.

Different flavours of CUSUM for change point detection.

This repo assists in building streaming analytics platform using RisingWave and dbt, empowering your real-time data insights.

Real-time ETL pipeline for financial data (kafka, pyspark) .

Extends the standard cumulocity administration with dialog to add analytics builder extensions

Self-Supervised Adaptive and Interpretable Anomaly Detection with Dynamic Operating Limits

⚡ Real-time fraud & anomaly detection system for streaming transactions. Built with Kafka Streams + Isolation Forest ML. Low-latency processing, online learning, and scalable architecture for detecting fraud patterns in transaction data. 🚨🔍

This repo provides a template for developing Cumulocity Streaming Analytics assets such as Blocks and EPL Apps, with a dev container for opening in Visual Studio Code

Source code of a heavy hitter packet streaming application implemented with four stream processing systems: Flink, Spark Streaming, Storm and WindFlow.

Real-time monitoring pipeline using Kafka, Flink, PostgreSQL, and Grafana to stream metrics, detect anomalies (EWMA + 3σ), and visualize results.

Built a Large Scale Distributed Data Processing system for Streaming Analytics using Hadoop Ecosystem (Apache Spark and HDFS), in Cloud for real-time spatial analytics.

Full-stack machine learning project that predicts viewer satisfaction (high ratings) on Netflix using demographic data and TMDB movie metadata. Includes EDA, XGBoost modeling, and real-time enrichment using the TMDB API.

An end‑to‑end real-time analytics & anomaly detection with PySpark Structured Streaming on user activity logs from Kafka

Real-time Coinbase market data streaming pipeline with visualizations. Much appreciation to DataTalks.Club Data Engineering Zoom Camp: https://github.com/DataTalksClub/data-engineering-zoomcamp

Rust stream processing engine for real-time detection. Open-source Apache Flink alternative built for detection engineering, fraud prevention, and MITRE ATT&CK coverage. 1.5M events/sec, single 15MB binary, no JVM.

Apama Connectivity Plugin for Apache Pulsar Messaging Framework.

Building application analytics streaming for delivering data-enriched visualizations in a real-time dashboard