Lab article · ~15 min read

Data Streaming: Kafka Streams & Flink

Stream processing for fraud detection and real-time payments: windowing, stateful joins, exactly-once processing, and the trade-offs between Kafka Streams (in-process) and Flink (separate cluster).

Kafka Streams Apache Flink IBM Event Streams Windowing RocksDB
Read article →
Lab article · ~14 min read

Data Streaming: ksqlDB & Flink SQL for Stream Analytics

SQL on streams for financial services: stateful aggregations, windowing semantics, temporal joins for sanctions screening, schema management, and the operational trade-offs that determine which engine fits your architecture.

ksqlDB Flink SQL Schema Registry Windowing Stream Analytics
Read article →
Lab article · ~14 min read

Data Streaming: Real-Time Fraud Detection Pipeline

End-to-end production design: Feast feature store, sliding-window velocity checks with Flink KeyedProcessFunction, embedded ONNX model scoring, a dispute-driven feedback loop, and the operational patterns that keep sub-100 ms card authorisation SLAs intact under load.

Apache Flink Feast ONNX Runtime Redis Kafka
Read article →
Lab article · ~14 min read

Schema Registry and Data Contracts: Avro, Compatibility Modes, and CI Enforcement

Avro schema design for pacs.008 with decimal logicalType and PDPL classification metadata, schema-registry-maven-plugin CI compatibility checks, schema evolution patterns, and the governance model that keeps 60 Kafka topics from becoming a fragile mesh of implicit contracts.

Confluent Schema Registry Avro Kafka OpenShift PDPL
Read article →
Lab article · ~14 min read

Stateful Stream Processing: Kafka Streams Interactive Queries and Flink Exactly-Once

Flink VelocityCheckFunction with RocksDB state and TTL, exactly-once Kafka sink configuration, Kafka Streams interactive query REST endpoint, tumbling and session window semantics, and the checkpoint sizing guidance that keeps RocksDB from stalling payment detection pipelines.

Apache Flink Kafka Streams RocksDB Exactly-Once Stateful Processing
Read article →