Streamkap Blog

Engineering January 6, 2026

CDC from Multi-Tenant Databases with Sub-Second Latency

How Streamkap handles CDC at scale across multi-tenant databases with thousands of schemas, delivering sub-second latency without managing Kafka or Flink.

Case Study December 16, 2025

Streaming 400,000 Tables with Streamkap

How Limble solved data architecture complexity, maintenance overhead, and lowered costs.

Case Study November 27, 2025

Case Study: InHire Powers Real-Time AI Recruitment with Streamkap

How a Brazilian ATS leader InHire solved a data crisis in three weeks and built a cutting-edge, real-time AI platform without a single data engineer.

Engineering September 5, 2025

Real-Time Data Streaming with Snowflake: Unlocking Low-Latency Analytics and GenAI with Streamkap

Snowflake streaming is now cheaper than batch-1-second latency at 10x lower cost. Learn how Streamkap achieves 75% cost reduction.

Tutorial August 26, 2025

The Evolution from Lambda to Kappa Architecture: A Comprehensive Guide

Kappa Architecture unifies streaming into a single model, eliminating Lambda's dual-layer complexity. Learn the key differences.

Tutorial August 21, 2025

How to Stream MongoDB Data to Iceberg on AWS with Streamkap

Stream MongoDB to Iceberg on S3 for e-commerce analytics. Enable real-time discounts and dynamic inventory with minimal latency.

Tutorial August 20, 2025

How to Stream AWS SQL Server Data to Iceberg on AWS with Streamkap

Stream SQL Server to Iceberg on S3 for AI/ML workflows. Leverage time-travel queries and optimized performance without complexity.

Company August 15, 2025

What’s New in Streamkap: 🧊 Apache Iceberg Connector

Real-time lakehouse, simplified with Apache Iceberg and Streamkap

Tutorial August 15, 2025

Why Apache Iceberg? A Guide to Real-Time Data Lakes in 2025

Apache Iceberg brings SQL tables to cloud storage with ACID transactions and time travel. Learn why it's essential for 2025.

Tutorial August 15, 2025

How to Stream AWS MySQL Data to Iceberg on AWS with Streamkap

Stream MySQL to Iceberg on S3 for real-time lakehouse analytics. Build scalable foundations with ACID transactions and schema evolution.

Tutorial August 12, 2025

How to Stream AWS Postgres Data to Iceberg on AWS with Streamkap

Stream PostgreSQL to Iceberg on S3 in minutes. Build data lake architectures for predictive maintenance and equipment monitoring.

Engineering July 18, 2025

Migrating Data from Batch Ingestion to Streamkap: A Technical Deep Dive

At SpotOn, we had an existing pipeline that synchronized data from our production MongoDB to Snowflake. During peak demand, our customers require data to be as close to real-time as possible. To improve our latency (and reduce the cost of our maintenance and infrastructure), we started to look for a

Company July 18, 2025

What’s New in Streamkap: Read-Only Snapshot and Heartbeat Support

Responsive connectors, no replication lag or stuck offsets in low activity tables.

Engineering July 1, 2025

FAQ Apache Iceberg

Apache Iceberg adds ACID transactions and time travel to data lakes. Learn how Netflix uses it at petabyte scale for analytics.

Tutorial June 30, 2025

How to Stream SQL Server to ClickHouse with Streamkap

As demand for real-time data insights grows, organizations need tools that can quickly move data from production applications into their data platforms.

Tutorial June 20, 2025

How to Stream MySQL to Databricks with Streamkap

Modern data teams often face the challenge of making operational data from systems like AWS-hosted MySQL available in analytics platforms like Databricks with minimal delay.

Tutorial June 17, 2025

How to Stream MongoDB to ClickHouse for Real-Time Analytics

Data-driven decision-making is only as effective as the systems that power it. Unfortunately, many traditional architectures can't keep pace with today’s e-commerce velocity.

Tutorial May 30, 2025

How to Stream AWS MySQL Data to Google BigQuery with Streamkap

Modern data teams often face the challenge of making operational data from systems like AWS-hosted MySQL available in analytics platforms like Google BigQuery with minimal delay.

Tutorial May 28, 2025

How to Stream DynamoDB to Databricks with Streamkap

Modern data practitioners face an increasingly complex challenge: ingesting data from diverse sources into multiple destinations at high velocity. As NoSQL databases have surged in popularity, teams struggle with fast, reliable data movement from these operational stores to analytics platforms.

Tutorial May 10, 2025

Streaming Data from AWS MySQL to MotherDuck: Real-Time Analytics Made Simple

Stream MySQL data to MotherDuck for real-time analytics. Replace slow batch ETL with CDC streaming for faster financial analysis and market decisions.

Tutorial May 1, 2025

How to Stream DynamoDB to MotherDuck with Streamkap

In today’s fast-paced business environment, having access to accurate data at the right moment is crucial for making informed decisions.

Tutorial April 22, 2025

How to Stream SQL Server to Databricks with Streamkap

Modern data teams often face the challenge of making operational data from systems like AWS-hosted SQLServer available in analytics platforms like Databricks with minimal delay.

Tutorial April 10, 2025

How to Stream Oracle to Snowflake with Streamkap

In a World Where Speed is King, Don’t Let Your Data Fall Behind When decisions can’t wait, neither should your data. Outdated processes are slowing you down—but they don’t have to anymore.

Company April 3, 2025

Why LLMs Fail at SQL: The Case for Semantic Layers

Why LLMs fail at business data questions - your data warehouse doesn't speak business language. Semantic layers might be the key.

Tutorial March 30, 2025

How to Stream PostgreSQL to Databricks with Streamkap

In today’s fast-moving world, businesses need the right data at the right time to make smart decisions. But let’s face it—traditional data processing can be slow and complicated.

Company March 27, 2025

Startup Metrics Inflated 11x: Separating Real ARR from Hype

AI startups claim massive ARR numbers, but many don't hold up to scrutiny. $10M claimed versus $3M actual is an 11x gap.

Case Study March 25, 2025

Streamkap Empowers Nala Money to Optimize Real-Time Money Transfers to Africa

It's a Tuesday morning in London. You're rushing to catch the Tube when your phone buzzes. Your cousin in Lagos, Nigeria, needs money for emergency surgery, or the hospital won't admit her. You need to be able to send the money now and trust it will get there without any problems.

Tutorial March 17, 2025

How to Stream MySQL to ClickHouse with Streamkap

In today’s fast-paced business world, speed isn’t just an advantage—it’s a necessity. Decisions need to be made in real-time, but let’s face it: traditional data processing is clunky, slow, and overly complicated.

Company March 11, 2025

Will AI Replace Zapier? How MCP Threatens 8,000+ Integrations

Chegg's stock plunged 89% due to AI disruption. Now MCP threatens Zapier's 8,000+ integrations - will they adapt or decline?

Tutorial March 8, 2025

How to Stream SQL Server to Snowflake with Streamkap

In an era demanding instant insights, your data can’t afford lag.When milliseconds determine outcomes, delayed data becomes a liability. Legacy systems throttle progress, but transformation is within reach.

Company March 5, 2025

Data Teams Must Prove ROI: Why Business Impact Beats Definitions

The ZIRP era is over - data teams must now prove their value through real outcomes, not debates about definitions.

Tutorial March 3, 2025

How to Stream PostgreSQL to S3 with Streamkap

In today's ever-changing business climate, immediate access to reliable data is crucial for making sound decisions. However, traditional data processing methods are often too lengthy and slow to meet modern demands.

Tutorial February 5, 2025

How to Stream DynamoDB to ClickHouse with Streamkap

In today’s fast-paced business environment, having access to accurate data at the right moment is crucial for making informed decisions.

Engineering January 29, 2025

Change Data Capture for Streaming ETL

Change Data Capture refers to the process of capturing changes made to data in a source system such as a database, so that these change events can be used in the destination system, such as a data warehouse, data lake, data app, machine learning models, indexes, or caches.

January 27, 2025

Streamkap vs Airbyte: Managed Real-Time CDC vs Open-Source ETL

Compare Streamkap and Airbyte for data integration. Understand the trade-offs between managed real-time CDC and open-source batch ETL to choose the right platform.

January 27, 2025

Streamkap vs AWS DMS: Real-Time CDC Platform Comparison

Compare Streamkap and AWS Database Migration Service for CDC and data replication. Understand latency, features, and when to choose each platform.

January 27, 2025

Streamkap vs Confluent: Purpose-Built CDC vs Kafka Platform

Compare Streamkap and Confluent for real-time CDC. Understand when you need a full Kafka platform vs a focused CDC solution for data warehouses and lakes.

January 27, 2025

Streamkap vs Debezium: Managed CDC vs Self-Hosted Open Source

Compare Streamkap's managed CDC platform with self-hosted Debezium. Same proven technology, dramatically different operational experience.

January 27, 2025

Streamkap vs Estuary: Real-Time CDC Platform Comparison

Compare Streamkap and Estuary for real-time data integration and CDC. Understand features, pricing, and architecture differences to choose the right platform.

January 27, 2025

Streamkap vs Fivetran: The Complete 2025 Comparison for Real-Time Data Teams

An in-depth comparison of Streamkap and Fivetran for CDC and data integration. Compare pricing, latency, features, and use cases to choose the right platform.

Tutorial January 9, 2025

AWS RDS PostgreSQL Set Up

AWS RDS PostgreSQL stands out as one of the most widely used production databases. Its global adoption and everyday usage have prompted Amazon to make it exceptionally user-friendly. New users can set up an RDS PostgreSQL instance from scratch in just a few minutes.

Tutorial January 9, 2025

Databricks Warehouse Set Up

Getting started with Databricks is a breeze, regardless of your experience level. This guide provides clear instructions on how to create a new account or use your existing credentials, ensuring a smooth and efficient streaming process.

Tutorial January 9, 2025

How to Stream Data From AWS PostgreSQL to Databricks

In today’s fast-moving world, businesses need the right data at the right time to make smart decisions. But let’s face it—traditional data processing can be slow and complicated.

Tutorial January 9, 2025

Streamkap Set Up

To connect Streamkap to AWS RDS PostgreSQL, we need to ensure the database is configured to accept traffic from Streamkap by safelisting Streamkap’s IP addresses in the PostgreSQL instance.

Engineering December 15, 2024

Change Data Capture (CDC) Tutorial: Get Started in Minutes

Learn how Change Data Capture enables real-time data synchronization between your databases and data warehouses.

Engineering September 25, 2024

Kafka Alternatives: Improving Your Data Pipelines

Let’s explore why Streamkap is a superior alternative to vanilla Kafka and compare it with other alternatives.

Engineering September 24, 2024

Optimizing Snowflake for Lower Costs with the Snowpipe Streaming API

With Snowpipe Streaming, Streamkap can provide cost-effective real-time streaming connectivity and performance at a fraction of the competition’s cost — interoperable and Snowflake-ready.

Engineering September 12, 2024

DynamoDB ETL and Rockset migration with Streamkap

Let’s look at the advantages of DynamoDB ETL and Rockset migration with Streamkap.

Case Study August 2, 2024

How Streamkap Reduced Niche.com's Data Latency from 24 Hours to Near Real-Time

Streamkap helped Niche.com reduce their data latency by 95%, slash their data infrastructure costs, and transition from moving limited data to their entire set in less than a day of implementation.

Company August 1, 2024

Streamkap Raises $3.3M to Bring Real-Time Data at a Fraction of the Cost to Businesses

Streamkap, a real-time data streaming provider, announced it has raised $3.3 million in seed and pre-seed funding for its low-cost, low-maintenance streaming ETL platform.

Case Study July 22, 2024

Streamkap Enables Fleetio to Ditch Weekend Data Maintenance for Reliable, Real-Time Streaming

Find out how Streamkap enabled a leading fleet management software company to make the switch from batch processing to real-time streaming data.

Case Study June 18, 2024

Streamkap and SpotOn: A Partnership for Real-Time Data for Payments in Restaurants & Retail

As one of the fastest-growing software and payment companies, SpotOn needed a better way to scale their data batch-processing.

Tutorial May 3, 2024

Streaming MongoDB to Snowflake with Snowpipe Streaming and Dynamic Tables and Lowering Costs

This hands-on guide is for data teams who wish to ingest data from MongoDB to a Snowflake data warehouse with sub-second latency and cost savings to boot.

Tutorial May 3, 2024

Streaming MySQL to Snowflake with Snowpipe Streaming and Dynamic Tables to Save Money

This hands-on guide is for data teams who wish to ingest data from MySQL to a Snowflake data warehouse with sub-second latency and save on ETL costs.

Tutorial May 3, 2024

Streaming PostgreSQL to Snowflake with Snowpipe Streaming and Dynamic Tables for Lower Costs

This hands-on guide is for data teams who wish to ingest data from PostgreSQL to a Snowflake data warehouse with sub-second latency and sub-budget costs.

Tutorial April 24, 2024

Streaming with Change Data Capture to ClickHouse

We’re excited to announce our new ClickHouse database connector for streaming CDC (Change Data Capture) data into ClickHouse.

Tutorial August 27, 2023

Snowflake Snowpipe Streaming with Change Data Capture (CDC)

How to use Snowpipe Streaming to stream Change Data Capture (CDC) to Snowflake

Engineering July 21, 2023

Batch Processing vs Real-Time Stream Processing

There is a big movement underway in the migration from batch ETL to real-time streaming ETL but what does that mean? How do these methods compare? While real-time data streaming has many advantages over batch processing, it is not always the right choice depending on the use case so let's take a loo

Drop-in Replacement for your Batch ETL