<--- Back to all connectors

Parquet

Apache Parquet is an open source, column-oriented data file format designed for efficient data storage and retrieval. It provides efficient data compression and encoding schemes with enhanced performance to handle complex data in bulk. Streamkap supports Parquet files for reading and writing to S3.

Add Connector
View Documentation

Read & Write Parquet file formats for real-time processing

  • Snapshot/Backfill historical data before moving to streaming
  • Can include/exclude table/columns
  • Change Data Capture for supported sources
  • Schema evolution support for supported destinations
  • Setup sending real-time data to Parquet in minutes

‍

Marcin Migda

Staff Data Engineer

"Streamkap was 4x faster and had 3x lower total cost of ownership than our previous solution"

Why Streamkap?

Reliable

Serverless platform providing enterprise reliability and scale.

Affordable

Only pay for GB into Streamkap.

Longterm

Retain data for as long as you need.

Flexible

Read once, write to many destinations.

Explore more connectors

DynamoDB

DynamoDB is a serverless, NoSQL database service from Amazon that enables you to develop modern applications at any scale. DynamoDB is scalable, fast and flexible. Streamkap can connect to via DynamoDB streams for real-time change data capture. For historical data, Streamkap uses DynamoDB’s S3 export feature for cost-efficient backfilling of data.

Explore more
Source

Db2

Db2 is a database product from IBM. It is a Relational Database Management System (RDBMS). Db2 is designed to store, analyze and retrieve the data efficiently. Db2 product is extended with the support of Object-Oriented features and non-relational structures with XML.

Explore more
Source

Vitess

Vitess is an open source system for database clustering that allows for the horizontal scaling of MySQL databases. Vitess was originally developed at YouTube and is used by some of the largest websites in the world. Vitess combines the features of MySQL with the scalability of a NoSQL database, and uses sharding to separate large databases into smaller, more manageable parts.

Explore more
Source
Explore All Connectors