<--- Back to all connectors

Parquet

Apache Parquet is an open source, column-oriented data file format designed for efficient data storage and retrieval. It provides efficient data compression and encoding schemes with enhanced performance to handle complex data in bulk. Streamkap supports Parquet files for reading and writing to S3.

Add Connector
View Documentation

Read & Write Parquet file formats for real-time processing

  • Snapshot/Backfill historical data before moving to streaming
  • Can include/exclude table/columns
  • Change Data Capture for supported sources
  • Schema evolution support for supported destinations
  • Setup sending real-time data to Parquet in minutes

‍

Marcin Migda

Staff Data Engineer

"Streamkap was 4x faster and had 3x lower total cost of ownership than our previous solution"

Why Streamkap?

Reliable

Serverless platform providing enterprise reliability and scale.

Affordable

Only pay for GB into Streamkap.

Longterm

Retain data for as long as you need.

Flexible

Read once, write to many destinations.

Explore more connectors

DuckDB

DuckDB is a fast, embeddable, and open-source analytical database. It can run on a local machine, embedded in an application or in the cloud and excels at complex SQL queries on various file formats (like CSV and Parquet), and integrates seamlessly with languages like Python and R.

Explore more
Destination

MotherDuck

MotherDuck is DuckDB in multiplayer mode. A serverless data warehouse with all the power of DuckDB and the scale of the cloud. Streamkap supports MotherDuck as a destination.

Explore more
Destination

DynamoDB

DynamoDB is a serverless, NoSQL database service from Amazon that enables you to develop modern applications at any scale. DynamoDB is scalable, fast and flexible. Streamkap can connect to via DynamoDB streams for real-time change data capture. For historical data, Streamkap uses DynamoDB’s S3 export feature for cost-efficient backfilling of data.

Explore more
Source
Explore All Connectors