cdc · GitHub Topics

debezium / debezium

Debezium为捕获数据更改(change data capture,CDC)提供了一个低延迟的流式处理平台

change-data-capture kafka-connect apache-kafka debezium cdc 数据库 kafka kafka-producer event-streaming

Java 11.16 k

15 小时前

apache / seatunnel

SeaTunnel （原名为 waterdrop）是一个易用的支持海量数据实时同步的高性能分布式数据集成平台，每天可以稳定同步数百亿数据

data-integration high-performance offline real-time apache batch cdc change-data-capture data-ingestion elt streaming

Java 8.34 k

2 天前

supabase / realtime

Broadcast, Presence, and Postgres Changes via WebSockets

翻译 - 通过websockets实时收听PostgreSQL数据库。用Elixir构建。

Elixir PostgreSQL realtime phoenix phoenix-framework cdc change-data-capture crdt distributed-systems Publish-subscribe pattern

Elixir 6.96 k

7 天前

apache / flink-cdc

Flink CDC Connector 是ApacheFlink的一组数据源连接器

change-data-capture cdc batch data-integration data-pipeline distributed elt etl flink kafka MySQL paimon PostgreSQL real-time schema-evolution

Java 5.99 k

9 小时前

disease-sh / API

API for Current cases and more stuff about COVID-19 and Influenza

翻译 - 针对当前案例的API，以及有关COVID-19或新型冠状病毒株的更多内容

corona COVID-19 API covid disease Redis Discord Postman discord-server cdc coronavirus coronavirus-tracking

JavaScript 2.47 k

7 个月前

PeerDB-io / peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

etl SQL BigQuery cloud-native distributed-systems kafka PostgreSQL realtime Rust snowflake stream-processing cdc clickhouse s3

Go 2.44 k

1 天前

confluentinc / examples

Apache Kafka, Apache Flink and Confluent Platform examples and demos

kafka Demo Example confluent cloud connect connector jdbc debezium quickstart schema-registry 监控 avro Kubernetes cdc SQL Docker 微服务

Shell 1.95 k

21 天前

cherry-embedded / CherryUSB

CherryUSB is a tiny and beautiful, high performace and portable USB host and device stack for embedded system with USB IP

usb-host usb-device usb cdc hid uvc uac dfu ehci hub rndis

C 1.43 k

8 天前

eulerto / wal2json

JSON output plugin for changeset extraction

翻译 - JSON输出插件，用于变更集提取

PostgreSQL replication 插件 JSON cdc

C 1.37 k

10 个月前

hazelcast / hazelcast-jet

Distributed Stream and Batch Processing

翻译 - 基于Hazelcast的分布式流和批处理引擎。

Java big-data stream-processing batch-processing low-latency kafka cdc Hacktoberfest

Java 1.1 k

3 个月前

datavane / tis

Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI

Java datax etl flink cdc DataOps

Java 1.1 k

2 天前

2ndQuadrant / pglogical

Logical Replication extension for PostgreSQL 17, 16, 15, 14, 13, 12, 11, 10, 9.6, 9.5, 9.4 (Postgres), providing much faster replication than Slony, Bucardo or Londiste, as well as cross-version upgra...

PostgreSQL replication subscription Publish-subscribe pattern data-transformation etl cdc zero-downtime

C 1.08 k

6 个月前

drasi-project / drasi-platform

The Data Change Processing platform

cdc change-data-capture change-detection

Rust 1.07 k

5 天前

JumpMind / symmetric-ds

SymmetricDS is database replication and file synchronization software that is platform independent, web enabled, and database agnostic. It is designed to make bi-directional data replication fast, ea...

synchronization 数据库 platform-independent cdc Java MySQL PostgreSQL sql-server db2 h2-database firebird replication informix Oracle 数据库

Java 780

1 天前

WangXuan95 / FPGA-USB-Device

An FPGA-based USB 1.1 (full-speed) device core to implement USB-serial, USB-camera, USB-audio, USB-hid, etc. It requires only 3 FPGA common IOs rather than additional chips. 基于FPGA的USB 1.1 (full-speed...

fpga Verilog rtl usb usb-cdc usb-hid usb-device keyboard usb-audio cdc uvc

Verilog 705

3 个月前

artie-labs / transfer

Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift, Databricks) in real-time.

snowflake cdc change-data-capture Go BigQuery kafka apache-kafka data-integration data-pipelines 数据库 debezium elt redshift

Go 636

1 天前

xtoolbox / TeenyUSB

Lightweight USB device and host stack for STM32 and other MCUs. Ready for USB 3.0 device.

usb stm32 host hub composite hid cdc msc rndis embedded usb3 speed

C 583

1 年前

dotnetcore / CanalSharp

Alibaba mysql database binlog subscription & consumer components Canal's .NET client.

canal canal-client netstandard20 netcore MySQL binlog real-time cdc

C# 581

6 天前

actiontech / dtle

Distributed Data Transfer Service for MySQL

MySQL data-transfer data-migration replication cdc change-data-capture

Go 553

1 年前

datazip-inc / olake

Fastest open-source tool for replicating Databases to Apache Iceberg or Data Lakehouse. ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Starting with MongoDB

cdc change-data-capture data-pipeline 数据库 elt etl lakehouse replication

Go 449

1 天前