#计算机科学#Apache Airflow 是一个workflow工作流调度、编排、监控平台
Turns Data and AI algorithms into production-ready web applications in no time.
Airbyte 开源 EL(T) 平台，帮助用户将数据从应用程序，API 和数据库中同步到数据仓库
An orchestration platform for the development, production, and observation of data assets.
翻译 - 用于构建数据应用程序的Python库：ETL，ML，数据管道等。
SeaTunnel （原名为 waterdrop）是一个易用的支持海量数据实时同步的高性能分布式数据集成平台，每天可以稳定同步数百亿数据
#计算机科学#🧙 Build, run, and manage data pipelines for integrating and transforming data.
Flink CDC Connector 是ApacheFlink的一组数据源连接器
Upserts, Deletes And Incremental Processing on Big Data.
翻译 - 大数据的更新，删除和增量处理。
Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.
Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
翻译 - EventNative是一个开源数据收集框架
Privacy and Security focused Segment-alternative, in Golang and React
翻译 - Golang和React中针对隐私和安全性的细分市场替代方案
Chunjun 纯钧，是一款稳定、易用、高效、批流一体的数据集成框架，目前基于实时计算引擎Flink实现多种异构数据源之间的数据同步与计算，已在上千家公司部署且稳定运行。
#Awesome#Community-curated list of software packages and data resources for single-cell, including RNA-seq, ATAC-seq, etc.
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and co...
翻译 - DevLake：用于 DevOps 工具的开源数据湖和仪表板。
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is widely used to synchronize hundreds of trillions of data every d...
Hop Orchestration Platform
翻译 - Hop 编排平台
#网络爬虫#Kuwala is the no-code data platform for BI analysts and engineers enabling you to build powerful analytics workflows. We are set out to bring state-of-the-art data engineering tools you love, such as ...