A curated list of awesome ETL frameworks, libraries, and software.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
A framework for moving data into a data warehouse.
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
Flow-based programming for JavaScript
Golang framework for streaming ETL, observability data pipeline, and event processing apps
翻译 - 用于流ETL,可观察性数据管道和事件处理应用程序的Golang框架
A .NET dataflow and etl framework built upon Microsoft TPL Dataflow library
Bigquery ETL
Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Go...
LinkedPipes ETL is an RDF based, lightweight ETL tool
Pentaho Data Integration ( ETL ) a.k.a Kettle
翻译 - Pentaho数据集成(ETL)水壶
ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ
visualized crawler & ETL IDE written with C#/WPF
翻译 - 用C#/ WPF编写的可视化爬虫和ETL IDE
ETL best practices with airflow, with examples
Extract, Transform, and Load data with Ruby
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contrac...