datafusion

DataFusion 是一个可扩展的查询执行框架，用Rust 编写，使用Apache Arrow 作为其内存格式

the portable Python dataframe library

#数据仓库#Create full-fledged APIs for slowly moving datasets without writing a single line of code.

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

Distributed compute platform implemented in Rust, and powered by Apache Arrow.

The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query processing

#计算机科学#High performance Rust stream processing engine seamlessly integrates AI capabilities, providing powerful real-time data processing and intelligent analysis.

Apache DataFusion Comet Spark Accelerator

#计算机科学#LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.

ClickBench: a Benchmark For Analytical Databases

Apache Kafka® compatible broker with S3, PostgreSQL, Apache Iceberg and Delta Lake

Analytical database for data-driven Web applications 🪶

#区块链#Next-generation decentralized data lakehouse and a multi-party stream processing network

Distributed pushdown cache for DataFusion

Unofficial rust implementation of Apache Iceberg with integration for Datafusion

Batteries included CLI, TUI, and server implementations for DataFusion.

Query and transform data with PRQL

Postgres protocol frontend for DataFusion

Blazing-Fast Bioinformatic Operations on Python DataFrames