stream-processing · GitHub Topics

#安卓#MediaPipe 是一个跨平台实时、流媒体机器学习解决方案。提供了人脸识别、人体姿势识别与跟踪、物体检测、自拍分割、即时运动跟踪等功能

mediapipe C++机器视觉深度学习 Android video-processing audio-processing mobile-development 机器学习 inference graph-framework graph-based calculator 框架 pipeline-framework stream-processing perception

C++ 30.63 k

10 小时前

pathwaycom / pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

batch-processing kafka pathway Python streaming 机器学习 real-time data-analytics data-pipelines data-processing dataflow etl etl-framework iot-analytics Rust stream-processing time-series-analysis

Python 28.67 k

11 小时前

vectordotdev / vector

A high-performance observability data pipeline.

router logs 监控 Rust observability forwarder vector Parser events stream-processing pipeline

Rust 19.92 k

3 天前

zhisheng17 / flink-learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、...

flink kafka elasticsearch Apache Spark Redis MySQL rocketmq hbase rabbitmq stream-processing streaming clickhouse loki influxdb opentsdb

Java 14.86 k

4 个月前

oxnr / awesome-bigdata

#Awesome#A curated list of awesome big data frameworks, ressources and other awesomeness.

Awesome Lists bigdata data-warehouse data-analytics 数据可视化 data-stream 数据库数据科学 data distributed-database stream-processing streaming-data visualize-data

13.72 k

5 个月前

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

kafka C++Kubernetes Go streaming redpanda containers realtime event-driven 微服务 storage-engine stream-processing seastar

C++ 10.56 k

1 天前

madd86 / awesome-system-design

#面试#A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

relational-database message-broker hadoop-ecosystem NoSQL 面试 distributed-systems microservices-architecture stream-processing 微服务

10.52 k

1 年前

ThreeDotsLabs / watermill

Building event-driven applications the easy way in Go.

watermill event-driven event-sourcing sagas events stream-processing reactive Go rabbitmq kafka cqrs nats

Go 8.65 k

11 天前

redpanda-data / connect

Fancy stream processing made operationally mundane

message-queue stream-processing streaming-data message-bus logs stream-processor cqrs event-sourcing Go kafka amqp rabbitmq nats etl data-engineering DataOps

Go 8.41 k

1 天前

risingwavelabs / risingwave

下一代云原生流数据库

数据库 stream-processing Rust PostgreSQL kafka materialized-view data-engineering apache-iceberg

Rust 7.99 k

2 小时前

fluent / fluent-bit

Fluent Bit 是一个快速、轻量级日志采集、转发器，可运行在 Linux、MacOS、Windows、嵌入式系统中

fluentd C Logging data-collector fluent-bit forwarder cloudnative stream-processing sql-queries 监控 traces logs OpenTelemetry prometheus

C 7.03 k

4 小时前

robinhood / faust

Python Stream Processing

kafka-streams kafka Python asyncio distributed-systems stream-processing

Python 6.81 k

1 年前

hazelcast / hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

Java hazelcast in-memory big-data scalability distributed caching Hacktoberfest stream-processing low-latency distributed-computing distributed-systems data-in-motion data-insights real-time

Java 6.35 k

3 天前

MaterializeInc / materialize

Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.

Rust 数据库 SQL streaming kafka distributed-systems postgresql-dialect materialized-view stream-processing PostgreSQL streaming-data operational-data-store data-store

Rust 6.04 k

20 小时前

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

hudi apachehudi datalake bigdata apachespark incremental-processing stream-processing data-integration apacheflink

Java 5.87 k

3 天前

online-ml / river

#计算机科学#🌊 Online machine learning in Python

incremental-learning 机器学习 Python online-learning online-statistics 数据科学 streaming online-machine-learning streaming-data concept-drift real-time-processing stream-processing

Python 5.44 k

12 天前

infinyon / fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

cloud-native streaming Rust real-time Serverless stateful stream-processing WebAssembly data-integration data-flow distributed-systems event-driven-architecture stream-processing-engine data-pipelines streaming-data streaming-data-pipelines streaming-data-processing data-analytics streaming-analytics

Rust 4.96 k

10 天前

javascriptdata / danfojs

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.

data-analytics 数据科学 pandas data-manipulation tensors dataframe JavaScript 数据分析 stream-processing Tensorflow table

TypeScript 4.96 k

21 天前

ArroyoSystems / arroyo

Distributed stream processing engine in Rust

data dev-tools infrastructure kafka Rust SQL stream-processing data-stream-processing stream-processing-engine

Rust 4.42 k

2 天前

ag2ai / faststream

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

asyncio kafka Python rabbitmq AsyncAPI Specification distributed-systems faststream fastkafka propan nats Redis stream-processing

Python 4.17 k

1 天前