stream-processing · GitHub Topics

#安卓#MediaPipe 是一个跨平台实时、流媒体机器学习解决方案。提供了人脸识别、人体姿势识别与跟踪、物体检测、自拍分割、即时运动跟踪等功能

mediapipe C++机器视觉深度学习 Android video-processing audio-processing mobile-development 机器学习 inference graph-framework graph-based calculator 框架 pipeline-framework stream-processing perception

C++ 28.91 k

1 天前

pathwaycom / pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

batch-processing kafka pathway Python streaming 机器学习 real-time data-analytics data-pipelines data-processing dataflow etl etl-framework iot-analytics Rust stream-processing time-series-analysis

Python 23.35 k

16 小时前

vectordotdev / vector

A high-performance observability data pipeline.

翻译 - 用于构建可观察性管道的轻量级和超快速工具

router logs 监控 Rust observability forwarder vector Parser events stream-processing pipeline

Rust 18.95 k

1 小时前

zhisheng17 / flink-learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、...

flink kafka elasticsearch Apache Spark Redis MySQL rocketmq hbase rabbitmq stream-processing streaming clickhouse loki influxdb opentsdb

Java 14.68 k

18 小时前

oxnr / awesome-bigdata

#Awesome#A curated list of awesome big data frameworks, ressources and other awesomeness.

Awesome Lists bigdata data-warehouse data-analytics 数据可视化 data-stream 数据库数据科学 data distributed-database stream-processing streaming-data visualize-data

13.5 k

1 个月前

madd86 / awesome-system-design

#面试#A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

翻译 - 精选的出色系统设计（A.K.A.分布式计算）资源列表。

relational-database message-broker hadoop-ecosystem NoSQL 面试 distributed-systems microservices-architecture stream-processing 微服务

10.09 k

8 个月前

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

翻译 - Redpanda是现代应用程序的实时引擎。

kafka C++Kubernetes Go streaming redpanda containers realtime event-driven 微服务 storage-engine stream-processing seastar

C++ 10.09 k

5 小时前

redpanda-data / connect

Fancy stream processing made operationally mundane

翻译 - 普通任务和数据工程的声明式流处理

message-queue stream-processing streaming-data message-bus logs stream-processor cqrs event-sourcing Go kafka amqp rabbitmq nats etl data-engineering DataOps

Go 8.26 k

3 小时前

ThreeDotsLabs / watermill

Building event-driven applications the easy way in Go.

翻译 - 在Go中轻松构建事件驱动的应用程序。

watermill event-driven event-sourcing sagas events stream-processing reactive Go rabbitmq kafka cqrs nats

Go 8.17 k

2 天前

risingwavelabs / risingwave

下一代云原生流数据库

数据库 stream-processing Rust PostgreSQL kafka materialized-view data-engineering

Rust 7.51 k

3 小时前

robinhood / faust

Python Stream Processing

kafka-streams kafka Python asyncio distributed-systems stream-processing

Python 6.77 k

7 个月前

fluent / fluent-bit

Fluent Bit 是一个快速、轻量级日志采集、转发器，可运行在 Linux、MacOS、Windows、嵌入式系统中

fluentd C Logging data-collector fluent-bit forwarder cloudnative stream-processing sql-queries 监控 traces logs OpenTelemetry prometheus

C 6.65 k

1 天前

hazelcast / hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

翻译 - 开源内存数据网格

Java hazelcast in-memory big-data scalability distributed caching Hacktoberfest stream-processing low-latency distributed-computing distributed-systems data-in-motion data-insights real-time

Java 6.26 k

2 天前

MaterializeInc / materialize

Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.

翻译 - 流数据仓库

Rust 数据库 SQL streaming kafka distributed-systems postgresql-dialect materialized-view stream-processing PostgreSQL streaming-data

Rust 5.9 k

2 天前

apache / hudi

Upserts, Deletes And Incremental Processing on Big Data.

翻译 - 大数据的更新，删除和增量处理。

hudi apachehudi datalake bigdata apachespark incremental-processing stream-processing data-integration apacheflink

Java 5.69 k

9 小时前

online-ml / river

#计算机科学#🌊 Online machine learning in Python

翻译 - ：custard：Python中的在线机器学习

incremental-learning 机器学习 Python online-learning online-statistics 数据科学 streaming online-machine-learning streaming-data concept-drift real-time-processing stream-processing

Python 5.23 k

7 天前

javascriptdata / danfojs

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.

翻译 - danfo.js是一个开放源代码的JavaScript库，可提供高性能，直观且易于使用的数据结构来处理和处理结构化数据。

data-analytics 数据科学 pandas data-manipulation tensors dataframe JavaScript 数据分析 stream-processing Tensorflow table

TypeScript 4.85 k

8 个月前

infinyon / fluvio

Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.

cloud-native streaming Rust real-time Serverless stateful stream-processing WebAssembly data-integration data-flow distributed-systems event-driven-architecture stream-processing-engine data-pipelines streaming-data data-analytics

Rust 4.34 k

2 天前

ArroyoSystems / arroyo

Distributed stream processing engine in Rust

data dev-tools infrastructure kafka Rust SQL stream-processing data-stream-processing stream-processing-engine

Rust 4.07 k

6 天前

airtai / faststream

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

asyncio kafka Python rabbitmq AsyncAPI Specification distributed-systems faststream fastkafka propan nats Redis stream-processing

Python 3.54 k

2 天前