⚡ Workflow Automation Platform. Orchestrate & Schedule code in any language, run anywhere, 500+ plugins. Alternative to Zapier, Rundeck, Camunda, Airflow...
Alluxio作为数据编排层为大数据和人工智能工作负载带来速度和敏捷性并降低成本，使用户能够迁移到对象存储等更新的存储解决方案
cloud-native distributed storage
翻译 - 面向云本机应用程序的分布式文件系统和对象存储，用于分解的计算和存储。
An open source, standard data file format for graph data storage and retrieval.
A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data vi...
Data-aware orchestration with dagster, dbt, and airbyte
Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis
Best practices for data workflows, integrations with the Modern Data Stack (MDS), Infrastructure as Code (IaC), Cloud Provider Services
#计算机科学#This repo contains a dataset, exercises, and sample code for an end-to-end SAP BTP data-to-value bootcamp covering SAP HANA Cloud, SAP Data Warehouse Cloud, SAP Data Intelligence Cloud, and SAP Analyt...
A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran
CI/CD repository template to automate deployments of your production flows
Get started with Dagster ASAP
#计算机科学#An operator for managing Alluxio system on Kubernetes cluster
A simple pipeline infrastructure with ETL pipeline contained in a Docker environment on Apache Airflow for orchestration and Postgres for data warehousing
Bring Infrastructure as Code best practices to your data workflows with Kestra and Terraform
Develop a real-time data ingestion pipeline using Kafka and Spark. Collect minute-level stock data from Yahoo Finance, ingest it into Kafka, and process it with Spark Streaming, storing the results in...
Data orchestration repo with Docker deployment
Build an ELT pipeline with dagster and dbt to schedule loading HDB resale transactions in Singapore into Google BigQuery data warehouse, then create Power BI dashboard to enhance insight exploration.
Working with SCD Type (Change Data Capture) and need a Data Vault model to test Azure Data Factory v2? - This Code with Help!
Prefect - Data orchestration tool practice & learning