hdfs · GitHub Topics

SeaweedFS 是一个用于blob、对象、文件和数据湖的分布式存储系统，可快速存储和服务数十亿个文件

distributed-storage distributed-systems s3 hdfs fuse distributed-file-system hadoop-hdfs posix tiered-file-system Kubernetes replication object-storage s3-storage seaweedfs erasure-coding blob-storage cloud-drive

Go 23.9 k

9 小时前

heibaiying / BigData-Notes

大数据入门指南 ⭐

hadoop hdfs Yarn mapreduce hive Apache Spark storm hbase Scala kafka zookeeper flume azkaban sqoop phoenix bigdata big-data

Java 16.25 k

1 年前

ceph / ceph

Ceph is a distributed object, block, and file storage platform

翻译 - Ceph是一个分布式对象，块和文件存储平台

C++ 14.71 k

13 小时前

juicedata / juicefs

为开发者设计的云文件系统。为云环境设计，兼容 POSIX、HDFS 和 S3 协议的分布式文件系统

filesystem cloud-native Go Redis distributed-systems storage object-storage posix hdfs s3 bigdata

Go 11.34 k

12 小时前

wangzhiwubigdata / God-Of-BigData

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

flink Apache Spark hadoop hdfs hive hbase kafka zookeeper bigdata flume azkaban

9.99 k

2 年前

piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

Python s3 hdfs boto streaming file streaming-data bz2 Hacktoberfest

Python 3.28 k

6 天前

TileDB-Inc / TileDB

The Universal Storage Engine

tiledb arrays storage-engine scientific-computing 数据分析 hdfs s3 s3-storage 数据科学 sparse-data dataframes

C++ 1.91 k

1 天前

water8394 / BigData-Interview

#面试#🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

bigdata Apache Spark kafka hbase flink hadoop hdfs mapreduce Yarn 面试

1.6 k

4 年前

collabH / bigdata-growth

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

flink kafka hive mapreduce Apache Spark olap hadoop hbase debezium hdfs bigdata hudi

Shell 1.56 k

4 个月前

colinmarc / hdfs

A native go client for HDFS

hdfs Go 命令行界面

Go 1.39 k

2 个月前

wgzhao / Addax

Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.

hadoop hive 数据库 clickhouse influxdb MySQL sql-server trino excel impala Oracle 数据库 PostgreSQL etl hdfs

Java 1.23 k

3 天前

spotify / snakebite

A pure python HDFS client

hdfs Python

Python 856

3 年前

HariSekhon / DevOps-Python-tools

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML...

cloudformation Python hbase JSON avro parquet Apache Spark pyspark travis-ci elasticsearch solr hadoop hdfs dockerhub Docker Linux Amazon Web Services DevOps Google 云 gcf

Python 791

1 个月前

sunnyandgood / BigData

💎🔥大数据学习笔记

hadoop hive hbase hdfs zookeeper sqoop mapreduce flume MySQL Linux Shell

Java 679

6 年前

Stratio / sparta

Real Time Analytics and Data Pipelines based on Spark Streaming

streaming-data Scala Apache Spark streaming spark-streaming olap kafka hdfs workflow analytics real-time sparksql lambda triggers

Scala 525

5 年前

lensesio / kafka-connect-ui

Web tool for Kafka Connect |

kafka kafka-connect elasticsearch Apache Cassandra s3 documentdb Redis MQTT hdfs influxdb Twitter

JavaScript 509

1 年前

dromara / CloudEon

CloudEon uses Kubernetes to install and deploy open-source big data components, enabling the containerized operation of an open-source big data platform. This allows you to reduce your focus on underl...

hadoop Kubernetes doris hdfs Yarn bigdata cloudnative

FreeMarker 448

21 天前