parquet · GitHub Topics

multiprocessio / dsq

Commandline tool for running SQL queries against JSON, CSV, Excel, Parquet, and more.

翻译 - 用于针对 JSON、CSV、Excel、Parquet 等运行 SQL 查询的命令行工具。

Go CSV JSON tsv excel openoffice-calc parquet SQL 命令行界面

Go 3.79 k

1 年前

roapi / roapi

#数据仓库#Create full-fledged APIs for slowly moving datasets without writing a single line of code.

SQL GraphQL arrow REST API analytics Query (disambiguation)columnar Rust in-memory-database datafusion blob-storage cloud-native parquet 数据集 s3 delta-lake

Rust 3.28 k

24 天前

apache / arrow-rs

Official Rust implementation of Apache Arrow

arrow object-store parquet Rust

Rust 2.82 k

3 小时前

apache / parquet-java

Apache Parquet Java

翻译 - 阿帕奇木地板

parquet apache parquet-java

Java 2.74 k

4 天前

dathere / qsv

#数据仓库#Blazing-fast Data-Wrangling toolkit

CSV data-wrangling 命令行界面 Open Data data-engineering ckan excel luau parquet PostgreSQL SQLite polars snappy SQL geocode timeseries dcat metadata 统计 sampling

Rust 2.65 k

14 小时前

apache / drill

Apache Drill is a distributed MPP query layer for self describing data

Java big-data SQL hive hadoop jdbc parquet

Java 1.96 k

10 小时前

apache / parquet-format

Apache Parquet Format

parquet apache

Thrift 1.9 k

7 天前

rilldata / rill

Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.

duckdb Svelte sveltekit 数据可视化 CSV parquet Go s3 gcs 数据分析 SQL bi data business-analytics sql-editor

Go 1.89 k

10 天前

uber / petastorm

#计算机科学#Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, a...

Tensorflow PyTorch 深度学习机器学习 pyspark parquet

Python 1.82 k

1 年前

gchq / Gaffer

A large-scale entity and relation database supporting aggregation of properties

accumulo graph graph-database hadoop big-data aggregation hbase parquet Apache Spark

Java 1.78 k

1 个月前

quiltdata / quilt

Quilt is a data mesh for connecting people with actionable data

data data-engineering data-version-control data-versioning Python serialization parquet

TypeScript 1.33 k

5 天前

paradigmxyz / cryo

cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes

crypto 以太坊 evm parquet Rust

Rust 1.32 k

2 个月前

BemiHQ / BemiDB

Postgres read replica optimized for analytics

analytics data-warehouse duckdb iceberg olap parquet PostgreSQL replication

Go 1.3 k

5 天前

bigdatagenomics / adam

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

Apache Spark big-data Bioinformatics genomics parquet avro Scala Java Python R

Scala 1.02 k

10 天前

Mooncake-Labs / pg_mooncake

Postgres-native Data Warehouse

analytics columnstore delta-lake iceberg lakehouse parquet PostgreSQL

C++ 1.01 k

2 天前

tonbo-io / tonbo

A portable embedded database using Arrow.

arrow big-data Rust embedded-database 数据库 htap lsm-tree offline-first parquet

Rust 900

8 天前

mukunku / ParquetViewer

Simple Windows desktop application for viewing & querying Apache Parquet files

parquet windows-desktop .NET big-data apache-parquet

C# 831

24 天前

Cinchoo / ChoETL

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)

CSV Parser writer reader flat XML JSON keyvalue etl etl-framework C#.NET parquet YAML avro

C# 820

3 个月前

HariSekhon / DevOps-Python-tools

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML...

cloudformation Python hbase JSON avro parquet Apache Spark pyspark travis-ci elasticsearch solr hadoop hdfs dockerhub Docker Linux Amazon Web Services DevOps Google 云 gcf

Python 791

1 个月前

developmentseed / lonboard

A Python library for fast, interactive geospatial vector data visualization in Jupyter.

apache-arrow deck-gl geopandas Jupyter Notebook 数据可视化 geospatial-analysis maps Python 可视化 webgl apache-parquet parquet geospatial

Python 714

10 天前