pyspark

the portable Python dataframe library

#计算机科学#Simple and Distributed Machine Learning

#自然语言处理#State of the Art Natural Language Processing

Linkis 在上层应用和底层引擎之间构建了一层计算中间件。通过使用Linkis 提供的REST/WebSocket/JDBC 等标准接口，上层应用可以方便地连接访问Spark, Presto, Flink 等底层引擎,同时实现跨引擎上下文共享、统一的计算任务和引擎治理与编排能力

Implementing best practices for PySpark ETL jobs and applications.

#计算机科学#Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, a...

A curated list of awesome Apache Spark packages and resources.

#计算机科学#Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

#计算机科学#🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

SQL data analysis & visualization projects using MySQL, PostgreSQL, SQLite, Tableau, Apache Spark and pySpark.

Jupyter magics and kernels for working with remote Spark clusters

#计算机科学#Hopsworks - Data-Intensive AI platform with a Feature Store

PySpark-Tutorial provides basic algorithms using PySpark

Lightweight and extensible compatibility layer between dataframe libraries!

#计算机科学# MapReduce, Spark, Java, and Scala for Data Algorithms Book

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

#计算机科学#Sparkling Water provides H2O functionality inside Spark cluster

#编辑器#Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.

pyspark🍒🥭 is delicious，just eat it!😋😋

LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.