Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.
Directorio de skills
Descubre skills reutilizables para AI agents.
Cada recomendación conserva un vínculo claro con su repositorio, auditoría y ruta de instalación.
Resultados de búsqueda: pyspark
Directorio en inglésSQL data analysis & visualization projects using MySQL, PostgreSQL, SQLite, Tableau, Apache Spark and pySpark.
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
End-to-end Data Lakehouse project built on Databricks, following the Medallion Architecture (Bronze, Silver, Gold). Covers real-world data engineering and analytics workflows using Spark, PySpark, SQL, Delta Lake, and Unity Catalog. Designed for learning, portfolio building, and job interviews.
Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.
Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake
Notes on Apache Spark (pyspark)
Code repository for the "PySpark in Action" book