AI Agent Skills

TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache Geb: Very Groovy Browser Automation

A scalable, mature and versatile web crawler based on Apache Storm

Flink CDC is a streaming data integration tool

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks…

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask,…

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumP…

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀