AI Agent Skills

Apache DataFusion Ballista Distributed Query Engine

Distributed private networking

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further e…

:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis

Vald. A Highly Scalable Distributed Vector Search Engine

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Down…

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.

A lightweight, high-performance go mqtt server(v3.0|v3.1.1|v5.0) supporting distributed cluster

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM…

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Web Scraping Framework

Mysterium Network Node - official implementation of distributed VPN network (dVPN) protocol

A cloud-native open source distributed time series database with high performance, high compression ratio and high availability.

CNCF sandbox project, an open source distributed time-series database with high concurrency, high performance, and high scalability

Simple web scraping for R