A framework for efficient model inference with omni-modality models

Community maintained hardware plugin for vLLM on Ascend

🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

A reusable skill for Claude Code that adds multimodal vision capabilities for analyzing screenshots, UI, and charts using various models.

Use with the dstack skill for model-serving work when the image, serving command, resources, backend/fleet choice, or service behavior is not proven. Guides task-first prototyping on real hardware, choosing fleets/backends that can reuse idle instances and caches, checking vLLM/SGLang sources, and verifying the final dstack service with a model request.

7 ücretsiz modelin en iyi yeteneklerini tek çatı altında toplayan akıllı coding agent'ı

A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.

A tiny single-file coding agent for self-hosted models (llama.cpp / vLLM / SGLang).

A reusable AI agent skill that converts text-based system architecture descriptions into editable native PowerPoint diagrams for Claude Code, Codex, and similar coding agents.

Obsidian plugin for AI chat, workflow automation, and semantic search — supports Gemini, OpenAI, OpenRouter, Grok, Ollama, and CLI backends

An open-source educational chat model from ICALK, East China Normal University. 开源中英教育对话大模型。(通用基座模型，GPU部署，数据清理) 致敬: LLaMA, MOSS, BELLE, Ziya, vLLM

The AI-native JupyterLab — open-source Cursor for notebooks. Cmd+K inline edit, multi-step agent with cell-level tools (read/edit/run), chat with @cell/@file context, ghost-text completion, one-click traceback fix. BYO model: Anthropic, OpenAI, Gemini, Ollama, vLLM. Local-first, privacy-first, fully open source.