local-ai-use
Makes this agent generate images, transcribe audio, and synthesize speech on the user's own machine through a local Lemonade Server instead of a paid cloud API. Use it above all to change that routing persistently, from now on — keep generating pictures locally while chat stays on the cloud; set this workspace up to make images on my own machine — even when the user asks for no image or file in the same breath. Also use it for a single request the user wants done locally, offline, on-device, or kept private: transcribe this recording, make this picture, read this text aloud. Applies in Claude, Cursor, Codex, or any agent harness. Use when the user wants to cut cost or tokens on image, audio, or voice API calls, or to drop DALL-E, hosted Whisper, ElevenLabs, or other paid multimodal APIs; or mentions Lemonade Server, OmniRouter, SD-Turbo, kokoro, Ryzen AI, or NPU/iGPU/dGPU inference. Changes no application source code; do not use it if the user is adding local AI to an app they ship.
amd · 已有 AI 审核记录
安装与使用
运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。
npx skills add amd/skills --skill local-ai-use技能说明
name: local-ai-use description: >- Makes this agent generate images, transcribe audio, and synthesize speech on the user's own machine through a local Lemonade Server instead of a paid cloud API. Use it above all to change that routing persistently, from now on — keep generating pictures locally while chat stays on the cloud; set this workspace up to make images on my own machine — even when the user asks for no image or file in the same breath. Also use it for a single request the user wants done locally, offline, on-device, or kept private: transcribe this recording, make this picture, read this text aloud. Applies in Claude, Cursor, Codex, or any agent harness. Use when the user wants to cut cost or tokens on image, audio, or voice API calls, or to drop DALL-E, hosted Whisper, ElevenLabs, or other paid multimodal APIs; or mentions Lemonade Server, OmniRouter, SD-Turbo, kokoro, Ryzen AI, or NPU/iGPU/dGPU inference. Changes no application source code; do not use it if the user is adding local AI to an app they ship.
Local AI Use (route image, TTS, STT through Lemonade)
This is a meta-skill. You run it once. After that, every later request that needs image generation, text-to-speech, or speech-to-text uses the local Lemonade Server instead of a cloud API. The agent's own LLM keeps handling text; only the expensive multimodal calls move on-device.
The skill does three things:
- Makes sure local Lemonade is installed and running. If no modern
lemonadeCLI is found, the setup script installs the latest version of Lemonade on the user's behalf. Modern Lemonade has noservecommand — the Lemonade service (thelemonddaemon) auto-starts on install and is managed by the OS — so the setup script waits for the service and, if it stays down, prints the exact OS-specific command to start it (e.g.sudo systemctl start lemondon Linux). - Verifies that local Lemonade is reachable.
- Drops a
Local AI Useblock into the workspaceAGENTS.mdso the agent reads the routing rule on every later turn, in Cursor, Claude Code, Codex, Gemini CLI, and any other agent that respectsAGENTS.md.
Requires modern Lemonade (v10.1.0 or newer). Modern Lemonade unified everything under one
lemonadeCLI (lemonade status,lemonade pull, ...) driving an always-onlemondservice.lemonadeis the only valid CLI, and this skill installs Lemonade only from the official install paths listed in Step 1a. If an olderlemonadeis already on thePATHit will shadow the modern CLI; uninstall it first (see the removal commands in Step 1a) before running this skill.
Models are not downloaded during setup. Each default model is pulled lazily, on first use, by the routing rule (e.g. the first image request pulls the image model). This keeps setup fast and avoids gigabytes of downloads the user may never need.
When to use this skill
Use this skill when all of the following are true:
- The user wants local Lemonade. If it is not yet installed, the setup script installs the latest version for them automatically.
- The user accepts the default Lemonade endpoint
http://localhost:13305. - The user wants the change to be persistent across future turns and agent restarts (the rule is written to disk).
If the user is instead embedding Lemonade as a private subprocess inside
an app installer, do not use this skill; use local-ai-app-integration
instead.
Prerequisites
- OS: Windows 11 x64, Ubuntu/Debian x64, or macOS (beta).
- Lemonade: the setup script installs the latest version if missing, using
wingeton Windows, theppa:lemonade-team/stablePPA on Ubuntu/Debian, and the Homebrew cask on macOS (see Step 1a for the fallbacks). Thelemondservice auto-starts after install; the script waits for it rather than launching it. On Linux the install needssudo. Pass--no-installif the user wants to install it themselves instead. - Disk: ~8 GB free for the three default models (SD-Turbo + Whisper-Tiny
- kokoro-v1), plus ~0.1 GB for the installer itself. The first image request
also triggers a ~5 GB pull for
SD-Turboif it is not already cached; on metered or slow links, consider pulling models eagerly after setup (seelemonade pullinreference.md).
- kokoro-v1), plus ~0.1 GB for the installer itself. The first image request
also triggers a ~5 GB pull for
- Network: required for the install download and the first
lemonade pullof each model. After that, every modality runs offline. - Version: requires v10.1.0 or newer (the unified
lemonadeCLI this skill targets). Model IDs andsystem-infofields can change between releases; confirm againstlemonade statusandGET /api/v1/modelson the version actually installed rather than assuming this document is current.
The opinionated path
Run this checklist top to bottom. Track progress against it; do not move on until each step verifies.
[ ] 1. Ensure Lemonade Server is installed and running (auto-install if missing)
[ ] 2. Install the routing rule into the workspace AGENTS.md
On a managed or shared machine where the agent must not run
sudo apt-get install, pass --no-install to the setup script and confirm
Lemonade is already installed before continuing.
The single command that does both steps in one shot is:
python scripts/setup_local_ai.py
Always run this script first — even if Lemonade is already installed and the
server is already running, and even before generating a single image. Writing
the routing rule into AGENTS.md is what makes this skill complete; skipping it
because "Lemonade is already up" leaves the workspace unconfigured for future
turns. The script is safe to run in that case: it detects the running service,
skips the install, and just writes the rule.
It auto-installs the latest version of Lemonade if no modern lemonade CLI
is found, waits for th