跳至正文
OpenAgentSkill
浏览已开放 · 目录记录日期 2026-11-21 · 自动更新和账户服务暂时关闭。
视频与音频

genai-vision

Integrating Stable Diffusion for vision generation and Whisper for audio/multimodal tasks.

j4flmao · 已有静态检查记录

安装与使用

运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。

npx skills add j4flmao/agent-skills --skill genai-vision

技能说明


name: genai-vision description: Integrating Stable Diffusion for vision generation and Whisper for audio/multimodal tasks.

GenAI Vision & Multimodal

Integration Strategy

  • Stable Diffusion: Use Diffusers library for image generation. Optimize with xformers.
  • Whisper: Process audio locally or via API for high-accuracy transcription to complement visual tasks.

Multimodal Workflow

%%{init: {"theme": "default", "flowchart": {"useMaxWidth": true}}}%%
graph TD
    A[User Audio] --> B(Whisper)
    B -->|Text Prompt| C[Stable Diffusion]
    C --> D[Generated Image]

Stable Diffusion Snippet

import torch
from diffusers import StableDiffusionPipeline

def generate_image(prompt: str, output_path: str):
    pipe = StableDiffusionPipeline.from_pretrained(
        "runwayml/stable-diffusion-v1-5", 
        torch_dtype=torch.float16
    ).to("cuda")
    pipe.enable_xformers_memory_efficient_attention()
    
    image = pipe(prompt, num_inference_steps=30).images[0]
    image.save(output_path)