Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Direktori skill
Temukan skill yang dapat digunakan kembali untuk AI agents.
Setiap rekomendasi tetap terhubung dengan repositori, audit, dan jalur pemasangannya.
Hasil pencarian: inference
Direktori bahasa InggrisTurn any computer or edge device into a command center for your computer vision projects.
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
Run agents like Hermes and OpenClaw more securely inside NVIDIA OpenShell with managed inference
Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, K8s, AI inference, and IAM services.
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.