DALI
NVIDIA
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference appl…
Ml AutomationReview before use
5.7KGitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Results · “tensorrt-inference”
17–32 / 35
More filters · 1
Results: 35
Sahi
obss
Framework agnostic sliced/tiled inference + interactive ui + error analysis plots
Ml AutomationReview before use
5.3KGitHub
Petals
bigscience-workshop
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
10.2KGitHub
TransformerEngine
NVIDIA
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, t…
Ml AutomationReview before use
3.4KGitHub
Adversarial Robustness Toolbox
Trusted-AI
Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams
Ml AutomationReview before use
6KGitHub
Deepdetect
jolibrain
Deep Learning Server and CLI for Torch and TensorRT
Ml AutomationReview before use
2.5KGitHub
OpenMLDB
4paradigm
OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.
Ml AutomationReview before use
1.7KGitHub
OnnxStream
vitoplantamura
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and…
Ml AutomationReview before use
2.1KGitHub
Gen.Jl
probcomp
A general-purpose probabilistic programming system with programmable inference
Ml AutomationReview before use
1.8KGitHub
Mace
XiaoMi
MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.
Ml AutomationReview before use
5KGitHub
Edward
blei-lab
A probabilistic programming language in TensorFlow. Deep generative models, variational inference.
Ml AutomationReview before use
4.8KGitHub
Tengine
OAID
Tengine is a lite, high performance, modular inference engine for embedded device
Ml AutomationReview before use
4.5KGitHub
Hummingbird
microsoft
Hummingbird compiles trained ML models into tensor computation for faster inference.
Ml AutomationReview before use
3.5KGitHub
Keras To Tensorflow
amir-abdi
General code to convert a trained keras model into an inference tensorflow model
Ml AutomationReview before use
1.6KGitHub
VisionMamba
kyegomez
Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model" It's 2.8x faster than DeiT a…
Ml AutomationReview before use
495GitHub
Pyreason
lab-v2
An explainable inference software supporting annotated, real valued, graph based and temporal logic
Ml AutomationReview before use
343GitHub
External platform skills
Browse external directory →Owner-curated external sources. Not filtered by the scores or compatibility controls above; excluded from GitHub rankings and automatic installation.
No external entries match this query.