AI Agent Skills

A modular active learning framework for Python

SDK libraries for Modal

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.

A voice chat app

Write precise Seedance 2.0 prompts for multimodal video, camera movement, editing, music, and product storytelling.

Multi-modal OCR pipeline optimized for ML training (text, figure, math, tables, diagrams)

An Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

FarmVibes.AI: Multi-Modal GeoSpatial ML Models for Agriculture and Sustainability

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

[CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation

Superfast AI decision making and intelligent processing of multi-modal data.

A multi-modal vector database that supports upserts and vector queries using unified SQL (MySQL-Compatible) on structured and unstructured data, while meeting the requir…

SALMONN family: A suite of advanced multi-modal LLMs

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and…