AI Agent Skills

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching.…

A Pytorch Implementation of "Neural Speech Synthesis with Transformer Network"

Post-process Amazon Textract results with Hugging Face transformer models for document understanding

A collection of tricks and tools to speed up transformer models

A Non-Autoregressive Transformer based Text-to-Speech, supporting a family of SOTA transformers with supervised and unsupervised duration modelings. This project grows w…

Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)

Triggered when the user needs to convert data formats, such as CSV to JSON, JSON to YAML, or XML to JSON. Automatically performs the conversion and verifies the output f…

Reformer, the efficient Transformer, in Pytorch

[ICLR2025] Kolmogorov-Arnold Transformer

[CVPR 2023] Official code release of our paper "BiFormer: Vision Transformer with Bi-Level Routing Attention"

Latency and Memory Analysis of Transformer Models for Training and Inference

This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc

快速上手AI理论及应用实战：基础知识、Transformer、NLP、ML、DL、竞赛。含大量注释及数据集，力求每一位能看懂并复现。

BertViz: Visualize Attention in Transformer Models

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification