Natasha alternatives for AI agents.

text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。

Fast State-of-the-Art Static Embeddings

Bringing BERT into modernity via both architecture changes and scaling

Retrieval and Retrieval-augmented LLMs

Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Persian NLP Toolkit

100+ Chinese Word Vectors 上百种预训练中文词向量

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

Implementation of the node2vec algorithm.

unified embedding model

VectorFlow is a high volume vector embedding pipeline that ingests raw data, transforms it into vectors and writes it to a vector DB of your choice.

Nomic Developer API SDK

Classify Kaggle San Francisco Crime Description into 39 classes. Build the model with CNN, RNN (GRU and LSTM) and Word Embeddings on Tensorflow.

A tool for learning vector representations of words and entities from Wikipedia

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.