Hazm alternatives for AI agents.

text2vec, text to vector. 文本向量表征工具，把文本转化为向量矩阵，实现了Word2Vec、RankBM25、Sentence-BERT、CoSENT等文本表征、文本相似度计算模型，开箱即用。

Pre-trained subword embeddings in 275 languages, based on Byte-Pair Encoding (BPE)

Fast State-of-the-Art Static Embeddings

Solves basic Russian NLP tasks, API for lower level Natasha projects

Bringing BERT into modernity via both architecture changes and scaling

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

Retrieval and Retrieval-augmented LLMs

A tool for learning vector representations of words and entities from Wikipedia

WikiChat is an improved RAG. It stops the hallucination of large language models by retrieving data from a corpus.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

The collection of pre-trained, state-of-the-art AI models for ailia SDK

Data augmentation for NLP, presented at EMNLP 2019

100+ Chinese Word Vectors 上百种预训练中文词向量

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing