All Dataset engineering Listings
Loading
...
Loading
...
Loading
...
Loading
...
Loading
...
Loading
...
datasketch
MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW
tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
data-juicer
Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！
snorkel
A system for quickly generating training data with weak supervision
TextAttack
TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
gpt-crawler
Crawl a site to generate knowledge files to create your own custom GPT from a URL
prm800k
800,000 step-level correctness labels on LLM solutions to MATH problems
datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
Transformer Lab
The open-source platform for training advanced AI models and image diffusion.
Listings per page
Showing1 - 11of11listings
Page 1 of 1