All Dataset engineering Listings
Loading
...
Loading
...
Loading
...
Loading
...
Loading
...
Loading
...
Internal link to /explore/datasketch
datasketch
MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW
Internal link to /explore/data-juicer
data-juicer
Making data higher-quality, juicier, and more digestible for foundation models! ๐ ๐ ๐ฝ โก๏ธ โก๏ธ๐ธ ๐น ๐ทไธบๅคงๆจกๅๆไพๆด้ซ่ดจ้ใๆดไธฐๅฏใๆดๆโๆถๅโ็ๆฐๆฎ๏ผ
Internal link to /explore/datatrove
datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
Internal link to /explore/gpt-crawler
gpt-crawler
Crawl a site to generate knowledge files to create your own custom GPT from a URL
Internal link to /explore/textattack
TextAttack
TextAttack ๐ is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/
Internal link to /explore/prm800k
prm800k
800,000 step-level correctness labels on LLM solutions to MATH problems
Internal link to /explore/tiktoken
tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Internal link to /explore/snorkel
snorkel
A system for quickly generating training data with weak supervision
Listings per page
Showing1 - 10of10listings
Page 1 of 1