github Not archived

togethercomputer/RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

1 awesome list

Quick read

Stars
5,000
Forks
371
Open issues
43
Commits
46

Activity and growth

Latest capture 2026-11-09 09:54

Stars · last 7 days
0 0.0%
Commits · last 7 days
0 0.0%
Stars since tracking
0
Stored snapshots
1

Compare the starting count and capture dates, not just the percentage. How to read GitHub star growth. Missing history is not zero growth.

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-04-14
First commit
2023-04-17
Last pushed
2026-06-03
GitHub updated
2026-11-08
Last synced
2026-11-09 09:54
Stack scanned
2026-11-09 09:54
Archived
No

Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

1 observed capture since 2026-11-09. Observed captures are shown by default.

Stars from first capture 0

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

Zjh-819/LLMDataHub

A quick guide (especially) for trending instruction finetuning datasets

3,420 stars
2 awesome lists

tirth8205/code-review-graph

Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.

32,651 stars
Python 4 awesome lists

Ramaseshanr/anlp

Contains demo codes for the course Applied Natural Language Processing

42 stars
Jupyter Notebook 1 awesome list

OpenDCAI/DataFlow

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

8,209 stars
Python 3 awesome lists

niderhoff/nlp-datasets

Alphabetical list of free/public domain datasets with text data for use in Natural Language Processing (NLP)

6,012 stars
1 awesome list

adobe/NLP-Cube

Natural Language Processing Pipeline - Sentence Splitting, Tokenization, Lemmatization, Part-of-speech Tagging and Dependency Parsing

564 stars
HTML 1 awesome list