On matters of Preservation

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Markup, boundaries, and the notation of pre-training corpora. Research · 2026

The Missing Format Format reliability as an unrecorded pre-training variable, and the case for building what the corpora no longer contain. Research · 2026

Glaring Fireball Format Composition: a proposal to measure what pre-training pipelines discard. Research · 2026