one year on
DeepSeek open-sources OCR model that compresses text into images for cheaper long-context LLMs
The Chinese startup releases DeepSeek-OCR, which uses visual encoders to squeeze text contexts up to 20x, claiming a path to dramatic memory savings for large language models.
Originally published Published on this site
DeepSeek has released DeepSeek-OCR, an open-source multimodal model that compresses text by rendering it as images, on GitHub and Hugging Face. The model pairs a vision encoder with a 3B-parameter mixture-of-experts decoder (570M active) and, according to the accompanying paper, achieves 97% OCR precision when the ratio of text tokens to vision tokens is under 10x. At a 20x compression ratio, accuracy falls to about 60%. DeepSeek frames the work as an initial investigation into “contexts optical compression”—using 2D visual representations to shrink long contexts for large language models. The company says this could lead to significant token reduction, potentially lowering memory and compute costs for long-context tasks. On benchmarks, DeepSeek-OCR outperforms GOT-OCR2.0 with 100 vision tokens per page and surpasses MinerU2.0 using fewer than 800 vision tokens, versus MinerU2.0’s 6000+. In production, it can generate training data for LLMs and VLMs at over 200,000 pages per day on a single A100-40G GPU. The release continues DeepSeek’s push for efficiency and cost reduction in AI models.
The record
the paper's authors describe the work as an initial investigation into optical 2D mapping for long-context compression, noting that decoding precision holds at 97% under 10x compression and drops to about 60% at 20x.
in a blog post, the company says the model demonstrates 7–20x token reduction for different historical context stages, offering a promising direction for long-context challenges in LLMs.
One year later — open only if you can handle spoilers
The idea of storing long context as compressed images rather than text tokens drew wide interest from researchers, and DeepSeek followed up with DeepSeek-OCR 2 on January 27, 2026.
Filed
Compiled and edited by Adam Allcock.
The Weekly Replay · free by email
This week, one year ago — every Sunday.
One email each Sunday: the week's replayed AI news, with the one-year-later annotations included. Written like it's breaking — dated like it isn't.
Free · double opt-in · unsubscribe anytime · privacy