GO TO A SECTION

↑ ↓ to navigate · Enter to openExplore all sections →
FDEInterviews logo
arXiv preprint

DeepSeek-OCR: Contexts Optical Compression

Can a page image replace a much longer text prefix? DeepSeek-OCR explores optical compression, with useful OCR results and important limits for agent memory.

Breakdown by FDE Interviews · 10 min read · Updated

About the original · 2025
AUTHORS
Wei, Sun, Li
FROM
DeepSeek-AI
PUBLISHED
Oct 2025 · arXiv preprint
IN THIS BREAKDOWN · 10 SECTIONS

You can read 16% of this breakdown.

01

The paper in one minute

DeepSeek-OCR asks whether an image can carry text through a language model using fewer input tokens than the text itself. Its encoder processes a page at useful visual resolution, compresses the spatial representation and passes a relatively short sequence to a text decoder. OCR reconstruction provides a concrete way to measure how much information survives.

The architecture combines a visual encoder called DeepEncoder with a three-billion-parameter mixture-of-experts decoder. Several native resolutions and tiled modes let the system trade visual-token count against document detail. Small input sequences can work well on readable pages, while heavier compression loses information.

The report's most ambitious motivation is long-context compression: render text visually, then use fewer visual tokens to represent it. The experiments establish an OCR proof of concept. They do not establish that an agent can reliably reason over a compressed conversation history, preserve every constraint or recover every critical detail.

This breakdown reviews the October 2025 report and its official code and model resources. The practical contribution is a document-processing option worth evaluating, together with an unusually clear reminder that reconstruction quality must be measured at the level the application cares about.

THE IDEA, VISUALLY
COMPRESSION HAS A RECONSTRUCTION COST Reported Fox English OCR results, Table 2. Each point summarizes a text-length bin. 50 60 70 80 90 100 5 10 15 20 OCR precision (%) Text tokens / vision tokens 100 vision tokens 64 vision tokens Highest compression: 19.7× at 59.1% Only 4 pages in bin. This is OCR reconstruction, not a demonstrated long-history reasoning or memory benchmark.
Reported Table 2 results show a compression-quality tradeoff on 100 selected English pages. The highest-compression point represents only four pages; it is not a universal reconstruction guarantee.
Research notes: the problem, approach and results
64–400

native-mode vision tokens, Table 1

98.5%

100-token OCR precision, 600–700 text-token bin, Table 2

59.1%

64-token precision at 19.7× compression, four-page bin, Table 2

THE PROBLEM

Document images contain substantial text, but high-resolution visual encodings can create expensive input sequences.

THE IDEA

Combine local visual encoding, spatial downsampling and global attention before decoding text from a compact visual representation.

THE RESULT

The model demonstrates useful OCR at small visual-token budgets; reliable compressed agent memory remains a separate research question.

02

Why it matters to an FDE

Enterprise documents contain layout, tables, small print and scanned text. A pipeline that extracts them poorly can damage retrieval before an answer model sees anything. Better visual processing can therefore improve an entire assistant, but only if the extracted content remains faithful to its source.

A compact visual representation also changes the serving calculation. Fewer input positions may reduce work in parts of the decoder, yet image encoding and output generation still cost time and memory. Measure the full request instead of converting a token ratio directly into a speedup claim.

Use multimodal model evaluation to compare the available modes on actual document types. Pair that with structured-output validation for dates, identifiers and amounts. A nearly perfect transcript can still contain the one incorrect digit that makes a downstream action unacceptable.

THE FULL BREAKDOWN

Understand the mechanism. Try it on a real problem.

Unlock this breakdown and 199 more papers.

Premium opens every paper in full, plus every answer, concept, course and guide on the site. One payment for six months of access.

6 months · One payment · No auto-renewal

Get Premium · ₹2,000 / $25
  • ◇1 architecture diagram
  • </>2 runnable code blocks
  • ▦3 results tables
  1. 03Key takeaways

    Six distinctions that make optical compression results useful for deployment decisions

    Free account
  2. 04How it works

    Follow local image processing, spatial compression and global encoding into the decoder

    Premium
  3. 05The numbers that matter

    Keep token counts, OCR quality and evaluation populations attached to each result

    Premium
  4. 06Try it yourself

    Calculate visual-token counts and catch a critical error hidden by high character agreement

    Premium
  5. 07Where it breaks

    Recognize information loss, benchmark scope and the limits of token-ratio arguments

    Premium
  6. 08Using it on a deployment

    Build a mode-selection and acceptance experiment around the customer's actual documents

    Premium
  7. 09Interview angles

    Explain why compact visual context still needs a precise acceptance contract

    Premium
Back to the paper library →