Analysis on Prompt + Document Type Compatibility

There are six prompt variants documented in the official codebase, and I've done some analysis on which prompt works best on which type of document.

Some findings:


1. Document `\n<|grounding|>Convert the document to markdown.` is the best generalist prompt over `\nFree OCR.`
2. General `\nDescribe this image in detail.` is the most reliable prompt, though it doesn't usually give you word for word output.
3. Rec `\nLocate <|ref|>{OBJECT}<|/ref|> in the image.` is effective with photos, but not documents.

You can view the full dataset, including exact model outputs, in an interactive web app here: https://deepseek-ocr-v2-demo.vercel.app

Curious to hear everyone's experiences on getting this model to perform well!