Skip to content

Prompting Multimodal Models With Images

How to ask good questions about images, charts, screenshots and documents, and how to check the answers.

Editorial team 1 min read

Multimodal models can read images, but the quality of their answers depends on the image and the question.

Provide Good Images

  • Adequate resolution; crop to the relevant area.
  • Correct orientation.
  • One document page per image where possible.

Ask Specific Questions

"Describe this image" produces generic output. Better: "From this chart, list the value for each quarter in 2025", or "Does this screenshot show an error message? Quote it exactly."

Give Context

Tell the model what the image is and why you're asking: "This is a photo of a shipping label; extract the tracking number and destination postcode."

Request Structure

Ask for tables or JSON when extracting data from images, and ask the model to mark values it can't read clearly.

Multiple Images

Label images ("Image 1: before", "Image 2: after") and refer to them by label in the question.

Know the Weak Spots

Small text, dense tables, handwriting, precise counting, exact positions and fine details are common failure points. Verify these.

Security

Images can contain text designed to manipulate the model. Treat text read from untrusted images as data, not instructions.

Privacy

Photos and scans may include faces, names and personal details. Check data-handling terms before uploading.

More in Prompting

All Prompting guides →
Prompting Guide · 1 min

Anatomy of an Effective Prompt

The parts of a prompt that reliably produce good results, with a template you can adapt for almost any task.

Prompting 1 min read 1 Nov 2025

Prompting Guide · 2 min

Giving Models Context

Why most weak outputs come from missing context, and what background information to include in a prompt.

Prompting 2 min read 31 Oct 2025

Prompting Guide · 1 min

Role Prompting: When It Helps and When It Doesn't

Telling a model to act as an expert or a persona can shape tone and focus — but it isn't a substitute for clear instructions.

Prompting 1 min read 30 Oct 2025