Reading 04 of 8

How to Get Useful Answers (and Know When Not to Trust Them)

Good prompting is mostly good briefing: state the goal, provide the right evidence, define the output, and specify how the result will be checked.

A model cannot infer every unstated constraint. Treat a prompt like a brief to a capable colleague who lacks your local context: explain the objective, audience, source material, boundaries, and desired result.

Start with the job. “Summarize this” is ambiguous; “Give a five-bullet risk summary for a non-technical board, using only the attached report, and quote the page number for each figure” defines both audience and evidence. The extra words are not magic incantations. They remove decisions the model would otherwise guess.

Examples help when quality is hard to describe. One good input-output pair can show tone, granularity, labels, or edge-case treatment. This is in-context learning: the model adapts its response from material in the current context without changing its trained weights.

For factual work, prioritize grounding over rhetorical confidence. Give the model the primary document or require search with links. Ask it to distinguish quoted facts, calculations, and interpretation. Tell it to say “not found in the supplied sources” instead of filling gaps.

Structured outputs can help downstream software. Request JSON or a table only when the schema is defined and validated. A response that looks like valid JSON can still contain the wrong type, omit a required field, or invent a value. Machine-readable is not the same as correct.

The highest-value instruction is often not “be smarter.” It is “show me what evidence supports each important claim.”

Break large work into reviewable stages. First ask for an outline or extraction; inspect it; then ask for synthesis. For code, ask the agent to inspect relevant files and run the actual project checks. For research, ask for a source table before conclusions. Intermediate artifacts expose misunderstandings earlier.

Know what prompting cannot fix. A polished instruction cannot supply facts missing from the context, make an untrusted source authoritative, grant a tool the right permissions, or guarantee that a long agent run stays on course. Those require retrieval, tools, access controls, tests, and human review.

Protect sensitive material too. Before pasting personal, customer, legal, or proprietary data, understand where the product sends it, how long it stores it, whether administrators can access it, and whether it may be used for training. “AI assistant” is not a privacy policy.

Finally, match verification to stakes. Brainstorming names needs little checking. Medical, legal, financial, security, and production decisions require primary sources or qualified review. The goal is not to distrust every output; it is to avoid confusing convenience with evidence.