How Reasoning Model works in practice
Standard language models emit their answer token by token in a single forward pass, spending roughly the same amount of compute whether asked for the capital of France or asked to debug a race condition across four microservices. Reasoning models, such as OpenAI's o-series and GPT-5 reasoning modes, Anthropic's extended thinking models, and DeepSeek-R1, introduce a second scaling axis: test-time compute.
These models are post-trained using Reinforcement Learning with Verifiable Rewards (RLVR) against millions of problems with objective ground truth, such as unit-tested software patches, formal logic puzzles, and mathematical proofs. During training, the model learns to decompose problems into sub-goals, test hypotheses, spot dead ends, backtrack, and verify constraints inside hidden or inspectable 'thinking' tokens before emitting the visible response. Developers can typically configure a reasoning effort parameter (`low`, `medium`, `high`) or a thinking-token budget per API call.
For example, a Cambridge biotech firm uses a reasoning model to audit Python bioinformatics pipelines and design multi-step SQL cohort queries across clinical trial tables, where a single logical slip in an outer join would invalidate a study cohort.
Why it matters and trade-offs
Reasoning models solve tasks where first-instinct pattern matching fails: complex tax or regulatory reconciliation, multi-file refactoring, security vulnerability analysis, and orchestrator planning in agentic workflows. On hard coding and scientific benchmarks, test-time thinking regularly beats a tenfold larger standard model.
The trade-offs are latency, token cost, and overthinking on simple tasks. Because reasoning tokens are billed as output tokens and generated sequentially, a single query can take ten to forty seconds and cost five to ten times more than a non-reasoning completion. Production systems should use model routing: send fast chat, classification, and simple RAG synthesis to low-latency models, and escalate only ambiguous planning or verification steps to a reasoning model.