LLMs reward expertise

gist

Sean Goedecke argues that LLMs amplify domain expertise rather than flatten it. Experts can recognize promising fragments, detect strange answers, propose better formulations, and steer a model using concrete knowledge of the problem and codebase. Prompting tricks cannot reproduce that judgment. Stronger models therefore make broad capability more accessible while leaving human understanding as the constraint on specifying and evaluating the result.

ideas

• Expertise selects from model possibilities. A knowledgeable user can identify the useful part of an answer, reject wrong turns, and suggest approaches the model did not choose.
• Prompting style is a consequence, not a recipe. Short questions and firm steering work because the expert understands what matters, not because brevity itself unlocks better answers.
• Concrete familiarity beats generic principles. Codebase knowledge supports specific questions and simpler designs that broad system-design advice cannot supply on its own.
• General access and expert leverage coexist. LLMs help novices produce acceptable work while letting experts extract substantially more value from the same model.
• Human understanding remains a constraint. For many tasks, specifying the desired solution and judging its quality are harder than generating a plausible response.

quotes