hraness

saved

Fences, not Sandboxes

by Steve Yeggeyegge.aipublished

gist

Steve Yegge reports that a 50-agent Fable cluster building Wyvern grew Wheelhouse into a constitutional legal system: offices, case law, and enforcement patterns such as fences. He argues that once Fable-tier models are cheap, companies will need bespoke rule-of-law for amnesiac interchangeable agents rather than sandboxes that contain weaker models. A fence is a polite policy refusal, not a wall against malice; the institutional knowledge it encodes has to grow around a domain and cannot be transplanted.

ideas

  • Govern agents by law, not containment. Capable models should be coordinated with written rules and enforcement machinery rather than sandboxes that ration context and scope.
  • Today's models still have grade-school judgment. Fable codes at a high level but still makes at least one terrible overnight decision; current sandboxing fits that maturity, not next year's cheaper Fable-tier workforce.
  • Wheelhouse became a legal system. Asking Fable to ship faster produced 450 legal artifacts, a constitution, case law, and roles that outlive interchangeable amnesiac agents.
  • A fence is a polite refusal. It turns the wrong actor away for missing paperwork or policy, like a Molly Guard; it is not a sandbox that can stop a determined superintelligence.
  • Institutional law has to grow in place. Capturing thousands of conflicting tribal decisions takes months to years, and the resulting ivy-like intelligence is unique to a domain.

quotes

It's a future where AIs are governed by laws, not by programs that try to contain and control them.

Steve Yegge, stating the essay's governing claim.

a fence is any mechanism that turns you away if you aren't supposed to be there.

Steve Yegge, defining the fence pattern his agents built.

Humanity has only one mature technology for coordinating mortal, replaceable strangers via text — namely, law.

Steve Yegge, explaining why amnesiac agents converge on a legal system.

You can't rip ivy off someone's wall and stick it on someone else's.

Steve Yegge, arguing that domain-grown intelligence is not transplantable.