The design problem is not to make people virtuous, but to make self-interest and impartial knowledge point in the same direction. Good institutions do this by separating power from stakes, making ignorance costly, and ensuring that those who bear a decision’s consequences can contest it.
Separate judgment from interest
The first principle is structural: no person or body should both benefit from a decision and control the evidence used to justify it. This is the institutional answer to Miles’s Law—the well-documented tendency for institutional position to shape attitudes and judgments.scholar.law.colorado+1
Practical mechanisms include:
Mandatory recusal: anyone with a financial, familial, professional, or ideological stake in a decision is excluded from deliberation and voting.
Independent decision-makers: regulators, auditors, ethics boards, and courts should be appointed through processes insulated from the entities they oversee.
Divestment and cooling-off periods: officials must sell relevant assets or wait before moving between regulator and regulated industry, reducing the “revolving door” incentive.
Blind procedures: allocate contracts, grants, or cases through anonymised review where feasible, so the reviewer cannot know whose “bread” is being buttered.
The OECD treats disclosure, recusal, divestment and reassignment as core tools for preventing private interests from contaminating public duty.legalinstruments.oecd
Make ignorance expensive
If people can plausibly say “we did not know,” they will often arrange not to know. Research on organisational wilful ignorance shows that actors may avoid collecting or using information precisely because it would demand action, threaten routines, or expose responsibility.pmc.ncbi.nlm.nih
Institutions should therefore reverse that incentive:
Duty to inquire: decision-makers must actively investigate foreseeable risks, not merely avoid explicit knowledge. Legally, wilful blindness can already be treated as culpable where a person suspects a material fact but deliberately avoids confirming it.journals.sagepub
Presumption of knowledge: where information was reasonably available and materially relevant, treat failure to obtain it as negligence or misconduct.
Audit trails: require documented evidence that alternatives, risks, and affected parties were considered.
Penalties for strategic blindness: fines, dismissal, disqualification from office, and personal liability for executives who suppress or ignore red flags.
This shifts the calculus: ignorance stops being a free moral loophole and becomes an expensive institutional risk.
Make knowledge public and contestable
Transparency alone is weak—disclosure can become a ritual that legitimises a conflict without removing it. WHO guidance explicitly notes that disclosure by itself does not prevent biased action; it must be paired with verification, independent review, and enforcement.iris.who
A stronger architecture includes:
Open registers of interests: publish decision-makers’ financial ties, gifts, employment history, and lobbying contacts.
Reasoned decisions: require public, written justifications that cite evidence and explain why alternatives were rejected.
Adversarial review: give affected parties, civil-society groups, journalists, and independent experts formal rights to challenge evidence and decisions.
Protected whistleblowing: create confidential reporting channels with anti-retaliation protections; organisational climate and whistleblower protection materially affect whether concerns are raised.iris.who
Sunset and review clauses: automatically re-examine high-stakes decisions after a fixed period, so initial self-serving framings do not harden into precedent.
Align incentives with the common good
People apply knowledge fairly more reliably when fairness is rewarded and partiality is penalised. This means redesigning rewards, not merely issuing ethical exhortations.
| Institutional lever | What it changes | Example |
|---|---|---|
| Outcome-based pay | Rewards results for the people served, not volume or loyalty | Pay clinicians or officials for health outcomes rather than procedures alone ijhpm |
| Rotation and cross-appointment | Reduces entrenched “us versus them” perspectives | Rotate staff across departments, regions, or regulatory functions |
| Independent boards | Dilutes factional control | Require minority representation from affected communities or independent experts |
| Reputation sanctions | Makes bias publicly costly | Publish conflict-of-interest breaches and decisions overturned for partiality |
| Collective liability | Makes organisations internalise harms | Fines, contract bans, or clawbacks tied to foreseeable harm |
In health governance, for instance, reforms that align provider incentives with population health, clarify public-private boundaries, and strengthen independent oversight are proposed precisely because fee-for-service and dual-practice arrangements can embed conflicts into policy itself.ijhpm
Design for “moral knowledge”
Your Deutschian framing suggests a further requirement: institutions must make moral knowledge actionable. It is insufficient to know that others are being treated as instruments; the institution must create a route by which that recognition becomes a decision.
That implies:
Standing for the affected: workers, consumers, future generations, or nonhuman interests should have procedural representation, not merely rhetorical acknowledgment.
Precautionary defaults: when harm is serious and knowledge is incomplete, place the burden of proof on those proposing the risky action.
Counterfactual tests: before approval, ask: “Would we accept this rule if we occupied the weakest position it creates?”
Institutional empathy: structured exposure to affected parties—testimony, site visits, participatory panels—can interrupt the abstraction through which distant suffering becomes easy to ignore.
The hard limit
No design eliminates partiality. People will still interpret ambiguous evidence in self-serving ways, and powerful actors will seek to capture oversight bodies. The realistic aim is therefore not purity but asymmetry: make it harder to benefit from bias than to comply with fair procedure.
The most robust systems combine all four elements: independent judgment, costly ignorance, public contestability, and aligned incentives. A system with transparency but no enforcement becomes theatre; one with enforcement but no independence becomes weaponised; one with independence but no public scrutiny becomes a new elite. Fairness survives only where these checks constrain one another.
perplexity
No comments:
Post a Comment