Nathalie Smuha
Nathalie Smuha is Professor, jurist and philosopher (AI ethics & law) at KU Leuven / Oxford University. ## Background
The core conversation covers Smuha's book 'Algorithmic Rule by Law': when governments translate laws into code, arbitrary design choices (like counting a missed phone call as 'refusal to cooperate' in Indiana's welfare system) can undermine democratic intent and citizens' rights. She illustrates risks with the UK Post Office scandal, biased facial recognition, function creep of cameras in Antwerp's Jewish quarter, China's social credit system, and what happens if authoritarian parties inherit this digital infrastructure. On the EU AI Act, she argues it is a step forward but treats AI too much like a product-safety issue, relies on self-assessment for high-risk systems, and leaves gaps — it should be made smarter rather than simply looser. She closes by insisting humans must retain the role of deciding what is meaningful and valuable, never delegating value judgments to AI.
Insights & takeaways
Nathalie Smuha's central preoccupation is what happens when governments hand over the execution of law to algorithms, and she is unambiguous that this is never a neutral technical transfer. "Die vertaalslag van een wet naar code, dat is geen puur technisch iets, dat is eigenlijk iets dat politieke en normatieve implicaties heeft" 12. Her go-to illustration is Indiana, where "refusal to cooperate" with welfare authorities got coded as simply not answering the phone — an interpretation no legislator intended, but one baked permanently into a system now applied at scale 12. For Smuha this is the crux of the problem: coders end up making normative choices that were supposed to belong to democratically accountable lawmakers, and once made, those choices get executed uniformly and invisibly across an entire population.
Scale is her second recurring theme. Where a human bureaucrat's error affects one case, an algorithmic error affects everyone processed by that system, and she points to the UK Post Office accounting scandal as the sobering proof — a bug in the system that led to wrongful theft prosecutions, imprisonment, and suicides before anyone caught it 1. She's equally alert to feedback loops that manufacture their own confirmation: predictive policing sends officers to neighborhoods the algorithm flags, crime gets found there because that's where police are looking, and the algorithm appears validated while crime elsewhere goes unrecorded, locking the same communities into permanent suspicion 12. Function creep is the third recurring pattern — infrastructure justified for one purpose quietly migrates to another. Cameras installed to protect Antwerp's Jewish quarter after terrorist attacks were later used during COVID to check whether that same community was following lockdown rules 12, and Belgium's COVID pass was legalized in a way that lets the system return in a future crisis. Her warning here is pointed: "Er is eigenlijk geen limiet aan wat je kan doen in de naam van veiligheid en we moeten ons daar een beetje tegen verzetten" 12.
Smuha's framing for why this matters isn't abstract civil-liberties anxiety but a structural argument about the rule of law itself. Laws are supposed to be contestable, revisable, and applied through processes that allow for judgment and correction; she worries that algorithmic administration converts law into "algorithmic rule by law" — a technically enforced version of law that becomes rigid, opaque, and resistant to the political correction that ordinary law allows for. Crucially, she insists this isn't a bet you make on the current government's good intentions: "Denk niet aan de overheid die we vandaag hebben, denk aan volgende verkiezingen en uw nachtmerrie politieke partij wordt verkozen" 12. The infrastructure and the powers you build now are inherited by whoever comes next, and "wat vandaag legaal is kan morgen illegaal worden gemaakt door een andere overheid" 12 — meaning safeguards need to be built for the worst plausible future government, not the current one.
Underneath these institutional arguments sits a philosophical line she returns to explicitly: some judgments are not the kind of thing that should be delegated to a machine at all. "Die waardeoordelen is iets dat we niet mogen of kunnen delegeren aan AI-systemen... zelf uitmaken wat voor ons een waardevol leven is" 12. This is her check on techno-solutionism — not every decision that can be automated should be, because some decisions constitute the very autonomy that law and democracy are meant to protect.
On the EU AI Act, her position has a clear structure: necessary but insufficient, and mis-designed in a specific way. She names the flaw precisely — the Act relies on self-assessment, so even high-risk systems like welfare-decision algorithms or predictive policing get evaluated by the deploying organization itself, with independent scrutiny only arriving after complaints, "potentially three years of damage later" 1. Her deeper critique is conceptual: the Act treats AI like a product to be certified safe through technical standards, "zoals een wasmachine," but risks to human rights, democracy, and the rule of law don't reduce to technical specifications 12. Against Macron's push to loosen the regulation, she argues for the opposite move — not looser, but smarter: simplify the compliance burden while closing the gaps that currently let the most consequential government uses slip through the Act's lists 12. She's equally skeptical of transparency as a cure-all — publishing an algorithm's code doesn't help most citizens, doesn't stop errors slipping in, and doesn't guarantee anyone is actually accountable for the final decision 12.
She closes her critique of legal instruments with a warning that cuts against a common liberal assumption — that having law on your side is automatically protective. "Het recht kan dus eigenlijk ook worden gebruikt om onze rechten en vrijheden uit te hollen en dat is wat rule by law is" 2. Law, in other words, can be the mechanism of erosion rather than its remedy, which is precisely why she wants sunset clauses, independent verification, and structural limits built in now, before infrastructure and precedent make reversal costly.
Smuha extends the same skepticism about hype and necessity to the humanoid robotics wave, treating it as a useful analogy for how technological narratives outpace evidence. She calls the current rush of humanoid robot announcements "communicative acceleration" — once a major player announces progress, competitors must respond in kind mainly to keep investors interested, without corresponding proof of real technical leaps 12. Her practical judgment is that general-purpose humanoid robots are probably the wrong design goal altogether: specialized machines that do one task well, like a robot vacuum, make more sense, since even a task as simple as picking up an egg without crushing it remains extremely hard for robots. The pull toward humanoid form, she argues, comes from fascination with building something human-like rather than actual need 12 — the same diagnosis, in miniature, that she applies to governments adopting algorithmic systems: a mix of fascination with the technology and pressure to cut costs, with little evidence the systems actually deliver on efficiency or effectiveness 12.
- The apparent acceleration in humanoid robotics is largely 'communicative acceleration': once one big player announces progress, competitors must announce too, mainly to keep investors pumping money in.
- General-purpose humanoid robots are likely inefficient; specialized robots for single tasks (like a robot vacuum) make more sense, and the humanoid drive stems from fascination with creating something human-like, not real need.
- Translating law into code is not a neutral technical act but a political and normative one: in Indiana, 'refusal to cooperate' with welfare authorities was coded as simply not answering the phone, an arbitrary interpretation never intended by parliament.
- Algorithmic systems operate at population scale, so a single error — conscious or not — has an enormous impact on the entire population, unlike individual human errors.
- Governments adopt algorithms due to a combination of technology fascination and cost-cutting pressure, often without evidence that the systems are actually more efficient or effective.
- Function creep is real: cameras installed in Antwerp's Jewish quarter after terrorist attacks for community protection were later reused during COVID to check whether that same community followed lockdown rules.
- When evaluating government algorithm infrastructure, don't think of today's government — think of the next election and your nightmare political party inheriting cameras and algorithms that can decide for the whole population with one mouse click.
- Belgium legalized the COVID pass framework so the system can return in a future crisis — one example of security infrastructure that persists after the emergency, since there is no limit to what can be justified in the name of safety.
- Predictive policing creates a reinforcing feedback loop: sending police where the algorithm points means crime is detected there, 'confirming' the algorithm, while crime elsewhere goes unrecorded, repeatedly flagging the same neighborhoods and people.
- The AI Act classifies benefit-decision systems and predictive policing as high-risk yet allows self-assessment without independent verification, and treats AI like a product (like a washing machine) to be made safe via technical standards — an ill-fitting instrument for risks to human rights, democracy and the rule of law.
- Rather than loosening the AI Act as Macron suggested, it should be made smarter: simplified, with better coverage of the most important risks that currently slip through its lists and technical standards.
- Transparency alone is insufficient protection: seeing an algorithm's code helps citizens little, errors can still creep in, and accountability for decisions can still be missing.
- The wave of humanoid robot announcements is largely 'communicative acceleration': once one big player announces, others must follow to keep investors warm, without evidence of actual technical acceleration.
- General-purpose humanoid robots are likely inefficient; specialized robots that each do one task well (like a robot vacuum) make more sense, since even picking up an egg without crushing it is extremely hard for a robot — the humanoid form is driven by fascination, not need.
- Translating a law into algorithmic code is not a purely technical act but a political and normative one: in Indiana, coders operationalized 'refusal to cooperate' with welfare authorities as simply not answering the phone, an arbitrary interpretation the democratic legislator never intended.
- Because algorithmic systems operate at population scale, a single error has enormous impact: a simple bug in the UK Post Office's accounting algorithm led to workers being wrongly prosecuted for theft, imprisoned, and in some cases driven to suicide before the error was found.
- Governments adopt algorithms due to a combination of fascination with technology (solution looking for a problem) and pressure to cut costs, despite little evidence the systems are actually more efficient or effective.
- Function creep: cameras installed to protect Antwerp's Jewish neighborhood after terrorist attacks were later used during COVID to check whether the Jewish community followed lockdown rules — the same infrastructure repurposed for goals citizens never consented to.
- Predictive policing creates a self-reinforcing feedback loop: sending police where the algorithm points guarantees crime is spotted there, 'confirming' the algorithm while crime elsewhere goes undetected and the same neighborhoods and people keep being flagged.
- The AI Act's core weakness is self-assessment: even high-risk systems like welfare-decision algorithms and predictive policing can be self-evaluated by the deploying organization, with independent verification only after complaints — potentially three years of damage later.
- The AI Act wrongly treats AI as a product to be made safe via technical standards like a washing machine, but risks to human rights, democracy and the rule of law cannot be translated into technical standards.
- The COVID pass was legalized via a law that allows the system to return in a future crisis, illustrating why strong sunset guarantees are needed when surveillance infrastructure is built in the name of safety.
- Rather than making the AI Act 'looser' as Macron suggested, it should be made smarter: simplified while offering better protection, since its exhaustive lists leave gaps and the most important risks around government use aren't fully covered.
- Transparency alone is insufficient protection: seeing an algorithm's code won't help most citizens, errors can still slip in, and accountability for final decisions can still be absent.
Media & appearances
2- 1podcastVirtual · 26 Feb 2025
KU Leuven/Oxford professor Nathalie Smuha explains how governments' use of algorithms to execute laws risks 'algorithmic rule by law' — undermining the rule of law — and why the EU AI Act is a necessary but insufficient safeguard.
- 2podcastVirtual · 26 Feb 2025
KU Leuven/Oxford legal philosopher Nathalie Smuha explains how governments' use of algorithms (tax fraud detection, benefits, predictive policing, smart cameras) can quietly erode the rule of law, and why the EU AI Act is a necessary but insufficient safeguard.