About | HeinOnline Law Journal Library | HeinOnline Law Journal Library | HeinOnline



76 Vand. L. Rev. 429 (2023)
Humans in the Loop

handle is hein.journals/vanlr76 and id is 447 raw text is: 











                   Humans in the Loop



                               Rebecca  Crootof
                           Margot   E. Kaminski**
                           W. Nicholson   Price II***


        From   lethal drones  to cancer  diagnostics, humans are increasingly
working  with complex  and  artificially intelligent algorithms to make decisions
which  affect human   lives, raising questions about how   best to regulate these
human-in-the-loop  systems.  We make  four contributions  to the discourse.
        First, contrary to the popular narrative, law is already profoundly  and
often problematically   involved  in governing   human-in-the-loop   systems:  it
regularly affects whether  humans are retained in or removed from the loop.
Second,  we identify the MABA-MABA trap, which occurs when policymakers
attempt  to address   concerns  about  algorithmic  incapacities  by inserting  a
human   into a decisionmaking  process. Regardless of whether  the law governing
these systems is old or new, inadvertent or intentional, it rarely accounts for the
fact that human-machine systems are more than the sum of their parts: they




   *    Rebecca Crootof is Associate Professor of Law, University of Richmond School of Law.
   **   Margot E. Kaminski is Associate Professor of Law, Colorado Law School, and Director,
Privacy Initiative, the Silicon Flatirons Center.
   ***  W. Nicholson Price II is Professor of Law, University of Michigan, and Core Partner,
Center for Advanced Studies in Biomedical Innovation Law, University of Copenhagen Faculty of
Law.
   For detailed feedback on earlier drafts, we thank Nick Bagley, Stefan Bechtold, Douglas
Bernstein, Charleton Copeland, Dan Deacon, Rebecca Eisenberg, Michael Froomkin, Jim Gibson,
Patrick Gudridge, Kristian Hammond, Corinna Lain, Matt Sag, Andres Sawicki, Alex Stremitzer,
Charlotte Tschider, and Christopher Yoo. For helpful comments and conversations, we thank Luca
Baltensberger, Rabea Benhalim, Ana Bracic, Christopher Corts, Sue Glueck, Claudia Haupt,
Fiona Illi, Izzy Longstaff, Andrea Matwyshyn, Emily McReynolds, Aileen Neilson, Paul Ohm,
Nadav  Orien-Peer, Gabriel Rauterberg, Blake Reid, Nikkita Rivera, Andrew Selbst, Lawrence
Solum, Sloan Speck, Elizabeth Stalfort, and Harry Surden. This paper benefited from generous
feedback at the AALS 2020 Annual Meeting, the ETH Zurich and the Universities of Zurich and
St. Gallen Workshop on the Law & Economics of Innovation, the Legal Scholars Roundtable on
Artificial Intelligence, the Northwestern, Penn, and Stanford Law Schools' Junior Faculty Forum
for Law and STEM, the Privacy Law Scholars Conference, the Richmond Law School Faculty
Workshop, the University of Miami Law School Legal Theory Workshop, the University of
Michigan Law School Governance Workshop, the University of Michigan AI & Law Seminar, the
Techlaw Junior Scholars Workshop, and the We Robot conference. We thank Nathan Fuller, Abbi
Lynch, Phoebe Roque, Rylee Snively, and Angela Theodoropoulos for excellent research assistance.
Nicholson Price's work was  supported by  the Novo  Nordisk Foundation (Grant No.
NNF17SA0027784).  From each of us individually: All mistakes are my co-authors'.

                                       429