About | HeinOnline Law Journal Library | HeinOnline Law Journal Library | HeinOnline



25 Stan. Tech. L. Rev. 1 (2021-2022)

handle is hein.journals/stantlr25 and id is 1 raw text is: 







                   Beyond Automation:

     Machine Learning-Based Systems and

     Human Behavior in the Personalization

                            Economy


                            Niklas   Eder*


                    25 STAN. TECH. L. REV. 1(2021)


                                ABSTRACT

    Personalization has long been  a feature of online services, shaping
targeted advertisement and online manipulation. Corporations now seek to
exploit the enormous  economic  potential of personalization beyond the
confinements  of the online space. In recent years, the proliferation of
machine  learning-based decision-making has led to personalization in all
spheres  of life. Corporations rely on machine learning-based systems to
decide if and under what  conditions they contract with individuals. They
determine  who  is invited for job interviews and who is eligible for loans.
They  shape how  we  are perceived and  tailor the way in which we  are
treated. The implications of these systems are already immense, and they
foreshadow  a larger transformation. Over the course of the 21st century,
ubiquitous, machine learning-based personalization will likely permeate the
economy   and become   a fundamental  condition of human existence. The
shape of this transformation is still uncertain; before it concretizes, we have
the opportunity to guide its direction by articulating concepts that allow us
to describe and critically examine it.




* Niklas Eder is a Visiting Fellow at the Information Society Project at Yale Law School,
Senior Policy Officer at the Oversight Board and founder of the project Law in the
Algorithmic Society. I am grateful to Luise Durstewitz, Nawid Aludin, Yasmine Janah,
Milky T. Asefa, Louis Hunter, Andrew Hadler, Nikolas Guggenberger, Artur Pericles Lima
Monteiro, Przemek Palka, Yuval Goldfus, and the entire community of the Information
Society Project for their support of this project. I also want to thank Jack Balkin, Frank
Pasquale, Rebecca Wexler, and the organisers and participants of presentations at Yale
Law School, the Privacy Workshop at Northeastern University, the European University
Institute, the Legal Priorities Project, University of Tilburg, and Tartu University. Special
thanks to Stan. Tech. L. Rev.'s Erich Remiker, Tanner Kuenneth, Kathryn Larkin, Olivia
Malone, and Alex Evelson for their excellent editing. All errors are my own.


1