About | HeinOnline Law Journal Library | HeinOnline Law Journal Library | HeinOnline

LOG IN
LOG IN


92 Fordham L. Rev. 1941 (2023-2024)
ChatGPT, AI Large Language Models, and Law

handle is hein.journals/flr92 and id is 1992 raw text is: CHATGPT, Al LARGE LANGUAGE MODELS, AND LAW Harry Surden* This Essay explores Artificial Intelligence (AI) Large Language Models (LLMs) like ChatGPT/GPT-4, detailing the advances and challenges in applying AI to law. It first explains how these AI technologies work at an understandable level. It then examines the significant evolution of LLMs since 2022 and their improved capabilities in understanding and generating complex documents, such as legal texts. Finally, this Essay discusses the limitations of these technologies, offering a balanced view of their potential role in legal work. INTRODUCTION................................................................................ 1942 I. WHAT HAS CHANGED IN ARTIFICIAL INTELLIGENCE?............... 1944 A. Large Leaps in Capability in Just One Year (2022-2023)......................................................... 1949 B. How Large Language Models Work............................... 1953 C. The Meaning of GPT in GPT-4 and ChatGPT.......... 1957 II. GPT: GENERATIVE PRETRAINED TRANSFORMER..................... 1957 A. Generative .................................................................. 1957 B . P retrained .................................................................. 1957 C. Transformer ............................................................... 1962 D. Word Vectors.................................................................. 1965 E. Instruction Tuning and Reinforcement Learning ........... 1966 III. LLMS IN LAW AND THEIR LIMITATIONS.................................. 1968 CONCLUSION ................................................................................... 1972 * Professor of Law, University of Colorado Law School. Associate Director, Stanford Center for Legal Informatics (CodeX), Stanford University. This Essay was prepared for the Symposium entitled The New AI: The Legal and Ethical Implications of ChatGPT and Other Emerging Technologies, hosted by the Fordham Law Review and cosponsored by Fordham University School of Law's Neuroscience and Law Center on November 3, 2023, at Fordham University School of Law. 1941