TY  - JOUR
U1  - Wissenschaftlicher Artikel
A1  - Schweitzer, Sascha
A1  - Conrads, Markus
T1  - The digital transformation of jurisprudence : an evaluation of ChatGPT-4’s applicability to solve cases in business law
JF  - Artificial Intelligence and Law
N2  - In the evolving landscape of legal information systems, ChatGPT-4 and other advanced conversational agents (CAs) offer the potential to disruptively transform the law industry. This study evaluates commercially available CAs within the German legal context, thereby assessing the generalizability of previous U.S.-based findings. Employing a unique corpus of 200 distinct legal tasks, ChatGPT-4 was benchmarked against Google Bard, Google Gemini, and its predecessor, ChatGPT-3.5. Human-expert and automated assessments of 4000 CA-generated responses reveal ChatGPT-4 to be the first CA to surpass the threshold of solving realistic legal tasks and passing a German business law exam. While ChatGPT-4 outperforms ChatGPT-3.5, Google Bard, and Google Gemini in both consistency and quality, the results demonstrate a considerable degree of variability, especially in complex cases with no predefined response options. Based on these findings, legal professionals should manually verify all texts produced by CAs before use. Novices must exercise caution with CA-generated legal advice, given the expertise needed for its assessment.
Y1  - 2024
UN  - https://nbn-resolving.org/urn:nbn:de:bsz:rt2-opus4-50805
SN  - 0924-8463
SS  - 0924-8463
U6  - https://doi.org/10.1007/s10506-024-09406-w
DO  - https://doi.org/10.1007/s10506-024-09406-w
SP  - 26
S1  - 26
PB  - Springer
CY  - Berlin
ER  -