Case Law Retrieval: Critical Evaluation of Czech Legal
Information Retrieval Systems

D 2019

Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems

HARAŠTA, Jakub

Základní údaje

Originální název

Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems

Autoři

HARAŠTA, Jakub

Vydání

Bern, Internet of Things: Tagungsband des 22. Internationalen Rechtsinformatik Symposions IRIS 2019, od s. 391-398, 8 s. 2019

Nakladatel

Weblaw AG

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

50501 Law

Stát vydavatele

Švýcarsko

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

tištěná verze "print"

Označené pro přenos do RIV

Ano

Kód RIV

RIV/00216224:14220/19:00118712

Organizační jednotka

Právnická fakulta

ISBN

978-3-96443-724-2

Klíčová slova anglicky

Information Retrieval; Evaluation; Czech Legal Information Retrieval Systems; Relevance; Recall; Precision

Štítky

rivok

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 15. 3. 2022 12:17, Mgr. Petra Georgala

Anotace

V originále

This paper is concerned with a critical evaluation of three widely used Czech legal information retrieval systems: ASPI, Beck-online and Codexis. The legal information retrieved from these systems shape the existing Czech legal practice. Thus, the issue of how reliable their results are when compared to each other is of utmost importance. The paper reports results of an experiment aiming to frame the discussion on information retrieval from the Czech systems. The experiment uses relation-based searches to create three sets of court decisions. The union of these sets establishes ideal databases for individual research tasks that allow for a comparison of the Recall and the Precision of the individual systems. To assess relevance of documents in a system-independent way, three lawyers (two experts and a non-expert) provided for a binary coding of the relevance of the individual court decisions.

Návaznosti

GA17-20645S, projekt VaV

Název: Exaktní hodnocení aplikační relevance judikatury

Investor: Grantová agentura ČR, Exaktní hodnocení aplikační relevance judikatury

Přiložené soubory

Case_Law_Retrieval-fulltext.pdf

Požádat o autorskou verzi souboru

Case_Law_Retrieval_....pdf

Požádat o autorskou verzi souboru

Citovat

HARAŠTA, Jakub. Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems. In Erich Schweighofer, Franz Kummer, Ahti Saarenpää (Hrsg. / Eds.). Internet of Things: Tagungsband des 22. Internationalen Rechtsinformatik Symposions IRIS 2019. Bern: Weblaw AG, 2019, s. 391-398. ISBN 978-3-96443-724-2.

@inproceedings{1499716,
   author = {Harašta, Jakub},
   address = {Bern},
   booktitle = {Internet of Things: Tagungsband des 22. Internationalen Rechtsinformatik Symposions IRIS 2019},
   editor = {Erich Schweighofer, Franz Kummer, Ahti Saarenpää (Hrsg. / Eds.)},
   keywords = {Information Retrieval; Evaluation; Czech Legal Information Retrieval Systems; Relevance; Recall; Precision},
   howpublished = {tištěná verze "print"},
   language = {eng},
   location = {Bern},
   isbn = {978-3-96443-724-2},
   pages = {391-398},
   publisher = {Weblaw AG},
   title = {Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems},
   year = {2019}
}

TY  - CONF
ID  - 1499716
AU  - Harašta, Jakub
PY  - 2019
TI  - Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems
PB  - Weblaw AG
CY  - Bern
SN  - 9783964437242
KW  - Information Retrieval
KW  - Evaluation
KW  - Czech Legal Information Retrieval Systems
KW  - Relevance
KW  - Recall
KW  - Precision
N2  - This paper is concerned with a critical evaluation of three widely used Czech legal information retrieval systems: ASPI, Beck-online and Codexis. The legal information retrieved from these systems shape the existing Czech legal practice. Thus, the issue of how reliable their results are when compared to each other is of utmost importance. The paper reports results of an experiment aiming to frame the discussion on information retrieval from the Czech systems. The experiment uses relation-based searches to create three sets of court decisions. The union of these sets establishes ideal databases for individual research tasks that allow for a comparison of the Recall and the Precision of the individual systems. To assess relevance of documents in a system-independent way, three lawyers (two experts and a non-expert) provided for a binary coding of the relevance of the individual court decisions.
ER  -

HARAŠTA, Jakub. Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems. In Erich Schweighofer, Franz Kummer, Ahti Saarenpää (Hrsg. / Eds.). \textit{Internet of Things: Tagungsband des 22. Internationalen Rechtsinformatik Symposions IRIS 2019}. Bern: Weblaw AG, 2019, s.~391-398. ISBN~978-3-96443-724-2.

Přehled o publikaci