Case Law Retrieval: Critical Evaluation of Czech Legal
Information Retrieval Systems

J 2019

Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems

HARAŠTA, Jakub

Základní údaje

Originální název

Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems

Autoři

HARAŠTA, Jakub

Vydání

Jusletter IT, Weblaw AG, 2019, 1664-848X

Další údaje

Jazyk

angličtina

Typ výsledku

Článek v odborném periodiku

Obor

50501 Law

Stát vydavatele

Švýcarsko

Utajení

není předmětem státního či obchodního tajemství

Odkazy

Text (dostupný po přihlášení)

Označené pro přenos do RIV

Ano

Kód RIV

RIV/00216224:14220/19:00107284

Organizační jednotka

Právnická fakulta

EID Scopus

2-s2.0-85073050820

Klíčová slova anglicky

Information Retrieval; Evaluation; Czech Legal Information Retrieval Systems; Relevance; Recall; Precision

Štítky

rivok

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 29. 4. 2020 22:12, Mgr. Michal Petr

Anotace

V originále

This paper is concerned with a critical evaluation of three widely used Czech legal information retrieval systems: ASPI, Beck-online and Codexis. The legal information retrieved from these systems shape the existing Czech legal practice. Thus, the issue of how reliable their results are when compared to each other is of utmost importance. The paper reports results of an experiment aiming to frame the discussion on information retrieval from the Czech systems. The experiment uses relation-based searches to create three sets of court decisions. The union of these sets establishes ideal databases for individual research tasks that allow for a comparison of the Recall and the Precision of the individual systems. To assess relevance of documents in a system-independent way, three lawyers (two experts and a non-expert) provided for a binary coding of the relevance of the individual court decisions.

Návaznosti

GA17-20645S, projekt VaV

Název: Exaktní hodnocení aplikační relevance judikatury

Investor: Grantová agentura ČR, Exaktní hodnocení aplikační relevance judikatury

Přiložené soubory

Case_Law_Retrieval-fulltext.pdf

Požádat o autorskou verzi souboru

Citovat

HARAŠTA, Jakub. Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems. Jusletter IT. Weblaw AG, 2019, roč. 4, 21. Februar 2019, s. 1-8. ISSN 1664-848X.

@article{1499719,
   author = {Harašta, Jakub},
   article_number = {21. Februar 2019},
   keywords = {Information Retrieval; Evaluation; Czech Legal Information Retrieval Systems; Relevance; Recall; Precision},
   language = {eng},
   issn = {1664-848X},
   journal = {Jusletter IT},
   title = {Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems},
   url = {https://jusletter-it.weblaw.ch/en/issues/2019/IRIS/case-law-retrieval--_186fdccb91.html},
   volume = {4},
   year = {2019}
}

TY  - JOUR
ID  - 1499719
AU  - Harašta, Jakub
PY  - 2019
TI  - Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems
JF  - Jusletter IT
VL  - 4
IS  - 21. Februar 2019
SP  - 1-8
EP  - 1-8
PB  - Weblaw AG
SN  - 1664848X
KW  - Information Retrieval
KW  - Evaluation
KW  - Czech Legal Information Retrieval Systems
KW  - Relevance
KW  - Recall
KW  - Precision
UR  - https://jusletter-it.weblaw.ch/en/issues/2019/IRIS/case-law-retrieval--_186fdccb91.html
L2  - https://jusletter-it.weblaw.ch/en/issues/2019/IRIS/case-law-retrieval--_186fdccb91.html
N2  - This paper is concerned with a critical evaluation of three widely used Czech legal information retrieval systems: ASPI, Beck-online and Codexis. The legal information retrieved from these systems shape the existing Czech legal practice. Thus, the issue of how reliable their results are when compared to each other is of utmost importance. The paper reports results of an experiment aiming to frame the discussion on information retrieval from the Czech systems. The experiment uses relation-based searches to create three sets of court decisions. The union of these sets establishes ideal databases for individual research tasks that allow for a comparison of the Recall and the Precision of the individual systems. To assess relevance of documents in a system-independent way, three lawyers (two experts and a non-expert) provided for a binary coding of the relevance of the individual court decisions.
ER  -

HARAŠTA, Jakub. Case Law Retrieval: Critical Evaluation of Czech Legal Information Retrieval Systems. \textit{Jusletter IT}. Weblaw AG, 2019, roč.~4, 21. Februar 2019, s.~1-8. ISSN~1664-848X.

Přehled o publikaci