RŮŽIČKA, Michal. Math Information Retrieval for Digital Libraries. Brno: Masaryk University, Faculty of Informatics, 2017, 144 pp. Doctoral Thesis.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name Math Information Retrieval for Digital Libraries
Authors RŮŽIČKA, Michal (203 Czech Republic, guarantor, belonging to the institution).
Edition Brno, 144 pp. Doctoral Thesis, 2017.
Publisher Masaryk University, Faculty of Informatics
Other information
Original language English
Type of outcome Special-purpose publication
Field of Study 10201 Computer sciences, information science, bioinformatics
Country of publisher Czech Republic
Confidentiality degree is not subject to a state or trade secret
WWW Full-text Archive of Thesis
RIV identification code RIV/00216224:14330/17:00094408
Organization unit Faculty of Informatics
Keywords in English math information retrieval; math-aware full-text search; similarity search; digital libraries; MIaS; WebMIaS; MathML canonicalization; MathML structural unification; query relaxation strategies; topic modeling; math representation; evaluation
Tags International impact
Changed by Changed by: RNDr. Michal Růžička, Ph.D., učo 143424. Changed: 10/1/2018 14:12.
Abstract
The aim of my thesis is to improve full-text search functionality in the digital libraries of scientific documents. Documents in STEM (science, technology, engineering and mathematics) fields usually contain a lot of mathematical formulae which are germane to the main message of the documents. However, current, common full-text search engines provide neither the proper functionality to index formulae nor the appropriate interfaces for end users to search them. In essence, our math-aware full-text search engine MIaS (Math Indexer and Searcher) exploits the search functionality of the state-of-the-art keyword-based full-text search engines, while adding a new and efficient way of indexing formulae. To index mathematical formulae, the formulae are processed in several steps: formulae are normalized to remove the syntactic differences between formulae which are semantically the same; subformulae and generalized forms of the formulae are derived to be represented (and searchable) as standalone entities in the index; weights are assigned to them based on the degree of the modification from the original formula; finally, formulae are converted to a compact text representation called MTerms that are directly indexable by the common text search engines. During the search, similar processing is applied to formulae in the query resulting in query MTerms usable for querying the index. Formulae weights in the index are used to assign proper ranks to the results. For queries combining multiple text keywords and mathematical formulae I developed and evaluated multiple query relaxation strategies that improve the quality of the results. The suitability of various math representations for topic modeling on math documents was evaluated so as to make further improvements to the ranking of results in the math-aware search engine. Using the math normalization tool and query relaxation strategies in concert resulted in MIaS being independently evaluated as the system providing the best results on an NTCIR-11 evaluation event from among seven other math-aware full-text systems. MIaS has now been integrated to the European Digital Mathematics Library (EuDML) to provide math-aware search functionality in hundreds of thousands math papers, as the first ever industry standard digital library. This thesis evaluates the effects of various configuration parameter setups of the above-mentioned techniques of math-specific contents (formulae) representation and indexing. The evaluation process is automated using datasets and ground truth data from the NTCIR evaluation events. The automated evaluation methodology, exploiting existing judgement data, described in the thesis can also be applied to the rigorous evaluation of other systems.
Links
TD03000295, research and development projectName: Inteligentní software pro sémantické hledání dokumentů (Acronym: ISSHD)
Investor: Technology Agency of the Czech Republic
1ET200190513, research and development projectName: DML-CZ: Česká digitální matematická knihovna
Investor: Academy of Sciences of the Czech Republic, DML-CZ: Czech Digital Mathematical Library
250503, interní kód MUName: The European Digital Mathematics Library (Acronym: EuDML)
Investor: European Union
PrintDisplayed: 18/7/2024 14:19