Další formáty:
BibTeX
LaTeX
RIS
@inproceedings{1430596, author = {Novotný, Vít}, address = {Torino, Italy}, booktitle = {Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM '18)}, doi = {http://dx.doi.org/10.1145/3269206.3269317}, keywords = {Vector Space Model; computational complexity; similarity measure}, howpublished = {elektronická verze "online"}, language = {eng}, location = {Torino, Italy}, isbn = {978-1-4503-6014-2}, pages = {1639-1642}, publisher = {Association for Computing Machinery}, title = {Implementation Notes for the Soft Cosine Measure}, url = {https://arxiv.org/abs/1808.09407}, year = {2018} }
TY - JOUR ID - 1430596 AU - Novotný, Vít PY - 2018 TI - Implementation Notes for the Soft Cosine Measure PB - Association for Computing Machinery CY - Torino, Italy SN - 9781450360142 KW - Vector Space Model KW - computational complexity KW - similarity measure UR - https://arxiv.org/abs/1808.09407 N2 - The standard bag-of-words vector space model (VSM) is efficient, and ubiquitous in information retrieval, but it underestimates the similarity of documents with the same meaning, but different terminology. To overcome this limitation, Sidorov et al. proposed the Soft Cosine Measure (SCM) that incorporates term similarity relations. Charlet and Damnati showed that the SCM is highly effective in question answering (QA) systems. However, the orthonormalization algorithm proposed by Sidorov et al. has an impractical time complexity of O(n^4), where n is the size of the vocabulary. In this paper, we prove a tighter lower worst-case time complexity bound of O(n^3). We also present an algorithm for computing the similarity between documents and we show that its worst-case time complexity is O(1) given realistic conditions. Lastly, we describe implementation in general-purpose vector databases such as Annoy, and Faiss and in the inverted indices of text search engines such as Apache Lucene, and ElasticSearch. Our results enable the deployment of the SCM in real-world information retrieval systems. ER -
NOVOTNÝ, Vít. Implementation Notes for the Soft Cosine Measure. Online. In \textit{Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM '18)}. Torino, Italy: Association for Computing Machinery, 2018, s.~1639-1642. ISBN~978-1-4503-6014-2. Dostupné z: https://dx.doi.org/10.1145/3269206.3269317.
|