D 2023

Comparative Analysis of Community Detection and Transformer-Based Approaches for Topic Clustering of Scientific Papers

BRETSKO, Daniel, Aliaksandr BELY and Stanislav SOBOLEVSKY

Basic information

Original name

Comparative Analysis of Community Detection and Transformer-Based Approaches for Topic Clustering of Scientific Papers

Authors

BRETSKO, Daniel (804 Ukraine, guarantor, belonging to the institution), Aliaksandr BELY (112 Belarus, belonging to the institution) and Stanislav SOBOLEVSKY (112 Belarus, belonging to the institution)

Edition

Cham, 23rd International Conference on Computational Science and Its Applications , ICCSA 2023, p. 648-660, 13 pp. 2023

Publisher

Springer

Other information

Language

English

Type of outcome

Stať ve sborníku

Field of Study

10201 Computer sciences, information science, bioinformatics

Country of publisher

Germany

Confidentiality degree

není předmětem státního či obchodního tajemství

Publication form

printed version "print"

References:

URL

Impact factor

Impact factor: 0.402 in 2005

RIV identification code

RIV/00216224:14310/23:00131468

Organization unit

Faculty of Science

ISBN

978-3-031-36804-2

ISSN

DOI

http://dx.doi.org/10.1007/978-3-031-36805-9_42

UT WoS

001166618800042

Keywords in English

Network analysis; NLP; Topic clustering; Community detection; Sentence-transformers

Tags

rivok

Tags

International impact, Reviewed
Změněno: 21/3/2024 10:32, Mgr. Marie Šípková, DiS.

Abstract

V originále

We are solving the topic clustering problem, where we need to categorize papers with initially available subjects into more consistent and higher-level topics. We approach the task from two perspectives, one is the traditional network science, where we perform community detection on a subject network with the use of Combo algorithm, and the second is the transformer-based top2vec algorithm which uses sentence-transformer to embed the content of the papers. The comparison between the two approaches was conducted using a dataset of scientific papers on computer science and mathematics collected from the SCOPUS database, and different coherence scores were used as a measure of performance. The results showed that the community detection Combo algorithm was able to achieve a similar coherence score to the transformer-based top2vec. The findings suggest that community detection may be a viable alternative for topic clustering when one has predefined topics, especially when a high coherence score and fast processing time are desired. The paper also discusses the potential advantages and limitations of using Combo for topic clustering and the potential for future work in this area.

Links

EF16_019/0000822, research and development project
Name: Centrum excelence pro kyberkriminalitu, kyberbezpečnost a ochranu kritických informačních infrastruktur
MUNI/J/0008/2021, interní kód MU
Name: Digital City
Investor: Masaryk University, MASH JUNIOR - MUNI Award In Science and Humanities JUNIOR
Displayed: 3/11/2024 16:14