Automated Dewey Decimal Classification of Swedish library metadata using Annif softwareShow others and affiliations
2024 (English)In: Journal of Documentation, ISSN 0022-0418, E-ISSN 1758-7379, Vol. 80, no 5, p. 1057-1079Article in journal (Refereed) Published
Abstract [en]
PurposeIn order to estimate the value of semi-automated subject indexing in operative library catalogues, the study aimed to investigate five different automated implementations of an open source software package on a large set of Swedish union catalogue metadata records, with Dewey Decimal Classification (DDC) as the target classification system. It also aimed to contribute to the body of research on aboutness and related challenges in automated subject indexing and evaluation.Design/methodology/approachOn a sample of over 230,000 records with close to 12,000 distinct DDC classes, an open source tool Annif, developed by the National Library of Finland, was applied in the following implementations: lexical algorithm, support vector classifier, fastText, Omikuji Bonsai and an ensemble approach combing the former four. A qualitative study involving two senior catalogue librarians and three students of library and information studies was also conducted to investigate the value and inter-rater agreement of automatically assigned classes, on a sample of 60 records.FindingsThe best results were achieved using the ensemble approach that achieved 66.82% accuracy on the three-digit DDC classification task. The qualitative study confirmed earlier studies reporting low inter-rater agreement but also pointed to the potential value of automatically assigned classes as additional access points in information retrieval.Originality/valueThe paper presents an extensive study of automated classification in an operative library catalogue, accompanied by a qualitative study of automated classes. It demonstrates the value of applying semi-automated indexing in operative information retrieval systems.
Place, publisher, year, edition, pages
Emerald Group Publishing Limited, 2024. Vol. 80, no 5, p. 1057-1079
Keywords [en]
Automated subject indexing, Automatic classification, DDC, Annif, Libris, Supervised machine learning, Lexical algorithm, Ensemble approach, Qualitative evaluation
National Category
Information Studies
Research subject
Humanities, Library and Information Science
Identifiers
URN: urn:nbn:se:lnu:diva-128805DOI: 10.1108/JD-01-2022-0026ISI: 001194111700001Scopus ID: 2-s2.0-85189084858OAI: oai:DiVA.org:lnu-128805DiVA, id: diva2:1851246
2024-04-122024-04-122025-02-04Bibliographically approved