lnu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Ambient acoustic event assistive framework for identification, detection, and recognition of unknown acoustic events of a residence
Symbiosis Int Deemed Univ, India.ORCID iD: 0000-0002-4507-1844
Linnaeus University, Faculty of Technology, Department of computer science and media technology (CM). Tech Univ Denmark, Denmark;Tech Univ Munich, Germany. (AiHealth ; DISA ; DISA-IDP)ORCID iD: 0000-0002-2487-0866
2021 (English)In: Advanced Engineering Informatics, ISSN 1474-0346, E-ISSN 1873-5320, Vol. 47, article id 101238Article in journal (Refereed) Published
Abstract [en]

In recent times, Ambient Assisted Living has emerged as Smart Living. Smart living is a subset of ambient intelligence, which uses the latest technologies, intellectual processes, and ambient intelligent methodologies to enable house residents to live independently with a virtual companion 24 x 7. Typically, these residents are highly engrossed in the daily routine activities that they tend to ignore certain acoustic events attributing them to the white noise caused due to tap water leakage, flush water leakage, the acoustics of door opening/closing, cupboard opening/closing, curtain opening/closing, television, shower, radio, chair and many more. These unattended events lead to a waste of critical energy resources such as electricity, water, and gas and may cause accidents in some cases. For the conducted experiments, a customized dataset termed as "unknown-2000" and ESC-50 has been used, which has more than 2000 audio sound classification samples. The customized dataset is used for the conducted experiments, consisting of various length acoustic events ranging from 2 s to 10 s. In the proposed review, we have identified, analyzed, and evaluated resident acoustic events using Librosa machine learning libraries, texture analysis using LBP methodology, LSTM-CNN, SVM, KNN, LSTM, Bi-LSTM, and Decision Tree-based classification approaches. Furthermore, in the proposed approach, based on the conducted rigorous and detailed analysis, we are also envisioning the prospective ways to enhance smart living concepts by proposing a novel Acoustic Event Detection and Classification System. The investigation results validate the success of the proposed approach. The obtained results indicate that the customized version of the LSTM-CNN based classification approach used in the conducted experiment has outperformed all the other customized classification approaches, such as SVM, KNN-based classification, C4.5 decision tree-based classification, LSTM, and BiLSTM based classification. The LSTM-CNN based classification model has achieved an average value of approximately 0.77 and a standard deviation of 0.2295. Furthermore, the obtained experiential results show that the proposed approach has produced a good performance in various noisy conditions such as SNR0, SNR3, SNR6, SNR9, SNR12, and SNR15. The system classification accuracy has been enhanced to 77% for various acoustic events of a residence. In the end, a detailed comparison of LBP and without LBP approaches has been carried out, which proves that the combination of LBP and LSTM-CNN classification approach provides better results than without the LBP classification approach. The proposed Ambient Acoustic Event Assistive Framework is a costeffective alternative due to the use of low-cost microphone sensors in the conducted experiments.

Place, publisher, year, edition, pages
Elsevier, 2021. Vol. 47, article id 101238
Keywords [en]
Smart home acoustics acoustic sensor network, Home monitoring Residential assistance, LBP, LSTM-CNN
National Category
Computer Sciences
Research subject
Computer and Information Sciences Computer Science
Identifiers
URN: urn:nbn:se:lnu:diva-102001DOI: 10.1016/j.aei.2020.101238ISI: 000630364600023Scopus ID: 2-s2.0-85099058253Local ID: 2021OAI: oai:DiVA.org:lnu-102001DiVA, id: diva2:1542749
Available from: 2021-04-08 Created: 2021-04-08 Last updated: 2023-08-14Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Ghayvat, Hemant

Search in DiVA

By author/editor
Pandya, SharnilGhayvat, Hemant
By organisation
Department of computer science and media technology (CM)
In the same journal
Advanced Engineering Informatics
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 123 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf