Data paper All Open Access; Gold Open Access; Green Open Acce

LUMINA: Linguistic unified multimodal Indonesian natural audio-visual dataset

Eka Rahayu Setyaningsih, Anik Nur Handayani, Wahyu Sakti Gunawan Irianto, Yosi Kristian, Christian Trisno Sen Long Chen

Data in Brief , Vol. 54 · 2024

6Citations
73Highest percentile
5Authors

Summary

Summary LUMINA: Linguistic unified multimodal Indonesian natural audio-visual dataset
Key quote

The LUMINA dataset has been instrumental in advancing research on speech perception and technology.

Setyaningsih et al., 2024

Details

Abstract

The LUMINA (Linguistic Unified Multimodal Indonesian Natural Audio-Visual) Dataset is a carefully curated constrained audio-visual dataset designed to support research in the field of speech perception. Spoken exclusively in Indonesian, LUMINA contains high-quality audio-visual recordings featuring 14 native speakers, including 9 males and 5 females. Each speaker contributes approximately 1,000 sentences, producing a rich and diverse data collection. The recorded videos focus on facial recordings, capturing essential visual cues and expressions that accompany speech. This extensive dataset provides a valuable resource for understanding how humans perceive and process spoken language, paving the way for speech recognition and synthesis technology advancements. © 2024 The Author(s)

Affiliations

Department of Electrical Engineering and Informatics, Universitas Negeri Malang, Semarang Street 5, Malang, East Java, 65145, Indonesia; Institut Sains dan Teknologi Terpadu Surabaya, Ngagel Jaya Tengah Street 73 – 77, Surabaya, East Java, 60284, Indonesia

Elsevier Inc. · ISSN 23523409