TY - GEN
T1 - Development of visualizing earphone and hearing glasses for human augmented cognition
AU - Hwang, Byunghun
AU - Kim, Cheol Su
AU - Park, Hyung Min
AU - Lee, Yun Jung
AU - Kim, Min Young
AU - Lee, Minho
PY - 2011
Y1 - 2011
N2 - In this paper, we propose a human augmented cognition system which is realized by a visualizing earphone and a hearing glasses. The visualizing earphone using two cameras and a headphone set in a pair of glasses intreprets both human's intention and outward visual surroundings, and translates visual information into an audio signal. The hearing glasses catch a sound signal such as human voices, and not only finds the direction of sound sources but also recognizes human speech signals. Then, it converts audio information into visual context and displays the converted visual information in a head mounted display device. The proposed two systems includes incremental feature extraction, object selection and sound localization based on selective attention, face, object and speech recogntion algorithms. The experimental results show that the developed systems can expand the limited capacity of human cognition such as memory, inference and decision.
AB - In this paper, we propose a human augmented cognition system which is realized by a visualizing earphone and a hearing glasses. The visualizing earphone using two cameras and a headphone set in a pair of glasses intreprets both human's intention and outward visual surroundings, and translates visual information into an audio signal. The hearing glasses catch a sound signal such as human voices, and not only finds the direction of sound sources but also recognizes human speech signals. Then, it converts audio information into visual context and displays the converted visual information in a head mounted display device. The proposed two systems includes incremental feature extraction, object selection and sound localization based on selective attention, face, object and speech recogntion algorithms. The experimental results show that the developed systems can expand the limited capacity of human cognition such as memory, inference and decision.
KW - Augmented cognition system
KW - Computer interfaces
KW - Hearing glasses
KW - Incremental feature extraction
KW - Visualizing earphone
UR - http://www.scopus.com/inward/record.url?scp=81855177436&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-24958-7_40
DO - 10.1007/978-3-642-24958-7_40
M3 - Conference contribution
AN - SCOPUS:81855177436
SN - 9783642249570
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 342
EP - 349
BT - Neural Information Processing - 18th International Conference, ICONIP 2011, Proceedings
T2 - 18th International Conference on Neural Information Processing, ICONIP 2011
Y2 - 13 November 2011 through 17 November 2011
ER -