TY - GEN
T1 - Generating music from an image
AU - Sergio, Gwenaelle C.
AU - Mallipeddi, Rammohan
AU - Kang, Jun Su
AU - Lee, Minho
N1 - Publisher Copyright:
© 2015 ACM.
PY - 2015/10/21
Y1 - 2015/10/21
N2 - Images can convey emotion just like music. If that's so, then it might be possible that, given an image, one can obtain a music that can produce a similar reaction from the listener/ viewer. The challenge lies in how to do that. In this paper, we analyze the image using the HSV color space model and assume that each one of the three components have a relation with basic music elements, like tone, pitch, rhythm and loudness. The image is then scanned from left to right and top to bottom in order to generate a sequence of notes. In the end, the emotional Mean Opinion Score (MOS) is used to evaluate the performance of the proposed method. This work could prove to be a very important contribution to the field of HCI because it can improve the interaction between computers and humans who are visually and/or hearing impaired. In the current work, we only consider two emotions; positive and negative.
AB - Images can convey emotion just like music. If that's so, then it might be possible that, given an image, one can obtain a music that can produce a similar reaction from the listener/ viewer. The challenge lies in how to do that. In this paper, we analyze the image using the HSV color space model and assume that each one of the three components have a relation with basic music elements, like tone, pitch, rhythm and loudness. The image is then scanned from left to right and top to bottom in order to generate a sequence of notes. In the end, the emotional Mean Opinion Score (MOS) is used to evaluate the performance of the proposed method. This work could prove to be a very important contribution to the field of HCI because it can improve the interaction between computers and humans who are visually and/or hearing impaired. In the current work, we only consider two emotions; positive and negative.
KW - Emotion
KW - GAPED
KW - HSV Color Space Model
KW - MOS
KW - Music Elements
UR - https://www.scopus.com/pages/publications/84962838904
U2 - 10.1145/2814940.2814978
DO - 10.1145/2814940.2814978
M3 - Conference contribution
AN - SCOPUS:84962838904
T3 - HAI 2015 - Proceedings of the 3rd International Conference on Human-Agent Interaction
SP - 213
EP - 216
BT - HAI 2015 - Proceedings of the 3rd International Conference on Human-Agent Interaction
PB - Association for Computing Machinery, Inc
T2 - 3rd International Conference on Human-Agent Interaction, HAI 2015
Y2 - 21 October 2015 through 24 October 2015
ER -