Jose San pedro
ABSTRACT
This paper presents a novel approach to assist users of digital cameras and augment their photograph taking experience. To this end, a realtime analysis of the images framed by the camera is conducted to assess composition, exposure and presence of human subjects. The resulting information is used to give users feedback about their photographs before they release the shutter. The main contribution of this paper is the use of synesthetic feedback: a musical composition that maps aspects resulting from the realtime analysis of images is composed and played back to the photographer. A preliminary study shows that musical attributes can be controlled to provide effective feedback about the visual modality.
- Brewster, S., McAdam, C., McDonald, J., and Maciver, J. Rethinking camera user interfaces. In Digital Photography VIII, vol. 8299, SPIE (2012).Google Scholar
Cross Ref
- Brewster, S. A., and Johnston, J. Multimodal interfaces for camera phones. MobileHCI '08, ACM (2008), 387--390. Google ScholarDigital Library
- Koelsch, S., and Siebel, W. A. Towards a neural basis of music perception. Trends in Cognitive Sciences 9, 12 (2005), 578 -- 584.Google ScholarCross Ref
- McAdam, C., Pinkerton, C., and Brewster, S. A. Novel interfaces for digital cameras and camera phones. MobileHCI '10, ACM (2010), 143--152. Google ScholarDigital Library
- Obrador, P., Schmidt-Hackenberg, L., and Oliver, N. The role of image composition in image aesthetics. In Image Processing, Conf., IEEE (2010), 3185--3188.Google Scholar
Index Terms
- The sound of light: induced synesthesia for augmenting the photography experience
Recommendations
XiaoIce Band: A Melody and Arrangement Generation Framework for Pop Music
KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data MiningWith the development of knowledge of music composition and the recent increase in demand, an increasing number of companies and research institutes have begun to study the automatic generation of music. However, previous models have limitations when ...
PopMAG: Pop Music Accompaniment Generation
MM '20: Proceedings of the 28th ACM International Conference on MultimediaIn pop music, accompaniments are usually played by multiple instruments (tracks) such as drum, bass, string and guitar, and can make a song more expressive and contagious by arranging together with its melody. Previous works usually generate multiple ...
Pop Music Generation: From Melody to Multi-style Arrangement
Special Issue on KDD 2018, Regular Papers and Survey PaperMusic plays an important role in our daily life. With the development of deep learning and modern generation techniques, researchers have done plenty of works on automatic music generation. However, due to the special requirements of both melody and ...
Comments