Yi-Hsuan Yang
Home | Experiences | Publications | Projects | Resources

Book

• Y.-H. Yang and H.-H. Chen,
  "Music Emotion Recognition,"
  CRC Taylor & Francis Books, in press (to be published in Feb. 2011)
  (link)
  
  
This book provides a comprehensive introduction of the research on modeling human's emotion perception of music, a research topic that emerges in the face of the ever-increasing amount of digital music content. Automatic recognition of the perceived emotion of music allows users to retrieve and organize their music collections in an emotion-based fashion, which is more content-centric than conventional metadata-based methods. Building such a music emotion recognition system, however, is challenging because of the subjective nature of emotion perception. One needs to deal with issues such as the reliability of ground truth data and the difficulty of evaluating the prediction result, which do not exist in other pattern recognition problems such as face recognition and speech recognition. This book provides the detail of the methods that have been developed to address these issues.

Journal Papers

• Y.-C. Lin, Y.-H. Yang and H.-H. Chen,
  "Exploiting online tags for music emotion classification,"
  Special Issue on Social Media,
  ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP), accepted.
  (paper)
  
  
• Y.-H. Yang and H.-H. Chen,
  "Machine recognition of music emotion: A review,"
  ACM Transactions on Intelligent Systems and Technology (TIST), accepted.
  (paper)
  
  
• Y.-H. Yang and H.-H. Chen,
  "Prediction of the distribution of perceived music emotions using discrete samples,"
  IEEE Transactions on Audio, Speech and Language Processing (TASLP),
  vol. 19, no. 7, pp. 2184-2196, Sept. 2011.
  (paper) [project page]
  
  
• Y.-H. Yang and H.-H. Chen,
  "Ranking-based emotion recognition for music organization and retrieval,"
  IEEE Transactions on Audio, Speech and Language Processing (TASLP),
  vol. 19, no. 4, pp. 762-774, May 2011.
  (paper) [project page]
  
  
• Y.-H. Yang, W.-H. Hsu, and H.-H. Chen,
  "Online reranking via ordinal informative concepts for context fusion in concept detection and video search,"
  IEEE Transactions on Circuits and Systems for Video Technology (TCSVT),
  vol. 19, no. 12, pp. 1880-1890, Dec. 2009.
  (paper)
  
  
• Y.-F. Su, Y.-H. Yang, M.-T. Lu, and H.-H. Chen,
  "Smooth control of adaptive media playout for video streaming,"
  IEEE Transactions on Multimedia (TMM),
  vol. 11, no. 7, pp. 1331-1339, Nov. 2009.
  (paper)
  
  
• Y.-H. Yang, Y.-C. Lin, Y.-F. Su, and H.-H. Chen,
  "A regression approach to music emotion recognition,"
  IEEE Transactions on Audio, Speech and Language Processing (TASLP),
  vol. 16, no. 2, pp. 448-457, Feb. 2008.
  (abstract, paper, slides) [project page, include dataset] (cited by 50)
  
  
• Y.-H. Yang and H.-H. Chen,
  "Searching music in the emotion plane,"
  IEEE MMTC E-Letter, November issue, 2009, invited paper.
  (paper)
  
  

Conference Papers

2011

• Y.-H. Kuo, H.-T. Lin, W.-H. Cheng, Y.-H. Yang, and W.-H. Hsu,
  "Unsupervised auxiliary visual words discovery for large-scale image object retrieval,"
  in Proc. ACM Int. Conf. Computer Vision and Pattern Recognition 2011 (CVPR'11), accepted.
  (paper)
  
  
• K.-S. Lin, A. Lee, Y.-H. Yang, C.-D. Lee, and H.-H. Chen,
  "Automatic highlights extraction for drama video using music emotion and human face features,"
  in Proc. IEEE Int. Workshop on Multimedia Signal Processing 2011 (MMSP'11), accepted.
  (paper)
  
• C.-D. Lee, Y.-H. Yang, and H.-H. Chen,
  "Automatic transcription of piano music by sparse representa- tion of magnitude spectra,"
  in Proc. IEEE Int. Conf. Multimedia and Expo. 2011 (ICME'11), accepted.
  (paper) [project page]
  

2010

• Y.-H. Kuo, Y.-L. Wu, K.-T. Chen, Y.-H. Yang, T.-H. Chiu, and W.-H. Hsu,
  "A technical demonstration of large-scale image object retrieval by efficient query evaluation and effective auxiliary visual feature discovery,"
  in Proc. ACM Int. Conf. Multimedia 2010 (MM'10), technical demonstration.
  (paper)
  

2009

• Y.-H. Yang, Y.-C. Lin, A. Lee, and H.-H. Chen,
  "Improving musical concept detection by ordinal regression and context fusion,"
  in Proc. Int. Society of Music Information Retrieval 2009 (ISMIR'09), Kobe, Japan, pp. 147-152.
  (paper, abstract, poster)
  
  
• M.-Y. Su, Y.-H. Yang, Y.-C. Lin, and H.-H. Chen,
  "An integrated approach to music boundary detection,"
  in Proc. Int. Society of Music Information Retrieval 2009 (ISMIR'09), Kobe, Japan, pp. 705-710.
  (paper, abstract, poster)
  
  
• Y.-H. Yang, Y.-C. Lin, and H.-H. Chen,
  "Personalized music emotion recognition,"
  in Proc. ACM Int. Conf. Information Retrieval 2009 (SIGIR'09), Boston, USA, short paper, pp. 748-749.
  (paper)
  
  
• L.-C. Hsieh, K.-T. Chen, Y.-H. Yang, and G.-L. Wu,
  "Canonical image selection and efficient image graph construction for large-scale Flickr photos,"
  Grand Challenge for ACM Multimedia 2009 (MM'09).
  (paper)
  
  
• Y.-H. Yang and H.-H. Chen,
  "iMR: Interactive music recommendation via active interactive genetic algorithm,"
  in Proc. Int. Workshop on Computer Music and Audio Technology 2009 (WOCMAT'09), Taipei, Taiwan.
  (paper)
  
  
• Y.-H. Yang and H.-H. Chen,
  "Music emotion ranking,"
  in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing 2009 (ICASSP'09), Taipei, Taiwan, pp. 1657-1660.
  (paper, abstract) [project page, include dataset]
  
  
• Y.-C. Lin, Y.-H. Yang, H.-H. Chen, I-Bin Liao, and Yeh-Chin Ho
  "Exploiting genre for music emotion classification,"
  in Proc. IEEE Int. Conf. Multimedia and Expo. 2009 (ICME'09), New York, USA, pp. 618-621.
  (paper) [project page, include dataset]
  
  
• Y.-H. Yang, Y.-C. Lin, and H.-H. Chen,
  "Clustering for music search results,"
  in Proc. IEEE Int. Conf. Multimedia and Expo. 2009 (ICME'09), New York, USA, pp. 874-877.
  (paper)
  
  
• H.-T. Cheng, Y.-H. Yang, Y.-C. Lin, and H.-H. Chen,
  "Multimodal structure segmentation and analysis of music using audio and textual information,"
  in Proc. IEEE Int. Symp. Circuits and Systems 2009 (ISCAS'09), Taipei, Taiwan, pp. 1677-1680.
  (paper) [project page, include dataset]
  
  

2008

• Y.-H. Yang, P.-T. Wu, C.-W. Lee, K.-H. Lin, W.-H. Hsu, and H.-H. Chen,
  "ContextSeer: Context search and recommendation at query time for shared consumer photos,"
  in Proc. ACM Multimedia 2008 (MM'08) (oral, content track, accept rate=21%), pp. 199-208.
  (paper, slides) [project page, include dataset]
  
  
• P.-T. Wu, Y.-H. Yang, K.-T. Chen, W.-H. Hsu, T.-H. Li, and C.-J. Lee,
  "Keyword-based concept search on consumer photos by web-based kernel function,"
  in Proc. ACM Multimedia 2008 (MM'08) (poster, content track), pp. 651-654.
  (paper)
  
  
• Y.-H. Yang, Y.-C. Lin, H.-T. Cheng, and H.-H. Chen,
  "Mr.Emo: Music retrieval in the emotion plane,"
  in Proc. ACM Multimedia 2008 (MM'08) (demonstration), pp. 1003-1004.
  (paper, demo)
  
  
• T.-L. Wu et al,
  "Interactive content presenter based on expressed emotion and physiological feedback,"
  in Proc. ACM Multimedia 2008 (MM'08) (demonstration), pp. 1009-1010.
  (paper, demo)
  
  
• Y.-H. Yang, Y.-C. Lin, H.-T. Cheng, I.-B. Liao, Yeh-Chin Ho, and H.-H. Chen,
  "Toward multi-modal music emotion classification,"
  in Proc. Pacific-Rim Conf. Multimedia 2008 (PCM'08), pp. 70-79.
  (paper, slides)
  
  
• H.-T. Cheng, Y.-H. Yang, Y.-C. Lin, I.-B. Liao, and H.-H. Chen,
  "Automatic chord recognition for music classification and retrieval,"
  in Proc. IEEE Int. Conf. Multimedia and Expo. 2008 (ICME'08), Hannover, Germany, pp. 1505-1508.
  (paper)
  
  
• Y.-H. Yang and W.-H. Hsu,
  "Video search reranking via online ordinal reranking,"
  in Proc. IEEE Int. Conf. Multimedia and Expo. 2008 (ICME'08), Hannover, Germany.
  (paper)
  
  

2007

• M.-F. Weng, C.-K. Chen, Y.-H. Yang, R.-E. Fan, Y.-T. Hsieh, Y.-Y. Chunag, W.-H. Hsu, and C.-J. Lin,
  "The NTU toolkit and framework for high-level feature detection at TRECVID 2007",
  in NIST TRECVID Workshop 2007 (TRECVID'07).
  (paper, slides, tv07 website)
  
  
• C.-C. Ma, Y.-H. Yang, and W. Hsu,
  "Image thumbnailing via multi-view face detection and saliency analysis", in Proc. Conf. Visual Information Processing (VIP'07).
  (paper) [project page, include dataset]
  
  
• Y.-H. Yang, Y.-F. Su, Y.-C. Lin, and H.-H. Chen,
  "Music emotion recognition: The role of individuality,"
  in Proc. ACM SIGMM Int. Workshop on Human-centered Multimedia 2007, in conjunction with ACM Multimedia (ACM MM/HCM'07), Augsburg, Germany, pp. 13-21.
  (abstract, paper, slides) [project page(include dataset and the software 'AnnoEmo')]
  
  
• Y.-H. Yang, Y.-C. Lin, Y.-F. Su, and H.-H. Chen,
  "Music emotion classification: A regression approach,"
  in Proc. IEEE Int. Conf. Multimedia and Expo. 2007 (ICME'07), Bejing, China, pp. 208-211.
  (abstract, paper, poster) [project page(include dataset)]
  
  

2006

• Y.-H. Yang, C.-C Liu, and H.-H. Chen,
  "Music emotion classification: A fuzzy approach,"
  in Proc. ACM Multimedia 2006 (ACM MM'06), Santa Barbara, CA, USA, pp. 81-84. (short paper)(with travel grant)
  (abstract, paper) [project page]
  
  
• C.-C Liu, Y.-H. Yang, P.-H. Wu, and H.-H. Chen,
  "Detecting and classifying emotion in popular music,"
  in Proc. 9th Joint Int. Conf. Information Sciences / 7th Int. Conf. Computer Vision, Pattern Recognition and Image Processing 2006 (JCIS/CVPRIP'06), Kaohsiung, Taiwan, pp. 996-999.
  (abstract, paper)
  
  
• Y.-H. Yang, M.-T Lu, and H.-H. Chen,
  "Smooth playout control for video streaming over error-prone channels,"
  in Proc. IEEE Int. Symp. Multimedia 2006 (ISM'06), San Diego, CA, USA, pp. 415-418.
  (abstract, paper)
  
  
  

(last update: 2011/8/11)