About

Zhaojun Yang is a Ph.D. candidate at Signal Analysis and Interpretation Laboratory (SAIL), University of Southern California (USC). She received her B.E. Degree in Electrical Engineering from University of Science and Technology of China (USTC) in 2009 and M.Phil. Degree in Systems Engineering and Engineering Management from Chinese University of Hong Kong (CUHK) in 2011. She has been awarded the Annenberg Fellowship (2011 - 2015). Her paper (with S. Narayanan), "Lightly-Supervised Utterance-Level Emotion Identification Using Latent Topic Modeling of Multimodal Words", has won the Best Student Paper Award at ICASSP, 2016.

Her research lies in the intersection of Affective computing, Machine learning and Human-centered multimodal signal processing, focusing on understanding, analyzing, and modeling human-centered behavioral informatics that relate to the affective processes underlying human interactions. Her research goal is to design and develop human-centric multimodal systems that can recognize and interpret the emotional state of human users and can simulate appropriate verbal and non-verbal cues in response to those emotions.

[Curriculum Vitae] (Last updated: June 2016)

Publications

(Google Scholar)

Journal Articles

  • Z. Yang, S. Narayanan, "Modeling Dynamics of Expressive Body Gestures In Dyadic Interactions", IEEE Transactions on Affective Computing, 2016. [PDF]

  • T. Guha, Z. Yang, R. Grossman, S. Narayanan, "Reduced Complexity in Expressive Facial Dynamics of Children with Autism", IEEE Transactions on Affective Computing, 2016.

  • A. Metallinou, Z. Yang, C-C. Lee, C. Busso, S. Carnicke, S. Narayanan, "The USC CreativeIT Database of Multimodal Dyadic Interactions: From Speech and Full Body Motion Capture to Continuous Emotional Annotations", Journal of Language Resources and Evaluation, 2015. [PDF]

  • Z. Yang, A. Metallinou, S. Narayanan, "Analysis and Predictive Modeling of Body Language Behavior in Dyadic Interactions from Multimodal Interlocutor Cues", IEEE Transactions on Multimedia, vol. 16, pp. 1766 - 1778, 2014. [PDF]

  • Z. Yang, G. Levow, H. Meng, "Predicting User Satisfaction in Spoken Dialog System Evaluation With Collaborative Filtering", IEEE Journal of Selected Topics in Signal Processing, vol. 6, pp. 971 - 981, 2012. [PDF]

  • Book Chapter

  • Z. Yang, G. Levow, H. Meng, "Crowdsourcing for Spoken Dialog System Evaluation", in Crowdsourcing for Speech Processing: Applications to Data Collection, Transcription, and Assessment, John Wiley & Sons. (in press) [PDF]

  • Conference Proceedings

  • Z. Yang, S. Narayanan, "Analyzing Temporal Dynamics of Dyadic Synchrony in Affective Interactions", Annual Conference of the International Speech Communication Association (Interspeech), San Francisco, CA, 2016. [PDF] [Oral]

  • Z. Yang, S. Narayanan, "Lightly-Supervised Utterance-Level Emotion Identification Using Latent Topic Modeling of Multimodal Words", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China, 2016. (Best Student Paper) [PDF] [Oral]

  • Z. Yang, S. Narayanan, "Modeling Mutual Influence of Multimodal Behavior in Affective Dyadic Interactions", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia, 2015. [PDF] [Oral]

  • T. Guha, Z. Yang, A. Ramakrishna, R. Grossman, D. Hedley, S. Lee, S. Narayanan, "ON Quantifying Facial Expression-Related Atypicality Of Children With Autism Spectrum Disorder", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia, 2015. [PDF] [Oral]

  • Z. Yang, S. Narayanan, "Analysis of Emotional Effect on Speech-Body Gesture Interplay", Annual Conference of the International Speech Communication Association (Interspeech), Singapore, 2014. [PDF] [Oral]

  • R. Gupta, S. Ananthakrishnan, Z. Yang, S. Narayanan, "Variable Span Disfluency Detection in ASR Transcripts", Annual Conference of the International Speech Communication Association (Interspeech), Singapore, 2014. [Oral]

  • Z. Yang, A. Ortega, S. Narayanan, "Gesture Dynamics Modeling for Attitude Analysis Using Graph Based Transform", ICIP, Paris, France, 2014. [PDF]

  • Z. Yang, A. Metallinou, E. Erzin, S. Narayanan, "Analysis of Interaction Attitudes Using Data-Driven Hand Gesture Phrases", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy, 2014. [PDF]

  • Z. Yang, V. Ramanarayanan, D. Byrd, S. Narayanan, "The Effect of Word Frequency and Lexical Class on Articulatory-Acoustic Coupling", Annual Conference of the International Speech Communication Association (Interspeech), Lyon, France, 2013. [PDF]

  • Z. Yang, A. Metallinou, S. Narayanan, "Toward Body Language Generation in Dyadic Interaction Settings From Interlocutor Multimodal Cues", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, Canada, 2013. [PDF]

  • Z. Yang, Y. Zhu, B. Li, I. King, G. Levow, H. Meng, "Collection of User Judgments on Spoken Dialog System with Crowdsourcing", Spoken Language Technology, Berkeley, CA, USA, 2010. [PDF]

  • Z. Yang, Y. Zhu, B. Li, I. King, G. Levow, H. Meng, "Collaborative Filtering Model for User Satisfaction Prediction in Spoken Dialog Evaluation", Spoken Language Technology, Berkeley, CA, USA, 2010. [PDF]

  • Y. Zhu, Z. Yang, B. Li, H. Meng, G. Levow, I. King, "Using Finite State Machines for Evaluating Spoken Dialog Systems", Spoken Language Technology, Berkeley, CA, USA, 2010. [PDF]

  • B. Li, Z. Yang, Y. Zhu, H. Meng, G. Levow, I. King, "Predicting User Evaluations of Spoken Dialog Systems Using Semi-Supervised Learning", Spoken Language Technology, Berkeley, CA, USA, 2010. [PDF]
  • Distinctions

    • ICASSP 2016 Best Student Paper
    • NSF Student Travel Grant (2016)
    • Women in Science and Engineering (WiSE) Travel Grant (2014 - 2016)
    • USC Annenberg Fellowship (2011 - 2015)
    • IEEE Signal Processing Society Travel Grant (2015)
    • International Speech Communication Association (ISCA) Grant (2013)
    • CUHK Postgraduate Studentship (2009 - 2011)
    • USTC Outstanding Student Scholarship (2006 - 2008)
    • USTC Outstanding Freshman Scholarship (2005)

    Talks

  • "Analyzing Temporal Dynamics of Dyadic Synchrony in Affective Interactions", Interspeech, September 2016

  • "Analyzing and Modeling Multi-Level Dynamics of Multimodal Behavior in Affective Interactions", SRI International, Princeton, NJ, September 2016

  • "Analyzing and Modeling Multi-Level Dynamics of Multimodal Behavior in Affective Interactions", University of Central Florida, June 2016

  • "Lightly-supervised Utterance-level Emotion Identification Using Latent Topic Modeling Of Multimodal Words", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), April 2016

  • "Modeling Mutual Influence Of Multimodal Behavior In Affective Dyadic Interactions", IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), April 2015

  • Wireless and Mobile Networks Design (EE 579), USC, Guest Lecturer, Spring 2015

  • "Analysis of Emotional Effect on Speech-Body Gesture Interplay", Annual Conference of the International Speech Communication Association (Interspeech), September 2014
  • Teaching

  • Introduction to Digital Signal Processing (EE 483), USC, Teaching Assistant, Fall 2014, Spring 2015

  • Information Systems Analysis and Design (SEG 4570), CUHK, Teaching Assistant, Spring 2011

  • Applied Probability and Statistics (SEG 2430), CUHK, Teaching Assistant, Spring 2010
  • Contact Me

    E-mail: zhaojuny at usc dot edu

    Address:
    3740 McClintock Ave
    Room RTH 318
    University of Southern California
    Los Angeles, CA, 90089