Seamless natural communication between humans and machines
Seamless Natural Communication between Humans and Machines
Presented by Zhou Yu (Columbia University)

Dialog systems such as Alexa and Siri are everywhere in our lives. They can complete tasks such as booking flights, making restaurant reservations and training people for interviews. However, currently deployed dialog systems are rule-based and cannot generalize to different domains, let alone flexible dialog context tracking. We will first discuss how to design studies to collect realistic dialogs through a crowdsourcing platform. Then we introduce a dialog model that utilizes limited data to achieve good performance by leveraging multi-task learning and semantic scaffolds. We further improve the model's coherence by tracking both semantic actions and conversational strategies from dialog history using finite-state transducers. Finally, we analyze some ethical concerns and human factors in dialog system deployment. All our work comes together to build seamless natural communication between humans and machines.
SoDa Labs webinar series
The SoDa Labs webinar series provides a platform for researchers around the world to present work that uses novel and alternative data and/or tools from data science and beyond to answer social science questions.
Event Details
- Date:
- 30 March 2021 at 9:00 am – 10:00 am
- Venue:
- Online
- Categories:
- Economics; Econometrics and Business Statistics; General
Description
Seamless Natural Communication between Humans and Machines
Presented by Zhou Yu (Columbia University)

Dialog systems such as Alexa and Siri are everywhere in our lives. They can complete tasks such as booking flights, making restaurant reservations and training people for interviews. However, currently deployed dialog systems are rule-based and cannot generalize to different domains, let alone flexible dialog context tracking. We will first discuss how to design studies to collect realistic dialogs through a crowdsourcing platform. Then we introduce a dialog model that utilizes limited data to achieve good performance by leveraging multi-task learning and semantic scaffolds. We further improve the model's coherence by tracking both semantic actions and conversational strategies from dialog history using finite-state transducers. Finally, we analyze some ethical concerns and human factors in dialog system deployment. All our work comes together to build seamless natural communication between humans and machines.
SoDa Labs webinar series
The SoDa Labs webinar series provides a platform for researchers around the world to present work that uses novel and alternative data and/or tools from data science and beyond to answer social science questions.
Event Contact
- Name
- SoDaLabs@monash.edu
- Phone
- Organisation