RoboNLP: Grounded Communication for Robotics Workshop at TBD
Dates: TBD

  SCHEDULE         CfP         Important Dates         Invited Speakers         Organization          Previous: Robo-NLP 2017


The embodied, task-oriented aspect of language grounding is an important and timely next research direction following the exciting recent progress in visual language grounding. To realize the long-term goal of robots that we can converse with in our homes, offices, hospitals, and warehouses, it is essential that we develop new techniques for linking language to action in the real world. Can we give instructions to robotic agents to assist with navigation and manipulation tasks in remote settings? Can we talk to robots about the surrounding visual world, and help them interactively learn the language needed to finish a task? We hope to learn about (and begin to answer) these questions in the proposed workshop on Language Grounding for Robotics.

This workshop aims to bring together members of the NLP, robotics, and vision communities to focus on the much-needed task-oriented aspect of language grounding. The confirmed invited speakers, program committee, and organizing committee (see below) consist of researchers who belong to these communities, and who work at the intersection of language, robotics, and vision. Email us at if you have any questions.

Topics of interest for this workshop include, but are not limited to:
  • Aligning and Translating Language to Situated Actions
  • Simulated and Real World Situations
  • Instructions for Navigation
  • Instructions for Articulation
  • Instructions for Manipulation
  • Skill Learning via Interactive Dialogue
  • Language Learning via Grounded Dialogue
  • Language Generation for Embodied Tasks
  • Grounded Knowledge Representations
  • Mapping Language and World
  • Grounded Reinforcement Learning
  • Language-based Game Playing for Grounding
  • Structured and Deep Learning Models for Embodied Language
  • New Datasets for Embodied Language
  • Better Evaluation Metrics for Embodied Language
Format: The proposed format is 6-7 invited speaker talks, several oral paper talks, poster sessions, and a concluding panel with 4-5 of the invited speakers to discuss the concrete future directions, challenges, and collaboration opportunities for this important topic.

Important Dates:

Deadline for submission: TBD
Notification of acceptance: TBD
Deadline for camera-ready version: TBD
Early registration deadline ():
Workshop Date: TBD

Invited Speakers and Panelists:

Dhruv Batra, GaTech/FAIR
Anca Dragan, UC Berkeley
Mary Ellen Foster, Glasgow University
Dilek Hakkani-Tur, Amazon
Cynthia Matuszek, UMBC
Matthias Scheutz, Tufts
Stefanie Tellex, Brown
Andrea Thomaz, UT Austin
David Traum, USC


Jacob Andreas, MIT
Jason Baldridge, Google
Mohit Bansal, UNC Chapel Hill
Yonatan Bisk, Univ of Washington
Asli Celikyilmaz, Microsoft Research
Jesse Thomason, Univ of Washington
Matthew Marge, Army Research Lab
Contact email:

Program Committee:

Dipendra MisraHannaneh HajishirziHongyuan Mei
Jayant KrishnamurthyJivko SinapovJonathan Berant
Joyce ChaiJulia HockenmaierMarcus Rohrbach
Mark YatskarMatt WalterMatthew Hausknecht
Ray MooneySiva ReddyTom Williams
Alane SuhrAnna RohrbachDaniel Fried
Shiqi ZhangJacob ArkinAishwarya Padmakumar
Casey KenningtonKalesha BullardStephanie Lukin
Victor ZhongNatalie PardePreeti Ramaraj
Volkan CirikChris MavrogiannisIan Perera
Felix Gervits

ACL Anti-Harassment Policy