Paper in IROS 2012: “Linguistic Transfer of Human Assembly Tasks to Robots”

Linguistic Transfer of Human Assembly Tasks to Robots

  • N. Dantam, I. Essa, and M. Stilman (2012), “Linguistic Transfer of Human Assembly Tasks to Robots,” in Proceedings of Intelligent Robots and Systems (IROS), 2012. [PDF] [DOI] [BIBTEX]
    @InProceedings{    2012-Dantam-LTHATR,
      author  = {N. Dantam and I. Essa and M. Stilman},
      booktitle  = {Proceedings of Intelligent Robots and Systems
      doi    = {10.1109/IROS.2012.6385749},
      pdf    = {}
      title    = {Linguistic Transfer of Human Assembly Tasks to
      year    = {2012}


We demonstrate the automatic transfer of an assembly task from human to robot. This work extends efforts showing the utility of linguistic models in verifiable robot control policies by now performing real visual analysis of human demonstrations to automatically extract a policy for the task. This method tokenizes each human demonstration into a sequence of object connection symbols, then transforms the set of sequences from all demonstrations into an automaton, which represents the task-language for assembling a desired object. Finally, we combine this assembly automaton with a kinematic model of a robot arm to reproduce the demonstrated task.

Presented at: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2012), October 7-12, 2012 Vilamoura, Algarve, Portugal.


Tags: , , , , | Categories: 0205507, Activity Recognition, IROS/ICRA, Mike Stilman, Robotics | Date: October 7th, 2012 | By: Irfan Essa |

No Comments »

You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

Leave a Reply