Publications

2014

• Tuning accessibility of referring expressions in situated dialogue [html]
  Ellen Gurman Bard, Robin Hill, Mary Ellen Foster, and Manabu Arai
  Language, Cognition, and Neuroscience, 29(8):928-949, doi:10.1080/23273798.2014.895845, 2014.
• A Framework for 3D Object Identification and Tracking [pdf]
  Georgios Chliveros, Rui P. Figueiredo, Plinio Moreno, Maria Pateraki, Alexandre Bernardino, Jose Santos-Victor, and Panos Trahanias
  In Proceedings of the 9th International Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP2014), doi:10.5220/0004751506720677, Lisbon, Portugal, 2014.
• Validating Attention Classifiers for Multi-Party Human-Robot Interaction [pdf]
  Mary Ellen Foster
  In Proceedings of the HRI 2014 Workshop on Attention Models in Robotics, Bielefeld, Germany, 2014.
• Representing Uncertainty for Dynamic Multi-Party Social Human-Robot Interaction [pdf]
  Mary Ellen Foster
  In Proceedings of the Workshop of the UK Planning and Scheduling Special Interest Group (PlanSIG 2013), Edinburgh, Scotland, UK, 2014.
• Task-Based Evaluation of Context-Sensitive Referring Expressions in Human-Robot Dialogue [html]
  Mary Ellen Foster, Manuel Giuliani, and Amy Isard
  Language, Cognition, and Neuroscience, 29(8):1018-1034, doi:10.1080/01690965.2013.855802, 2014.
• Towards Action Selection Under Uncertainty for a Socially Aware Robot Bartender [html]
  Mary Ellen Foster, Simon Keizer, and Oliver Lemon
  In Proceedings of the 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2014), Late-Breaking Reports, doi:10.1145/2559636.2559805, Bielefeld, Germany, 2014.
• Planning for Social Interaction with Sensor Uncertainty [pdf]
  Mary Ellen Foster and Ronald P. A. Petrick
  In Proceedings of the ICAPS 2014 Scheduling and Planning Applications woRKshop (SPARK), pages 19-20, 2014.
• Planning Perception and Action for Cognitive Mobile Manipulators [pdf]
  Andre Gaschler, Svetlana Nogina, Ronald P. A. Petrick, and Alois Knoll
  In Proceedings of SPIE Volume 9025 - Intelligent Robots and Computer Vision XXXI: Algorithms and Techniques, 2014.
• Intuitive Robot Tasks with Augmented Reality and Virtual Obstacles
  Andre Gaschler, Maximilian Springer, Markus Rickert, and Alois Knoll
  IEEE International Conference on Robotics and Automation (ICRA), 2014.
• Using Ellipsis Detection and Word Similarity for Transformation of Spoken Language into Grammatically Valid Sentences
  Manuel Giuliani, Thomas Marschall, and Amy Isard
  In Proceedings of the 15th Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL 2014), Philadelphia, USA, 2014.
• Handling uncertain input in multi-user human-robot interaction [pdf]
  Simon Keizer, Mary Ellen Foster, Andre Gaschler, Manuel Giuliani, Amy Isard, and Oliver Lemon
  In Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication (IEEE RO-MAN 2014), Edinburgh, Scotland, UK, 2014.
• Machine Learning for Social Multi-Party Human-Robot Interaction
  Simon Keizer, Mary Ellen Foster, and Zhuoran Wang
  ACM Transactions on Intelligent Interactive Systems, 4(3), in press.
• Evaluating a social multi-user interaction model using a Nao robot [pdf]
  Simon Keizer, Pantelis Kastoris, Mary Ellen Foster, Amol Deshmukh, and Oliver Lemon
  In Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication (IEEE RO-MAN 2014), Edinburgh, Scotland, UK, 2014.
• Ghost-in-the-Machine: Initial Results [html]
  Sebastian Loth, Manuel Giuliani, and Jan P. de Ruiter
  In Proceedings of the 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2014), doi:10.1145/2559636.2563696, Bielefeld, Germany, 2014.
• Application of Dynamic Distributional Clauses for Multi-hypothesis Initialization in Model-based Object Tracking [pdf]
  D. Nitti, G. Chliveros, M. Pateraki, L. De Raedt, E. Hourdakis, and P. Trahanias
  In Proceedings of the 9th International Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP2014), doi:10.5220/0004654002560261, Lisbon, Portugal, 2014.
• Visual estimation of pointed targets for robot guidance via fusion of face pose and hand orientation [html]
  Maria Pateraki, Haris Baltzakis, and Panos Trahanias
  Computer Vision and Image Understanding, 120:1-13, doi:10.1016/j.cviu.2013.12.006, 2014.
• Extending the Knowledge-Level Approach to Planning for Social Interaction [pdf]
  Ronald P. A. Petrick
  In Proceedings of the Workshop of the UK Planning and Scheduling Special Interest Group (PlanSIG 2013), Edinburgh, Scotland, UK, 2014.
• Extending Knowledge-Level Contingent Planning for Robot Task Planning [pdf]
  Ronald P. A. Petrick and Andre Gaschler
  In Proceedings of the ICAPS 2014 Workshop on Planning and Robotics (PlanRob), pages 157-165, 2014.
• Robust Articulated Upper Body Pose Tracking under Severe Occlusions
  Markos Sigalas, Maria Pateraki, and Panos Trahanias
  In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Chicago, USA, 2014.
• Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot
  Abolfazl Zaraki, Daniele Mazzei, Manuel Giuliani, and Danilo De Rossi
  IEEE Transactions on Human-Machine Systems, 2(44):157-168, doi:10.1109/THMS.2014.2303083, 2014.

2013

• Demand Characteristics as a Tool for Evaluating the Design of Collaborative Tasks [pdf]
  Ed Baggs
  In Proceedings of the SemDial 2013 Workshop on the Semantics and Pragmatics of Dialogue (DialDam), Amsterdam, Netherlands, 2013.
• A task for collaborative detection of structure in letter strings [pdf]
  Ed Baggs
  Poster presented at the 5th Joint Action Meeting, Berlin, 2013.
• Unsupervised Learning Spatio-temporal Features for Human Activity Recognition from RGB-D Video Data
  Guang Chen, Feihu Zhang, Manuel Giuliani, Christian Buckl, and Alois Knoll
  In Proceedings of the International Conference on Social Robotics 2013 (ICSR 2013), Bristol, UK, 2013.
• Robust multi-hypothesis 3D object pose tracking [html]
  Georgios Chliveros, Maria Pateraki, and Panos Trahanias
  In Proceedings of the 9th International Conference on Computer Vision Systems (ICVS) in Lecture Notes in Computer Science, Volume 7963, St. Petersburg, Russia, doi:10.1007/978-3-642-39402-7_24, pages 234-243, 2013.
• How Can I Help You? Comparing Engagement Classification Strategies for a Robot Bartender [pdf]
  Mary Ellen Foster, Andre Gaschler, and Manuel Giuliani
  In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI 2013), doi:10.1145/2522848.2522879, Sydney, Australia, 2013.
• Robot Task and Motion Planning with Sets of Convex Polyhedra [pdf]
  Andre Gaschler, Ronald P. A. Petrick, Torsten Kröger, Oussama Khatib, and Alois Knoll
  In RSS 2013 Workshop on Combined Robot Motion Planning and AI Planning for Practical Applications, Berlin, Germany, 2013.
• Robot Task Planning with Contingencies for Run-time Sensing [pdf]
  Andre Gaschler, Ronald P. A. Petrick, Torsten Kröger, Alois Knoll, and Oussama Khatib
  In ICRA 2013 Workshop on Combining Task and Motion Planning, Karlsruhe, Germany, 2013.
• KVP: A Knowledge of Volumes Approach to Robot Task Planning [pdf]
  Andre Gaschler, Ronald Petrick, Manuel Giuliani, Markus Rickert, and Alois Knoll
  In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2013), doi:10.1109/IROS.2013.6696354, pages 202-208, Tokyo, Japan, 2013.
• Using Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction [html]
  Manuel Giuliani and Alois Knoll
  In International Journal of Social Robotics, 5(3):345-356, doi:10.1007/s12369-013-0194-y, 2013.
• Comparing Task-Based and Socially Intelligent Behaviour in a Robot Bartender [pdf]
  Manuel Giuliani, Ronald P. A. Petrick, Mary Ellen Foster, Andre Gaschler, Amy Isard, Maria Pateraki, and Markos Sigalas
  In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI 2013), doi:10.1145/2522848.2522869, Sydney, Australia, 2013.
• Evaluating a socially intelligent interactive bartender robot system
  Pantelis Kastoris
  MSc Thesis, School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, Scotland, UK, 2013.
• Training and evaluation of an MDP model for social multi-user human-robot interaction [pdf]
  Simon Keizer, Mary Ellen Foster, Oliver Lemon, Andre Gaschler, and Manuel Giuliani
  In Proceedings of the 14th Annual SIGdial Meeting on Discourse and Dialogue, Metz, France, 2013.
• User evaluation of a multi-user social interaction model implemented on a Nao robot [pdf]
  Simon Keizer, Pantelis Kastoris, Mary Ellen Foster, Amol Deshmukh, and Oliver Lemon
  In Proceedings of the ICSR 2013 Workshop on Robots in Public Spaces, Bristol, UK, 2013.
• Automatic detection of service initiation signals used in bars [html]
  Sebastian Loth, Kerstin Huth, and Jan de Ruiter
  In Frontiers in Cognitive Science, 4(557), doi:10.3389/fpsyg.2013.00557, 2013.
• Seeking attention: Testing a model of initiating service interactions [html]
  Sebastian Loth, Kerstin Huth, and Jan de Ruiter
  In Service Encounters and Cross Cultural Symposium, Seville, Spain, 2013.
• Learning Knowledge-Level Domain Dynamics [pdf]
  Kira Mourão and Ronald P. A. Petrick
  In ICAPS 2013 Workshop on Planning and Learning (PAL), pages 23-31, Rome, Italy, 2013.
• Visual human-robot communication in social settings [pdf]
  Maria Pateraki, Markos Sigalas, Georgios Chliveros, and Panos Trahanias
  In ICRA 2013 Workshop on Semantics, Identification and Control of Robot-Human-Environment Interaction, Karlsruhe, Germany, 2013.
• Planning for Social Interaction in a Robot Bartender Domain [pdf]
  Ronald P. A. Petrick and Mary Ellen Foster
  In Proceedings of the International Conference on Automated Planning and Scheduling (ICAPS 2013), Special Track on Novel Applications, pages 389-397, Rome, Italy, 2013.
• Plan-Based Social Interaction with a Robot Bartender [pdf]
  Ronald P. A. Petrick and Mary Ellen Foster
  In Proceedings of the ICAPS 2013 Application Showcase, pages 10-13, Rome, Italy, 2013.
• Robust Model-based 3D Torso Pose Estimation in RGB-D sequences [pdf]
  Markos Sigalas, Maria Pateraki, Iason Oikonomidis, and Panos Trahanias
  In Proceedings of the 2nd IEEE Workshop on Dynamic Shape Capture and Analysis, held as part of ICCV 2013, doi:10.1109/ICCVW.2013.49, Sydney, Australia, 2013.
• Upper body pose estimation and tracking
  Markos Sigalas, Maria Pateraki, and Panos Trahanias
  Demonstration Session at ICCV 2013, Sydney, Australia, 2013.
• Model-based 3D Torso Pose Estimation from RGB-D data
  Markos Sigalas, Maria Pateraki, and Panos Trahanias
  Demonstration Session at Computer Vision Pattern Recognition (CVPR) 2013, Portland, Oregon, USA, 2013.
• A Simple and Generic Belief Tracking Mechanism for the Dialog State Tracking Challenge: On the believability of observed information [pdf]
  Zhuoran Wang and Oliver Lemon
  In Proceedings of the 14th Annual SIGdial Meeting on Discourse and Dialogue, pages 423-432, Metz, France, 2013.

2012

• Social Robotics using NAO and Kinect [html]
  Arash Akbarinia, Corina Barbalata, Raquel Gil, and Eduardo Tusa
  MSc project, European Masters in Computer Vision and Robotics (VIBOT), Heriot-Watt University, 2012.
• Multimodal Grammar Implementation [pdf]
  Katya Alahverdzhieva, Dan Flickinger, and Alex Lascarides
  In Proceedings of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), pages 582-586, Montreal, QC, Canada, 2012.
• Translation of Natural Language to Robot Commands using Combinatory Categorial Grammar
  Stjepan Bakrac
  Bachelor Thesis, Technische Universität München, Munich, Germany, 2012.
• Visual tracking of hands, faces and facial features of multiple persons [pdf]
  Haris Baltzakis, Maria Pateraki, and Panos Trahanias
  Machine Vision and Applications, 23(6):1141-1157, doi:10.1007/s00138-012-0409-5, 2012.
• A statistical spoken dialogue system using complex user goals and value directed compression [pdf]
  Paul A. Crook, Zhuoran Wang, Xingkun Liu, and Oliver Lemon
  In 13th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2012), Avignon, France, 2012.
• Two People Walk Into a Bar: Dynamic Multi-Party Social Interaction with a Robot Agent [pdf]
  Mary Ellen Foster, Andre Gaschler, Manuel Giuliani, Amy Isard, Maria Pateraki, and Ronald P. A. Petrick
  In 14th ACM International Conference on Multimodal Interaction (ICMI 2012), doi:10.1145/2388676.2388680, Santa Monica, USA, 2012.
• Machine Learning of Social States and Skills for Multi-Party Human-Robot Interaction [pdf]
  Mary Ellen Foster, Simon Keizer, Zhuoran Wang and Oliver Lemon
  In Proceedings of the ECAI 2012 Workshop on Machine Learning for Interactive Systems (MLIS2012), Montpellier, France, 2012.
• Modelling state of interaction from head poses for social human-robot interaction [pdf]
  Andre Gaschler, Kerstin Huth, Manuel Giuliani, Ingmar Kessler, Jan de Ruiter, and Alois Knoll
  In Proceedings of the Gaze in Human-Robot Interaction Workshop held at the 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2012), Boston, USA, 2012.
• Social Behavior Recognition Using Body Posture and Head Pose for Human-Robot Interaction [pdf]
  Andre Gaschler, Sören Jentzsch, Manuel Giuliani, Kerstin Huth, Jan de Ruiter, and Alois Knoll
  International Conference on Intelligent Robots and Systems (IROS 2012), 2012.
• Combining Classical and Embodied Multimodal Fusion for Human-Robot Interaction [pdf]
  Manuel Giuliani and Jan de Ruiter
  In Proceedings of Embodied and Situated Language Processing (ESLP 2012), Newcastle Upon Tyne, United Kingdom, 2012.
• Insights from the bar: A model of interaction [pdf]
  Kerstin Huth, Sebastian Loth, and Jan de Ruiter
  In Proceedings of Formal and Computational Approaches to Multimodal Communication, Opole, Poland, 2012.
• Ordering a beer without your hands; the meaning of not gesturing [pdf]
  Kerstin Huth and Jan de Ruiter
  In Proceedings of the 5th Conference of the International Society for Gesture Studies (ISGS 5), Lund, Sweden, 2012.
• Rhetorical Structure for Natural Language Generation in Dialogue [pdf]
  Amy Isard and Colin Matheson
  In Proceedings of SemDial 2012 (SeineDial): The 16th Workshop on the Semantics and Pragmatics of Dialogue, pages 161-162, 2012.
• User Simulation in the Development of Statistical Spoken Dialogue Systems [pdf]
  Simon Keizer, Stéphane Rossignol, Senthilkumar Chandramohan, and Olivier Pietquin
  In Oliver Lemon and Olivier Pietquin, editors, Data-Driven Methods for Adaptive Spoken Dialogue Systems, doi:10.1007/978-1-4614-4803-7_4, pages 39-73. Springer New York, 2012.
• Intuitive Robot Programming by Trajectory Recording and Editing
  Kai Klinker
  Bachelor Thesis, Technische Universität München, Munich, Germany, 2012.
• Analysis of Spoken Language for Human-Robot-Interaction Based on Combinatory Categorial Grammar and WordNet
  Thomas Marschall
  Bachelor Thesis, Technische Universität München, Munich, Germany, 2012.
• Designing a restaurant assistance Robot - Involving Engagement of Multiple parties in conversation [pdf]
  Pratheep Paranthaman
  MSc in Artificial Intelligence, School of Mathematical and Computer Science, Heriot-Watt University, Edinburgh, Scotland, United Kingdom, 2012.
• Using Dempster's rule of combination to robustly estimate pointed targets [pdf]
  Maria Pateraki, Haris Baltzakis, and Panos Trahanias
  In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), St. Paul, MN, USA, 2012.
• What Would You Like to Drink? Recognising and Planning with Social States in a Robot Bartender Domain [pdf]
  Ronald P. A. Petrick and Mary Ellen Foster
  In Proceedings of the International Cognitive Robotics Workshop (CogRob 2012) at AAAI 2012, pages 69-76, Toronto, ON, Canada, 2012.
• Knowledge-Level Planning for Task-Based Social Interaction [pdf]
  Ronald P. A. Petrick and Mary Ellen Foster
  In Workshop of the UK Planning and Scheduling Special Interest Group (PlanSIG 2012), Middlesbrough, United Kingdom, 2012.
• Social State Recognition and Knowledge-Level Planning for Human-Robot Interaction in a Bartender Domain [pdf]
  Ronald P. A. Petrick, Mary Ellen Foster, and Amy Isard
  In Proceedings of the AAAI 2012 Workshop on Grounding Language for Physical Systems, pages 32-38, Toronto, ON, Canada, 2012.
• A model of intentional communication: AIRBUS (Asymmetric Intention Recognition with Bayesian Updating of Signals) [pdf]
  J.P. de Ruiter and Chris Cummins
  In Proceedings of SemDial 2012 (SeineDial): The 16th Workshop on the Semantics and Pragmatics of Dialogue, pages 149-150, 2012.
• Augmented Reality-supported Robot Visualization and Development
  Daniel Seidl
  Master's Thesis, Technische Universität München, Munich, Germany, 2012.
• Automated Planning for Natural Language Robot Dialogue
  Vidya Sharma
  MSc Project, School of Informatics, University of Edinburgh, Edinburgh, Scotland, United Kingdom, 2012.
• Depth-based Object Recognition for Robot Grasp Planning
  Sabine Thürauf
  Bachelor Thesis, Technische Universität München, Munich, Germany, 2012.
• A nonparametric Bayesian approach to learning multimodal interaction management [pdf]
  Zhuoran Wang and Oliver Lemon
  In Spoken Language Technology Workshop (SLT), doi:10.1109/SLT.2012.6424162, pages 1-6, 2012.
• Time-Dependent Infinite POMDPs for Planning Real-World Multimodal Interactions [pdf]
  Zhuoran Wang and Oliver Lemon
  In ESSLLI Workshop on Formal and Computational Approaches to Multimodal Communication, Opole, Poland, 2012.
• Calibration of a physics-based model of an anthropomimetic robot using evolution strategies [pdf]
  Steffen Wittmeier, Andre Gaschler, Michael Jäntsch, Konstantinos Dalamagkidis, and Alois Knoll
  In Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on, pages 445-450, 2012.

2011

• An HPSG approach to synchronous speech and deixis [pdf]
  Katya Alahverdzhieva and Alex Lascarides
  In S. Mueller, editor, Proceedings of the 18th International Conference on Head-Driven Phase Structure Grammar (HPSG 2011), Seattle, USA, 2011.
• Integration of speech and deictic gesture in a multimodal grammar [pdf]
  Katya Alahverdzhieva and Alex Lascarides
  In Proceedings of Traitement Automatique de Langues Naturelles (TALN 2011), Montpellier, France, 2011.
• Lossless value directed compression of complex user goal states for statistical spoken dialogue systems [pdf]
  Paul A. Crook and Oliver Lemon
  In Proceedings of the 12th Annual Conference of the International Speech Communication Association (Interspeech 2011), Florence, Italy, 2011.
• Don't look now: The relationship between mutual gaze, task performance and staring in Second Life [pdf]
  Sara Dalzel-Job, Jon Oberlander, and Tim J. Smith
  In Proceedings of the 33rd Annual Conference of the Cognitive Science Society, pages 832-837, Boston, 2011.
• Visual motion capturing for kinematic model estimation of a humanoid robot [pdf]
  Andre Gaschler
  In Rudolf Mester and Michael Felsberg, editors, Pattern Recognition, 33rd DAGM Symposium, volume 6835 of Lecture Notes in Computer Science, pages 438-443, Frankfurt, Germany, 2011.
• Evaluating supportive and instructive robot roles in human-robot interaction [pdf]
  Manuel Giuliani and Alois Knoll
  In Proceedings of the International Conference on Social Robotics 2011 (ICSR 2011), Amsterdam, Netherlands, 2011.
• Wie man ein bier bestellt
  Kerstin Huth
  MA thesis, Fakultaet fuer Linguistik und Literaturwissenschaft, Universitaet Bielefeld, Bielefeld, Germany, 2011.
• "The day after the day after tomorrow?" A machine learning approach to adaptive temporal expression generation: training and evaluation with real users [pdf]
  Srinivasan Janarthanam, Helen Hastie, Oliver Lemon, and Xingkun Liu
  In Proceedings of the SIGDIAL 2011 Conference, pages 142-151, Portland, Oregon, 2011.
• Kinect-enabled activity recognition of multiple human actors for a service robot
  Soeren Jentzsch
  Bachelor thesis, Technische Universitaet Muenchen, Germany, 2011.
• Visuelle erkennung von gesicht und gesichtsorientierung fuer ein szenario der mensch-roboterinteraktion
  Ingmar Kessler
  Bachelor thesis, Technische Universitaet Muenchen, Germany, 2011.
• An integrated approach for visual tracking of hands, faces and facial features [pdf]
  Maria Pateraki, Haris Baltzakis, and Panos Trahanias
  In Proceedings of the Workshop on Measuring and Understanding Human Movements and Emotions, held within the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, 2011.
• Visual estimation of pointed targets for robot guidance via fusion of face pose and hand orientation [pdf]
  Maria Pateraki, Haris Baltzakis, and Panos Trahanias
  In Proceedings of the IEEE Workshop on Challenges and Opportunities in Robot Perception at ICCV 2011, 2011.
• Visual tracking of hands, faces and facial features as a basis for human-robot communication [pdf]
  Maria Pateraki, Haris Baltzakis, and Panos Trahanias
  In Proceedings of the Workshop on Visual Tracking and Omnidirectional Vision, held within the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), San Fransisco, USA, 2011.
• An extension of knowledge-level planning to interval-valued functions [pdf]
  Ronald P. A. Petrick
  In Proceedings of the AAAI 2011 Workshop on Generalized Planning, San Francisco, USA, 2011.
• Knowledge, action, and Cartesian situations in the situation calculus [pdf]
  Ronald P. A. Petrick
  In Gerhard Lakemeyer and Sheila A. McIlraith, editors, Knowing, Reasoning, and Acting: Essays in Honour of Hector J. Levesque. College Publications, 2011.
• Integrating the horizontal and vertical cultural transmission of novel communication systems [pdf]
  Carrie Theisen-White, Simon Kirby, and Jon Oberlander
  In Proceedings of the 33rd Annual Conference of the Cognitive Science Society, pages 956-961, Boston, USA, 2011.

• Top
• james-project.eu
• Results