Consulting

Research Topics

Affective Computing and Human-Robot Interaction


Data to Text Generation

Natural Language Generation


Multimodal, Spoken Dialogue and Mobile Systems


  • Mocialov, B., Turner, G., Lohan, K. and Hastie, H.(2017). Towards Continuous Sign Language Recognition with Deep Learning. 2017 IEEE-RAS 17th International Conference on Humanoid Robots (Humanoids) [pdf]/.
  • Nina Dethlefs, Helen Hastie, Heriberto Cuayáhuitl, Yanchao Yu, Verena Rieser and Oliver Lemon. Information Density and Overlap in Spoken Dialogue. In Computer Speech and Language (to appear).
  • David McGookin, Dimitra Gkatzia and Helen Hastie (2015). Supporting Exploratory Navigation for Runners Through Geographic Area Classification with Crowd-Sourced Data. In proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI). Copenhagen, Denmark, 2015 (2015 acceptance rate: 23%) [pdf].
  • Helen Hastie, Marie-aude Aufaure, Panos Alexopoulos, Hugues Bouchard, Heriberto Cuayahuitl, Nina Dethlefs, Milica Gasic, James Henderson, Oliver Lemon, Xingkun Liu, Peter Mika, Nesrine Ben Mustapha, Tim Potter, Verena Rieser, Blaise Thomson, Pirros Tsiakoulis, Yves Vanrompay, Boris Villazon-Terrazas, Majid Yazdani, Steve Young and Yanchao Yu (2014). The PARLANCE mobile application for interactive search in English and Mandarin. In Proceedings of SIGDIAL 2014, 18-20 June, Philadelphia, USA, 2014. [pdf]
  • Helen Hastie, Marie-Aude Aufaure, Panos Alexopoulos, Hughes Bouchard, Heriberto Cuayáhuitl, Nina Dethlefs, Milica Gasic, James Henderson, Oliver Lemon, Xingkun Liu, Peter Mika, Tim Potter, Verena Rieser, Pirros Tsiakoulis, Yves Vanrompay, Boris Villa-Terrazas, Majid Yazdani, Steve Young and Yanchao Yu. 2014. Two Alternative Frameworks for Deploying Spoken Dialogue Systems to Mobile Platforms for Evaluation “in the Wild”. Abstract paper in the Workshop on the Semantics and Pragmatics of Dialogue (SemDial). Edinburgh, Scotland (non-referred) [pdf].
  • Patent:"System and method of handling problematic input during context-sensitive help for multi-modal” US 7,177, 816B2, February 13, 2007."
  • Patent: System and method of context-sensitive help for multi-modal dialog systems. “ US 7,177,815B2. February 13, 2007.
  • Wright Hastie, H., Johnston, M. and Ehlen, P. (2002). Context-sensitive Help for Multimodal Dialogue. In Proc. of ICMI. [pdf]
  • H. Hastie, O. Lemon, N. Dethlefs (2012). Incremental Spoken Dialogue Systems: Tools and Data. In Proceedings of the NAACL Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data, Montréal, Canada. [pdf].
  • Alan W Black, Susanne Burger, Alistair Conkie, Helen Hastie, Simon Keizer, Oliver Lemon, Nicolas Merigaud, Gabriel Parent, Gabriel Schubiner, Blaise Thomson, Jason D. Williams, Kai Yu, Steve Young and Maxine Eskenazi (2011). Spoken Dialog Challenge 2010: Comparison of Live and Control Test Results. In Proc. of SIGDIAL [pdf].
  • Hastie, H., Merigaud, N., Liu, X., and Lemon, O. (2010). “Let’s Go DUDE!” using the Spoken Dialogue Challenge to teach Spoken Dialogue Development. In Proceedings of SLT, SDC Special Session, Berkeley, U.S.A.. [pdf]
  • Hastie, H., Liu, X. and  Lemon, O. (2009) Automatic Generation of Information State Update Dialogue Systems that Dynamically Create Voice XML, as Demonstrated on the iPhone. In Proc of SIGDIAL, London, UK. [pdf]
  • Lemon, O., Liu, X., and Hastie, H. (2008)."Build your own" spoken dialogue systems: automatically generating ISU dialogue systems from business user resources. In Proc of COLING Conference, Manchester, UK. [pdf]

Evaluating Spoken Dialogue Systems and NLG

  • Amanda Cercas Curry, Helen Hastie and Verena Rieser (2017). A Review of Evaluation Techniques for Social Dialogue Systems. ICMI Workshop on Investigating Social Interactions with Artificial Agents. Glasgow. arXiv preprint
  • H.Hastie (2012) Metrics and Evaluation of Spoken Dialogue Systems. In Data-Driven Methods for Adaptive Spoken Dialogue Systems Computational Learning for Conversational Interfaces. Oliver Lemon and Olivier Pietquin (Editors). Springer Link
  • O. Pietquin and H. Hastie (2012) A survey on metrics for the evaluation of user simulations. The Knowledge Engineering Review, Cambridge University Press.  [pdf]
  • Helen Hastie and Anja Belz (2014). A Comparative Evaluation Framework for NLG in Interactive Systems. In Proceedings of the Language Resources and Evaluation Conference (LREC). Reykjavik, Iceland, May 2014. [pdf]
  • A. Belz and H. Hastie (2014). Towards Comparative Evaluation and Shared Tasks for NLG in Interactive Systems. In Srinivas Bangalore and Amanda Stent (eds.) Natural Language Generation in Interactive Systems. Cambridge University Press. [link]
  • Wright Hastie, H., Prasad, R. and Walker, M.A. (2002). What's the Trouble: Automatically Identifying Problematic Dialogs in DARPA Communicator Dialog Systems. In Proc. of ACL.[pdf]
  • Wright Hastie, H., Walker, M.A., and Prasad, R. (2002). Automatic Evaluation: Using a DATE Dialogue Act Tagger for User Satisfaction and Task Completion Prediction. In Proc. of LREC. [pdf]
  • Walker, M. A., Rudnicky, A., Aberdeen, J., Bratt, E., Garofolo, J.  Hastie, H.,   Le, A., Pellom, B., Potamianos, A., Passonneau, R., Prasad, R., Roukos, S., Sanders, G., Seneff, S., and Stallard, D. (2002). DARPA Communicator Evaluation: Progress from 2000 to 2001. In Proc. of ICSLP. [pdf]
  • Walker, M. A., Rudnicky, A., Aberdeen, J., Bratt, E., Garofolo, J.  Hastie, H.,   Le, A., Pellom, B., Potamianos, A., Passonneau, R., Prasad, R., Roukos, S., Sanders, G., Seneff, S., and Stallard, D. (2002). DARPA Communicator: Cross System Results for the 2001 Evaluation. In Proc. of ICSLP. [pdf]
  • Hastie et al. (2013) Demonstration of the PARLANCE system: a data-driven incremental, spoken dialogue system for interactive search. In Proceedings of SIGDIAL [pdf].

Intelligent Interaction for Autonomous Vehicles

  • David A. Robb, Muneeb I. Ahmad, Carlo Tiseo, Simona Aracri, Alistair C. McConnell, Vincent Page, Christian Dondrup, Francisco J. Chiyah Garcia, Hai-Nguyen Nguyen, Èric Pairet, Paola Ardón Ramírez, Tushar Semwal, Hazel M. Taylor, Lindsay J. Wilson, David Lane, Helen Hastie, Katrin Lohan. 2020. Robots in the Danger Zone: Exploring Public Perception through Engagement. In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (HRI’20), March 23–26, 2020, Cambridge, UK. ACM, New York, NY, USA, 10 pages. Forthcoming [link]

  • José Lopes, David R. Robb, Xingkun Liu, and Helen Hastie. 2018. Demonstration of A Social Robot for Control of Remote Auton\ omous Systems. In HRI ’20: ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, USA. Forthcoming [link]

  • Hastie, H., Robb, D. A., Lopes, J., Ahmad, M., Le Bras, P., Liu, X., Petrick, R. P. A., Lohan, K. & Chantler, M. J. 2019. Challenges in Collaborative HRI for Remote Robot Teams. Proceedings of the CHI2019 Workshop on The Challenges of Working on Social Robots that Collaborate with People (SIRCHI2019). 2019 Glasgow, UK.

  • Robb, D. A., Lopes, J. E., Padilla, S., Laskov, A., Liu, X., Willners, J. S., Valeyrie, N., \ Lohan, K. S., Lane, D., Patron, P., Petillot, Y., Chantler, M. J. & Hastie, H. 2019. Exploring Int\ eraction with Remote Autonomous Systems using Conversational Agents. In Proceedings of the 2019 A\ CM Conference on Designing Interactive Systems, DIS'19, 2019 San Diego, CA. ACM Accepted In Press,\ 14pp.

  • Eric Pairet, Paola Ardon, Xingkun Liu, Jose Lopes, Helen Hastie and Katrin Lohan (2019). A Digital Twin for Human-Robot Interaction. In Proceedings of Human Robot Interaction Conference. [pdf] [video]

  • Jose Lopes, David A. Robb, Muneeb Ahmad, Xingkun Liu, Katrin Lohan, Helen Hastie (2019). Towards a Conversational Agent for Remote Robot-Human Teaming. In Proceedings of Human Robot Interaction Conference. [link]

  • José Lopes, David R. Robb, Xingkun Liu, and Helen Hastie. 2018. Demonstration of A Social Robot for Control of Remote Auton\ omous Systems. In HRI ’20: ACM/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, USA. Forthcoming [link]

  • D. A. Robb, J.S. Willners, N. Valeyrie, F.J.C. Garcia, A. Laskov, X. Liu, P. Patron, H. Hastie and Y. Petillot (2018). A Natural Language Interface with Relayed Acoustic Communications for Improved Command and Control of AUVs. In Proceedings of the 2018 IEEE/OES Autonomous Underwater Vehicles Symposium, 2018. arxiv preprint

  • Lopes, J., Lohan, K. and Hastie, H. (2018) 'Symptoms of Cognitive Load in Interactions with a Dialogue System’. In Proceedings of the ICMI Workshop on Modeling Cognitive Processes from Multimodal Data [pdf]

  • Katsakioris, M. M., Laskov, A., Konstas, I. and Hastie, H. 2019. Corpus of Multimodal Interaction for Collaborative Planning. Proceedings of the SpLU-RoboNLP 2019 Workshop in conjunction with the 2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019), Minneapolis, USA.[pdf]

  • David A. Robb, Francisco J. Chiyah Garcia, Atanas Laskov, Xingkun Liu, Pedro Patron\ , and Helen Hastie. 2018. Keep Me in the Loop: Increasing Operator Situation Awareness through\ a Conversational Multimodal Interface. In 2018 International Conference on Multimodal Interac\ tion (ICMI ’18), October 16–20, 2018, Boulder, CO, USA. [link]

  • Francisco J. Chiyah Garcia, David A. Robb, Atanas Laskov, Xingkun Liu, Pedro Patron, and Helen Hastie. (2018) Explainable Autonomy: A Study of Explanation Styles for Building Clear Mental Models through a Multimodal Interface. In Proceedings of the 11th International Conference of Natural Language Generation (INLG), Tilburg, The Netherlands.

  • Helen Hastie, Francisco J. Chiyah Garcia, David A. Robb, Atanas Laskov, and Pedro Patron\ . 2018. MIRIAM: A Multimodal Interface for Explaining the Reasoning Behind Actions of Remote A\ utonomous Systems. In 2018 International Conference on Multimodal Interaction (ICMI ’18), Octo\ ber 16–20, 2018, Boulder, CO, USA. [link]

  • Helen Hastie, Katrin Lohan, Mike Chantler, David A. Robb, Subramanian Ramamoorthy,Ron Petrick, Sethu Vijayakumar and David Lane (2018). The ORCA Hub: Explainable Offshore Robotics through Intelligent Interfaces. Workshop on Explainable Robotic Systems. HRI Conference, Chicago, USA [pdf]\ .

  • Francisco J. Chiyah Garcia, David A. Robb, Xingkun Liu, Atanas Laskov, Pedro Patron, and Helen Hastie. 2018. Explain Yourself: A Natural Language Interface for Scrutable Autonomous Robots. Workshop on Explainable Robotic Systems. HRI Conference, Chicago, USA [pdf].

  • H.Hastie, Xingkun Liu and Pedro Patron (2017). Trust Triggers for Multimodal Command and Control Interfaces. In Proceedings of ICMI, Glasgow, UK [link]

  • Helen Hastie, F. Javier C. Garcia, David A. Robb, and Pedro Patron (2017). MIRIAM: A Multimodal Chat-based Interface for Autonomous Systems. In Proceedings of ICMI. Glasgow, UK [link].

  • M. De Lucas Alvarez, H.Hastie and D. Lane (2017). Navigation-based learning for survey trajectory classification in autonomous underwater vehicles. In Proceedings of 2017 IEEE International Workshop on Machine Learning for Signal Processing, Sept.\ 25--28, 2017, Tokyo [link].

  • Helen Hastie, Xingkun Liu, Pedro Patron and Yvan Petillot (2017).Talking autonomous vehicles: Automatic AUV mission analysis in natural language In Proceedings of OCEANS MTS/IEEE, Aberdeen, UK. [link]

  • H.Hastie, X. Liu and P. Patron "A Demonstration of Multimodal Debrief Generation for AUVs, Post-mission and In-mission". In Proceedings of ICMI. Tokyo, Japan [to appear, 2016]
  • Zhuoran Wang and Helen Hastie (2015). A Prototype for AUV Post-mission Debrief Generation from Metadata (Demonstration). In Proceedings of AAMAS. [pdf]
  • Helen Hastie (2015). Challenges of Military Applications for Data-to-Text Generation. In Proceedings of the 1st International workshop on Data-to-text Generation (D2T). Edinburgh, UK (non-refereed). [pdf]
  • Hastie, H., Craven, P. and Orr, M. (2007). WIRE: A Wearable Spoken Language Understanding System for the Military. In Proc of HLT Conference, Rochester, NY.[pdf]]
  • Orr, M., Hastie, H., Miksch, D., Flanders, J., and Corrado, C., (2005). Capturing Critical Information using The Wearable Intelligent Reporting Environment (WIRE). In Proc. of DHS S&T Partnership Conference, Boston, MA. [pdf]
  • Hastie, H.  and Daniels, J. J. (2004). An Adaptive Speech Recognizer that Learns using Short and Long Term Memory. In Proc. of the Nineteenth National Conference on Artificial Intelligence, San Jose, CA, July 25-29, 2004. [pdf]
  • Miksch, D., Daniels, J. J. and Hastie, H. (2004). Establishing Trust in a Deployed Spoken Language System for Military Domains. In Proc. of the Nineteenth National Conference on Artificial Intelligence, San Jose, CA, July 25-29, 2004. [pdf]
  • Daniels, J. and Hastie, H. (2003). The Pragmatics of Taking a Spoken Language System Out of the Laboratory. In Proc. of Human Language Technology Conference, HLT-2003, Edmonton, Canada, May, 2003.[pdf]

Health Informatics

  • Maria K. Wolters, Juan Martínez-Miranda, Soraya Estevez, Helen F. Hastie, Colin Matheson (2013). Managing Data in Help4Mood. In EAI Endorsed Transactions on Ambient Systems 13(01-06)  [link]
  • M. K. Wolters, J. Martínez-Miranda, H. Hastie and C. Matheson (2013). Managing Data in Help4Mood. In Proceedings of the 2nd International Workshop on Computing Paradigms for Mental Health - MindCare 2012, Vilamoura, Algarve, Portugal. <
  • M. K. Wolters, L. Ferrini, J. Martinez-Miranda, H. Hastie, C. Burton, The Help4Mood Consortium (2012). Help4Mood – a Flexible Solution for Supporting People With Depression in the Community across Europe In Proc. of Med-e-Tel  [pdf].

Dialogue act type recognition

  • Taylor, P.A., King, S., Isard, S.D. and Wright, H. (1998). Intonation and Dialogue Context as Constraints. for Speech Recognition. In Language and Speech vol. 41 (3-4), 493-512.[pdf]
  • Wright Hastie, H., Poesio, M., and Isard, S.D. (2002). Automatically Predicting Dialogue Structure using Prosodic Features. In Speech Communication.[pdf]
  • Taylor, P.A., King, S., Isard, S.D. and Wright, H. (1998). Intonation and Dialogue Context as Constraints. In Speech Recognition, Language and Speech.[pdf]
  • Wright, H.  (1998). Automatic Utterance Type Detection Using Suprasegmental Features. In Proc. of ICSLP. [pdf]
  • Wright, H. and Taylor, P.A. (1997). Modelling Intonational Structure using Hidden Markov Models. In Proc. of ESCA. [pdf]
  • Taylor, P.A., King, S., Isard, S.D., Wright, H. and Kowtko, J. (1997). Using Intonation to Constrain Language Models in Speech Recognition. In Proc. of Eurospeech. [postscript]
  • Wright, H., Poesio, M. and Isard, S.D. (1999). Using High Level Dialogue Informatio for Dialogue Act Recognition using Prosodic Features. In Proc. of ESCA. [pdf]

Contact me

Room EM1.42
Heriot-Watt University
Riccarton, Edinburgh
EH14 4AS
Directions

  • +44 (131) 451 3344
  • h . hastie (a) hw . ac. uk
Follow me