AutomotiveUI 2023 | Workshop | 18th, Sep | Ingolstadt, Germany

Holistic HMI Design for Automated Vehicles:
Bridging In-Vehicle and External Communication

As the field of automated vehicles (AVs) advances, it has become increasingly critical to develop human-machine interfaces (HMI) for both internal and external communication. Critical dialogue is emerging around the potential necessity for a holistic approach to HMI designs, which promotes the integration of both in-vehicle user and external road user perspectives. This approach aims to create a unified and coherent experience for different stakeholders interacting with AVs. This workshop seeks to bring together designers, engineers, researchers, and other stakeholders to delve into relevant use cases, exploring the potential advantages and challenges of this approach. The insights generated from this workshop aim to inform further design and research in the development of coherent HMIs for AVs, ultimately for more seamless integration of AVs into existing traffic.

Activities & Schedule

9:00 - 9:15 Welcome & Introduction

Ice-breaker activity, organisers give a brief introduction about the day and present the keynote speakers

9:15 - 9:35 Keynote Speech: Internal and External HMI

Openning up the workshop with two special keynote speeches. We are happy to announce our renowned speakers:

  • Dr. Wendy Ju: eHMI: "Should your car talk to you?"
  • Dr. Andreas Löcken: internal HMI
  • 9:35-9:45 Q&A

    9:45 - 10:15 Plenary: Reflective Discussion

    Alongside our distinguished keynote speakers and engaged audience members, we will initiate a thoughtful dialogue. This discussion will revolve around a use-case scenario thoughtfully curated by the organizers.
    We'll delve into questions such as:

  • How would you define a holistic perspective?
  • What potential benefits can be derived from it?
  • What are the challenges it presents?
  • How should we strategically approach this perspective?
  • 10:15 - 10:30 Coffee Break

    10:30 - 11:30 Group Work

    Participants will be divided into small groups, and further discuss and create new use scenarios using provided physicalisation tools*.

    * In order to effectively support the discussion among participants from different backgrounds, we will conduct a deliberately designed collaborative activity known as participatory physicalisation (Huron et al. (2017), Jansen et al. (2015), Koningsbruggen et al. (2022)) . This activity employs detailed instructions and tangible artefacts to facilitate the exploration of ideas, physicalise the discussion process and lead to shared understandings (Panagiotidou et al. (2022) ).

    Figure: example of the physicalisation tool in use.

    11:30 - 11:45 Coffee Break

    11:45 - 12:20 Plenary: Sum-up Discussion

    By showing the physicalisations created at each table, participants can analyse and discuss the scenarios together

    12:20 - 12:30 Closing

    Expected Outcomes

    This workshop will serve as a foundational exploration of HMI for AV design and research through a holistic lens, cultivating a shared understanding among participants from various backgrounds. The insights derived from our discussions, particularly regarding use cases and validity arguments for this holistic approach, will be compiled in a summary report. We intend to disseminate these findings through an academic article, marking the first consensus among experts in the field.

    Call for Participants

    Our target participants include designers, engineers, and researchers with expertise in automotive HMI design and development, encompassing both in-vehicle and external interfaces. Additionally, we welcome individuals with other profiles, including urban planners, traffic policymakers, etc., to promote interdisciplinary collaboration.


    Haoyu Dong

    is a doctoral candidate at the Eindhoven University of Technology in the Department of Industrial Design. Her research follows Research through Design approach and focuses on interaction design research of in-vehicle users and AVs, specifically in non-critical scenarios.

    Tram Thi Minh Tran

    is a doctoral candidate in the Urban Interfaces Lab at the University of Sydney's School of Architecture, Design, and Planning. Her research investigates the intricate interactions between pedestrians and AVs in complex traffic scenarios involving multiple road users.

    Pavlo Bazilinskyy

    is an assistant professor at Eindhoven University of Technology focusing on AI-driven interaction between AVs and other road users. He finished his PhD at TU Delft in auditory feedback for automated driving as a Marie Curie Fellow, where he also worked as a postdoc. He was the head of data research at SD-Insights. Pavlo is a treasurer of the Marie Curie Alumni Association (MCAA).

    Marius Hoggenmüller

    is a Lecturer in Interaction Design in the Design Lab at the University of Sydney's School of Architecture, Design, and Planning. His work focuses on prototyping interactions with emerging technologies in cities, such as urban robots and autonomous systems.

    Debargha Dey

    is a postdoctoral researcher at Cornell Tech, with a research focus on human-automation interaction. He has 8+ years of experience in the domain of human factors for automated driving and traffic behaviour.

    Silvia Cazacu

    is a doctoral candidate at the Spatial Applications Division Leuven of KU Leuven, Belgium. Her research focuses on participatory physicalisation as an approach to support collaboration in data ecosystems and draws on critical data studies and data humanism.

    Ruolin Gao

    is a doctoral candidate in the Department of Industrial Design, Eindhoven University of Technology. She focuses on the interaction between AVs and manually-driven vehicles to foster smooth interaction in a mixed-traffic environment.

    Mervyn Franssen

    is a doctoral candidate at the Eindhoven University of Technology in the Department of Industrial Design. His research is focused on designing and validating natural interfaces and behavioural characteristics for automation systems in order to reduce uncertainty and avoid unpredictable behaviour for human operators who sometimes need to take control.

    Get in touch

    If you have questions, please feel free to send a message!