Smell, Taste, and Temperature Interfaces

As the workshop is only one day, we are prioritizing socialization, discussions, and hands-on demonstrations throughout the day. All videos and papers will be pre-circulated amongst attendees, but come ready to talk about your work!

Sunday, April 23rd
Time (CEST)	Schedule Item
08:30-09:00	Coffee & Badge Distribution
09:00-09:15	Welcome & opening remarks
09:15-10:00	Smell mixer (social icebreaker)
10:05-10:45	Provocation Panel: Prof. Hsin-Ni Ho (Kyushu University), Prof. Gabriella Petrick (Univ. of Stavanger), Leanne Wijnsma (yeast.computer) Moderated by Prof. Simon Niedenthal (Malmö Univ.)
10:45-11:15	Break-out discussions with panelists.
11:15-11:30	Break (and demo set-up)
11:30-12:30	Demonstrations
12:30-01:30	Lunch presented by Algoma University
13:30-15:00	Provocation: Prof. Christy Spackman (ASU) Breakout discussions & regroup
15:00-15:45	Taste social activity: Jenn Sandercock's "Taste Bud is Blind" game
15:50-16:45	Thermal mixer & discussion (mini-thermal grills)
16:45-17:00	Closing remarks & goodbyes
17:00	(Optional) SIGCHI Welcome Reception Hall 3

Due to ACM CHI's Zoom structure not allowing the Chat feature, we are additionally bringing back the STT Discord for any parallel discussions about people's work.

Discord Link

Please note that all papers published from the Smell, Taste, and Temperature Interfaces Workshop are non-archival and went through a curation process instead of a peer-review process.

Published Publicly

Jenny Berkholz, Gunnar Stevens. Futuristic Senses: Approaching HCI Students’ Perceptions of the Future of the Senses Beyond Science-Fiction. Paper

Rachel Masters, Francisco Ortega, Victoria Interrante. A Multisensory Approach to Virtual Reality Stress Reduction. Paper

Jussi Rantala, Antti Sand, Ahmed Farooq, Jenni Lappi, Natalia Quintero, Mohit Nayak, Nesli Sözer, Roope Raisamo. A multisensory augmentation system to enhance eating experiences. Paper

Jakob C. Uhl. Multi-sensory VR Training: Research in the Wild. Paper

Masaharu Hirose, Masahiko Inami. Balanced Glass Design: A flavor perception changing system by controlling the center-of-gravity. Paper

Liam Aljundi, Thomas Bengtsson, Snezhana Bogeva, Ebba Bolin, Lisa Maliqi, Liam Melin- Higgins, Iana Minakova, Per-Anders Welin, Victor Baquero Wihlborg, Johannes Lund With & Simon Niedenthal. Olfactory display development in interaction design education. Video | Paper

Lala Guluzade, Corina Sas. Mindful Eating: Apps Review. Paper

Jessica Lai, Mason Manetta, Alireza Bahremand, Lauryn Mannigel, Byron Lahey, Christy Spackman, Brian H. Smith, Richard C. Gerkin, Robert LiKamWa. Design and evaluation techniques for odor mixing. Paper

Hiroki Kawahara, Kaito Yamao, Takayasu Fuchida, Kentaro Oda. Flavor Fusions: entertainment cooking device using ultrasound to levitate and discharge liquids to change color and flavor impressions. Paper

Shu Zhong, Madhan Kumar Vasudevan, Marianna Obrist. The Role of Temperature in the Study of Mindful Touch Perception. Paper

Privately Circulated

Miguel Garcia-Ruiz. Exploring Smell, Wind and Heat Stimuli in a Virtual Beach to Support Students’ Wellbeing.

Yunyi Zhu, Stefanie Mueller. BitePrint: Creating Complex and Customizable Food using Digital Fabrication Tools.

Yao Lu, Hao Wu, QI Lu. Intranasal Haptics Effect on Olfactory Experience.

Tim Moesgen, Yu Xiao. How do we express thermal sensations? An intermodal approach of verbal and non-verbal means to capture and describe temperature experiences.

Iddo Yehoshua Wald, Amber Maimon, Amir Amedi. Seeing temperature: a method and system concept for thermoception through visual-to-auditory sensory substitution.

Rébecca Kleinberger, Akito van Troyer, Qian Janice Wang. Auditory Seasoning Filters: Altering Food Perception via Augmented Sonic Feedback of Chewing Sounds. CHI Full Paper

Shiori Iwahama, Sho Sakurai, Koichi Hirota, Takuya Nojima. Fundamental Study of Method for Generating Tactile Sensation in Periodontal Ligament by Electrical Stimulation.

Sosuke Ichihashi, Masahiko Inami, Noura Howell. Fast-Switching, Spatial Thermal Display Using Water and Visible Lights.

To Be Announced

The topics of interest for the workshop include, but are not limited to, the following:

• Sharing & open-sourcing experimental setups, hardware, or toolkits for smell, taste, and temperature.
• Techniques and methods to design and use multi-sensory technologies.
• Systems for recording, stimulating, and augmenting multi-sensory experiences.
• Assistive and environmental technologies using smell, taste, or temperature.
• Cultural aspects and contexts of multi-sensory interactions in everyday life and history, and how they influence and shape the technologies developed and their societal adoption.

We aim to additionally highlight and discuss open challenges in the field, which include, but are not limited to,

• Recommendations on sharing tacit knowledge.
• Sharing system designs: share how researchers overcome power limitations, wearable form factor constraints, network constraints, and compute resource utilization.
• Tackling the replication of this research: affects all these devices, which end up being often non-reducible, recordings and replay of experiences, precision, inter-, and intra-modality effects.
• Data sharing & modeling: how to share data across HCI researchers, benefit from recommended practices in data modeling, information dissemination, and evaluation methodologies.
• Perception: avoid sensory conflicts or take advantage of mixed senses, calibrate for over or under stimulation, predictably stimulate senses for a large and diverse population of people.
• Social implications: for example, questions around cultural adoption and equal access to these interfaces.

• Final Submission Deadline: Sunday, February 26, 2023 at 12:00 (noon) PT.
• Extended Submission Deadline: Tuesday, March 7, 2023 at 12:00 (noon) PT.
• Notification date: Friday, March 10, 2023, at 12:00 (noon) PT.
• Video Deadline: Friday, April 7, 2023, at 12:00 (noon) PT.
• Workshop Day: Sunday, April 23, in Hamburg, Germany.

Note: PT - Pacific Time

The “Experiencing Smell, Taste, and Temperature Interfaces” workshop addresses the burgeoning subfield of chemo- and thermo-sensory interfaces (smell, taste, and temperature) as well as their cultural contexts, usage, and resulting experiences. This one-day, in-person workshop will offer an interdisciplinary forum of discussion for academics and practitioners interested in leveraging these sensations.

Examples of smell, taste, and temperature hardware: (a) The Smell Engine; (b) Chewing Jockey; (c) temperature altering perceived softness ; and (d) stereo-smell sensing via electrical trigeminal stimulation .

Researchers and practitioners from academia, arts, and industry are invited to apply to the workshop by submitting a 1-4 page position or research paper in the ACM Master Article Submission Template single column format via the submission portal. The submission deadline has been extended to Tuesday, March 7, 2021 at 12:00pm (noon) PT! All applications will be reviewed by the workshop organizers and selection will be based on the paper’s quality, novelty, and fit for topics. Applicants will be notified of decisions on Friday, March 10, 2023 at 12:00pm (noon) PT. Accepted papers will have the option to be made available at the workshop webpage. Upon acceptance, participants are asked to produce a 5-minute introduction/paper presentation video, which will also be shared publicly on the workshop website. At least one author of each accepted paper must attend the workshop.

In line with STT 2023's goals, we will prioritize submissions that include in-person demonstrations or share tacit knowlege.

Submission Form

Jas Brooks

Jas Brooks is a Ph.D. student in the Department of Computer Science at the University of Chicago. Their research expands the computer interface to engage with the chemical interactions of our bodies and investigates what this paradigm enables. These chemical interfaces have introduced new input and output methods, such as electrically induced stereo-smell (directional odor cues), chemically stimulated haptics, and more. Their research is covered in media publications like WIRED, Fast Company, Digital Trends, and IEEE Spectrum, and supported by a National Science Foundation Graduate Research Fellowship.

Website: jasbrooks.net

Alireza Bahremand

Alireza Bahremand is a Ph.D. student in the School of Electrical, Computer, and Energy Engineering at Arizona State University. His research focuses on adaptive software-hardware frameworks for multi-sensory digital embodiment. Recent works include the Smell Engine, a software-hardware framework that integrates olfactory stimuli into virtual environments, closely reflecting real-world olfactory sensations. As a contributing researcher to the ASU Dreamscape Learn partnership, Alireza is working with teams of professors and students to build educational multi-sensory XR experiences at scale.

Website: alirezabahremand.com

Pedro Lopes

Pedro Lopes is an Assistant Professor in Computer Science at the University of Chicago. Pedro focuses on integrating computer interfaces with the human body—exploring the interface paradigm that supersedes wearable computing. Some of these new integrated devices include: a device based on muscle stimulation that allows users to manipulate tools they never seen before or that accelerate their reaction time, or a device that leverages the nose to create an illusion of temperature. Pedro’s work also captured the interest of media, such as New York Times or NewScientist, and was exhibited at Ars Electronica and the World Economic Forum.

Website: lab.plopes.org

Christy Spackman

Christy Spackman is an Assistant Professor in the School for the Future of Innovation in Society as well as the Department of Arts, Media, and Engineering at Arizona State University. Her work focuses on how the sensory experiences of making, consuming, and disposing of food influence and are influenced by “technologies of taste,” oft-overlooked technologies and practices used to manage the sensory aspects of foods during production. Her current book uses this framework to examine how scientific and technological innovation changed the taste of water throughout the 20th-century. Christy holds training in molecular biology, food chemistry, and the culinary arts, allowing her to bridge disciplinary divides in research.

Website: christyspackman.com

Judith Amores

Judith Amores is a Research Fellow at the MGH/Harvard Medical School and a Research Affiliate at the MIT Media Lab, where she did her Ph.D. and master’s and helped run VR/AR at MIT as a co-president. She holds a multimedia engineering degree and has worked at Microsoft Research, URL Barcelona, and the Google Creative Lab. Her awards and publications include over 27 peer-reviewed research papers, two patents, a Facebook Graduate Fellowship, LEGO Foundation sponsored research, and was a finalist of the Innovation by Design Awards. She also received the Scent Innovator Award by CEW and IFF.

Website: judithamores.com

Hsin-Ni Ho

Hsin-Ni Ho is an Associate Professor in the Faculty of Design at Kyushu University, Japan. Her research interests include haptic perception, multimodal interactions, shitsukan (material quality) perception, and the development of haptic interfaces based on human perceptual properties. Hsin-Ni received her Ph.D. in Mechanical Engineering from the Massachusetts Institute of Technology in 2006 and worked as a research scientist in the NTT Communication Science Laboratories, Japan, from 2007 to 2021.

Website: sites.google.com/view/hohapticslab

Masahiko Inami

Masahiko Inami is a Professor at the University of Tokyo whose research asks, “What are the challenges in creating interfaces that allow users to act and express their intentions intuitively?” Today’s computer systems are limited: they only exploit visual and auditory sensations. However, daily life uses a variety of modalities, including some that come in direct contact with our bodies. These later modalities can dramatically affect our ability to experience and express ourselves. Masahiko designs a new generation of Human-Computer Integrated systems informed by modern physiological understandings of sensation and perception, emerging electronic devices, and agile computational methods.

Website: star.rcast.u-tokyo.ac.jp

Simon Niedenthal

Simon Niedenthal is an Associate Professor of Interaction Design at Malmö University, Sweden. His research focuses upon olfactory interaction, game aesthetics, and the sensory dimensions of gameplay. Recent projects include Nosewise, a collaboration with psychologists at Stockholm University exploring the potentials of smell training, and Exerscent, an open source, low-cost olfactory interface for remote olfactory assessment and training. In 2008, Simon defended his Ph.D. thesis Complicated Shadows: The Aesthetic Significance of Simulated Illumination in Digital Games, on game lighting and its effect on the emotions and behavior of the player.

Website: Faculty Page

Jessica Lai

Jessica Lai is a PhD student in the departments of Engineering and Design and the Arts at Arizona State University. Her interests are generally housed at the intersection of electrical engineering and visual arts, but more specifically, she is focused on human-computer interactions with virtual reality and olfaction. Her most recent work was a flexible software-hardware infrastructure for the production of spatially sensitive and programmable odors. She is currently working to further her insights in this realm as well as developing an artistic and scientific virtual reality experience about the senses through a journey to Mars.

Mason Manetta

Mason Manetta is an Electrical Engineering undergraduate researcher at Arizona State University’s Meteor Studio. Mason focuses on researching and developing odor-producing computer interfaces for multimodal experiences. Their most recent device enabled spatial smell perception in virtual reality. Additionally, Mason investigates energy-efficient architectures for mobile and embedded image capture and medical imaging methods, particularly electrical impedance tomography. Mason has published work at IEEE VR and MobiSys, which have been covered in media articles by ASU and KJZZ public radio. Mason plans to pursue a doctoral degree.

Website: mcmanetta.github.io

Lauryn Mannigel

Lauryn Mannigel is an artist-researcher and curator based in Tempe (U.S.) and Berlin (D.E.). She is a Ph.D. student in the Media Arts and Sciences program at Arizona State University. Since 2005, Mannigel has been tackling the issue of the Western cultural dominance of visual aesthetics and epistemology by exploring primarily non-visual sensory perception through diverse media technologies. Since 2015, Mannigel’s primary research interest has focused on the political potential of smell. She exhibited artwork and spoke at conferences worldwide.

Website: laurynmannigel.me