(highlight:: Designing with Multimodalities in Mind
Key takeaways:
• Multi modality is an exchange between a device and a human where multiple input or output modalities can be used simultaneously or sequentially, depending on context and preference.
• There are greater burdens on your customer research to understand your customer's context use and to understand what form of multimotal manifestation make sense for your customers.
Transcript:
Speaker 1
The definition we're working with for multi modality is, a multi modality is an exchange between a device and a human where multiple input or output modalities can be used simultaneously Or sequentially, depending on context and preference. If we think about the traditional desk top to human relationship, or laptop to human relationship, right? You have your keyboard and mounse and your monitors. There was one output, for the most part, which was the dominant output as visual. And the dominant input is haptic, where are you using your hands to manipulate physical input devices. It's not really super multamotal, and it's certainly not optimized for multe modality. You could argue that occasionally there's a secondary output in audio. And you know, some designers are doing a little bit of kinetic input when they use, like, a wacom tablet or something like that, but it's not the default way of working. And there's so much more potentialther and we think about what's happened in the last few years with the arrival of smart speakers, with the arrival of voice search an google, with the Fact that most of our customers are deeply comfortable speaking to their devices. Now, with the arrival of connect back ind like 20 ten 20 eleventh time frame, in the fact that some customers are even comfortable, like, waving to their devices and gesturing at them. Now, there's so much more potential than just moving and keyboard around. But i can say from experience that if you're trying to do more than just move a keyboard or mouse, definitely drastically increases the complexity of the design experience. And that's why i brought this book into being. There are a lot of considerations. There are greater burdens on your customer research to understand your customer's context use and to understand what form of multimotal manifestation make sense for your customers. It's just because you have a ton of outputs and imputs, doesn't mean that you should lean on all of them all the time. You know, if your customers in their living room and they're always going to be near a remote control, you know, maybe you don't want to lean on voice s much as you do remote it's just faster To press the channel button, versus the kitchen, where the kitchen is a dynamic environment, where the hands are often full, and voice becomes far more compelling.)
- Time 0:04:44
-