Voice User Interface Design VUI

As you know, I enjoy looking at other fields that might have design elements that could be leveraged in a speech and multimodal world.

My latest discovery was the film “Objectified” by Gary Hustwit. Even though the documentary is centered around the topic of Industrial Design and the process by which well known products are designed, created and injected into the marketplace, there are some great quotes by various designers that I couldn’t help but feel compelled to share with you and analyze in an attempt to find a way to apply them to our field. With so many quotes, I though this might be better off divided in parts so people can add comments and share their own insights and experiences. Let’s get started:

“What we really need to do to design is look at the extremes – the weakest, with arthritis, the athlete, the strongest, the fastest – because if we understand what the extremes are, the middle will take care of itself.” — Dan Formosa, Design and Research, Smart Design

Wow, what a way to start this topic! After readings this one, I couldn’t help but feel a little guilty about perpetuating the common design approach of the 80-20 rule. We try to capture what 20% of the population which will use 80% of the features might do, add support for a few other common “corner cases”, and ignore the really obscure and unlikely scenarios altogether. This point definitively made me wonder what if… what if we were to do it backwards, design by looking at those extremes - the distracted caller, the multitasking mom, the user that requires extra time to process the information or respond - and letting the middle take care of itself.

Case in point, the creation of the Oxo kitchenware, a peeler originally designed for people with arthritis that turned out to be more comfortable and easier to use for everyone!

“What we’re really always looking for whenever we design are ways we can improve the way people do things or improve their daily life… without them really even knowing, ever thinking about it.” — Davin Stowell, CEO & Founder, Smart Design

Another quote from Smart Design, but this time addressing the reasons behind our designs. How often are we really looking for ways in which we can improve how people do things or improve their lives? How often can we articulate this need and help evaluate it in the context of other seemingly more important needs such as completion rates, retention and automation? Can we really tell we designed something that not only solved someone’s issue or allowed them to complete their task but that in fact had a positive impact on them without them even knowing? Quite a challenge (and intrinsic motivator for me)!

“Good design should be innovative. Good design should make a product useful. Good design is aesthetic design. Good design will make a product understandable. Good design is honest. Good design is unobtrusive. Good design is long-lived. Good design is consistent in every detail. Good design is environmentally friendly. Good design is as little design as possible.” — Dieter Rams, Former Design Director, Braun

I think Mr. Rams said it perfectly. Seeing what goes on inside the minds of product creators behind brands like Braun and their philosophy definitively makes me appreciate the responsibility of a designer.

That’s it for part 1. Stay tuned for more quotes and nuggets of wisdom. And if you get a chance, watch the movie, you won’t regret it (and your users will appreciate it)!

During any Requirement’s Gathering process, one of the hardest yet most critical steps involves finding out the features that will be offered to the users. Figuring out the final set normally involves talking to agents, listening to the different business units, looking at statistics, etc.

Furthermore, if the customer is migrating from an existing system to a new one, part of the process also involves reevaluating the set of features currently being offered to determine which ones should be migrated and which ones should be eliminated for good (which very often becomes a challenge by itself since customers tend to feel that by doing so, they are “loosing” functionality)

Some of the tools available to us include performing a Usability test on an existing system, doing a benchmark analysis to compare features offered by competitors, looking at usage data to determine the frequency of usage of each existing feature, or setting up focus groups or customer surveys to explore the likely usage of new features.

So yes, there are way to figure out how often they might use a certain feature or what they might think about it, but how do you gauge how deeply your users care about those features?

Well, while watching a recent Burger King stunt (an interesting mix of market research and marketing) in which they made one of their US branches a “Whooper Free Zone”, and recorded via hidden cameras the reactions of their customers upon being told that they were no longer serving Whooper sandwiches (see video below).

This stunt made me think about a tool that designers don’t use very often: Subtraction.

By that I mean that very often we run complex studies and champion-challenger scenarios (aka A-B designs) to figure out what the best combination of items might be, or what the impact of adding one more choice will have on a user base. But how often do you test the impact of removing a choice both from a performance as well as from an emotional perspective? (and no, I’m not talking about those bad designs where options are so buried down or words are so poorly chosen that it’s almost impossible for users to find what they need or realize what they need is in front of their eyes (or ears).

So, next time you’re thinking about your users and the options they need, consider subtraction as one more tool in your ever-growing UI toolkit. And if you’ve used before, I’d be very interested in knowing what your results were.

Oh yeah, it’s that time of the year again. If you’re planning to attend this year’s SpeechTEK in New York, please stop by and say hi.

Also, you can now look at the final version of the program. In particular, I would like to invite you to the following sessions:

1. Introduction to Voice User Interface Design (STKU-2)

   Sunday August 23rd, from 1:30 PM to 5:00 PM. This workshop is designed to quickly get those new to VUI design up-to-speed so they can make the most of the Principles of VUI Design track at the conference

2. Efficient Design (B102)

   Monday August 24rd, from 11:15 AM to 12:00 PM. Here we’ll talk about “Truths and Myths About Reusable Designs”. How can you design for reuse? Can user requirements be captured the standard way?

3. Bilingual Spanish/English Design (B301)

   Wednesday August 26th, from 10:45 AM to 11:30 AM. Here we’ll talk about “How to Present Names of
   Geographical Locations in Spanish Systems”. Yes, listening for and capturing names of places seems like a trivial task, but what factors should be considered when making translation/pronunciation decision? What do those decisions say about you and your company?

Safe travels, and see you there.

A very interesting report from Nielsen was recently published highlighting some of the challenges mobile users face when accessing web information.

Aside from the sad news about average success rates being around 59%, it was interesting to me to see how most of the Mobile Problems outlined in the report can be actually seen as opportunities to seriously consider the use of Speech Recognition.

I know most companies suggest Speech Recognition as the killer app for mobile devices, but I would argue that it should be seen instead as the ideal complementary mode of interaction when navigating the internet and retrieving information on mobile devices, not as the silver bullet that would solve all mobility hurdles.

For example, thinking about speech in the context of those problems raised in the report:

• Small screens: Yes, small size is a natural result of being portable. Yet, having a limited number of options at any given time and relying on short-term memory are the bread and butter of most Speech Recognition Systems. Therefore, adding an audible element and allowing users to express themselves in more natural ways helps compensate those visual limitations. Furthermore, multislot interactions and natural language understanding help alleviate the challenge of multiple windows and advanced behaviors present in purely visual interactions.
• Awkward input (especially for typing): Once again, Speech Recognition shines here since it’s the facto way of interaction amongst humans. Words can easily trump visual counterparts such as menus, buttons, and links not only because of how natural interactions are but also because it avoids the inherent limitations of tiny keypads, trackballs and mini-keyboards.
• Download delays: Even though Speech cannot solve the problem of being able to download screens faster, it can help in those instances where information can be delivered in an audible form since users can continue to interact with the system and move along their intended goal since prompts and logic can be embedded in a device without requiring network connectivity or optimized and compressed for faster delivery.

An interesting discussion came up this week where there was a debate about the length of menu choices and how short/long options should be to help users move along in both an efficient and successful way through a system.

Interestingly enough, around the same time I ran across an article from Nielsen talking about taking about links and how well can users predict what will be contained within each link.  I’ve mentioned in the past that I feel there are many similarities between the web world and the voice world, so thinking along the same lines, I feel web links are the siblings of menu choices in speech, so I felt the part where he talked about the results of only showing the first 11 characters of a link was relevant for that discussion:

The two winning links (“Gift Cards” and “New Custome”) also showcase principles for effective Web content.  Both links:

• Use plain language
• Use specific terminology
• Follow conventions for naming common features
• Front-load user- and action-oriented terms

The point being that the importance is not really on the length of the word but on its meaning.  For example he found the worse links were the ones that only showed “Introducing” and “Working whi” that had the same length as the winning ones but were bad because of:

• Bland, generic words
• Made-up words or terms
• Starting with blah-blah and deferring the information-carrying text to the end

What this means in practice is that using single word commands on a menu (e.g. “Emergency”, “Billing”, “Status”) does not necessarily make menu choices easier to understand, more intuitive for users, or faster to navigate.  On the contrary, they may limit the user’s ability to infer what can be found underneath them, creating the exact opposite effect.

JTLYK  

Smashing Magazine just published an article about Useful Techniques for Good UI Design, that even though concentrated on Web Applications, I felt there were a few techniques that could be reviewed with an eye towards VUI design:

1. Highlight important changes

And by this I don’t mean “Please listen careful for our menu options have changed”. Here we’re talking about system status visibility - knowing where you are and that actions led to expected results. Implicit confirmations are a good example of this.

2. Enable shortcuts in your application

The key concept here is to offer users more responsive user interfaces. In the case of the phone, this can be somewhat compared to having “touch-tone equivalents” which allow expert users to breeze through applications without having to wait to be prompted for input. But here I would also argue that other things would fall under this same principle: good command selection, “shadow” options that even though not prompted for can be supported if tuning data backs up the decision, and even “parallel” choices which allow someone picking one branch to swiftly change “branches” without having to “go back” or return to a “main menu”.

3. “Upgrade” options

I feel this would be similar to having functionality available for “expert users”. Proper use of barge-in as well as multi-slot support allows someone to interact in more “advanced” ways with a system keeping such a transition simple and intuitive.

4. Advertise features of the application

And no, sending out “user manuals” for applications does not qualify for this. Here we would be talking about pointing out “new” features or even “advanced” features that are available. As with most non-task-oriented information, this should be presented only after the user has successfully completed their task.

5. Use “color-coded” lists

Items appearing together are an issue, no matter what type of interface we’re talking about. Therefore it is really important to put attention to the different tools at our disposal to avoid this issue: voice intonation/emphasis (such as making menu options clearer), word choice (avoid confusion amongst different choices), silences (natural pauses to allow mental processing of the information), etc.

6. Offer personalization options

I’m sorry to say this has been out there for quite a few years for most interfaces, yet voice user interfaces hardly ever offer them. It may be harder to do than with visual interfaces (where you can change colors, rearrange items, etc.) yet small things like offering only relevant choices based on someone profile or remembering the last tasks they’ve performed go a long way in making users feel like they “own” the system.

7. Display help messages

Help is definitively one of those topics that has been debated a lot, and like most controversial ones, whether or not it should be used and how it should be used can be summarized in two words: “it depends”. Personally I feel help should not be a stand-alone piece of a design (whether it is a tutorial or a separate collection of help prompts) but rather an integral part of design – commands offered should be helpful to a user, error messages should add relevant information to help users recover, transition messages should help users know where they are and where they are going, etc.

8. Design feedback messages carefully

Here we can think about transition messages (exit prompts) and error recovery prompts. Here, there are various things that can be done to make them more effective: control voice intonation so as to convey the right meaning, reword questions and statements so as to convey the same meaning without simply “reprompting” users (if the problem had to do with users not understanding you in the first place, simply repeating is not going to help at all)

9. Use tabbed navigation

This is one of those areas where visual design has an advantage over non-visual design. Nevertheless, good information architecture can help obtain similar results, where applications reflect user’s mental models making it easier for them to know what choices mean and how the system works. This makes users feel at ease since they feel more in control.

10. Darken background

Conversely, here non-visual design has the advantage since all interactions happen in sequence. No need to “gray out” parts of our design since by the time we move on with a new “task”, all previous information now belongs to the past.

11. Lightboxes and Slideshows

The concept here is to allow users to navigate back and forth. In the visual world there are a lot of tricks to reduce the noise and allow a user to focus on a particular item. In the case of non-visual design, there are ways to do similar things when the system has been properly architected, which should include consideration of “go back” behavior that would contextually match a user’s mental model, as well as proper “sub task” definitions so that if users need to make a change or update a certain piece of information, they don’t have to start all over again or get confused about how to do it.

12. Short sign-up forms

This is another one where non-visual design has the opportunity to leverage information. The whole notion here is to minimize the effort needed to identify a user and to speed up the process. On one hand, this means taking advantage of what technology has to offer: ANI identification, DNIS separation (ideal for language selection), CTI (please, please, please don’t loose everything that the user has accomplished so far). And on the other, there are design techniques such as the removal of “optional” elements if that allows a user to proceed (and especially if that avoids confusion and distraction from the user’s real goal).

We’ve heard about the global phenomenon of a population that is aging, yet there are very little talks about what design strategies should be used for them.  Other than the classical stereotypes - louder volume, slower pace yet not condescending, pitch within a certain range, more information, etc. – the impact this tech-savvy population will have on how interfaces are being designed is still vague and uncertain.

Quick fact: currently, the population under the age of 5 years old exceeds those above the age of 65. It is estimated that within the next 8 years, that trend will reverse. By 2050? They will double the number of people under the age of 5.

Source: U.N. Department of Economic and Social Affairs, Population Division

So, if we were to consider all the things that will change around us to accommodate those users – from healthcare products and services to how stores are arranged and houses are build – it should be easy to realize the wide range of possibilities and opportunities to improve interactions – from how information is provided to what types and levels and services are expected both from automated self-service solutions as well as live human beings.

Maybe getting serious about the topic and continuing research will finally take over the assumptions and stereotypes that so often appear in most user designs…

While doing some research on Multimodal Usability and User Interfaces, I ran across a list of Three Main Attributes of Multimodal User Interfaces, which on careful thought, can definitively be applied to ANY User Interface. It was a nice refresher which reminded me of why good design is so difficult to achieve, but very rewarding.

Good User Interfaces can be judged based on their:

1. Effectiveness: Whether a user can achieve a desired goal or a certain task with a predefined degree of perceived accuracy. This one has to do directly with our users and their environment. Good questions to ask ourselves: What level of accuracy are you designing for? What completion rates can you expect from certain design strategies? How satisfied will your users be after completing a task?




2. Efficiency: How much effort (fatigue, frustration, cognitive demand, stress, discomfort, number of tries) and resources (time) will those users need to complete a task. Good questions to ask ourselves: How long is it going to take for an average user to achieve a certain goal? How many error corrections can we expect from certain design strategies? Will users obtain something of a higher value than the one they are putting into the interaction?




3. Learnability:Whether a user can easily discover the functionality contained in a system and quickly learn how to use it. Good questions to ask ourselves: How intuitive is my design? Based on the context on the interaction, does the funtionality offered by the system match the user’s expectations? How easy is it for users to explore and discover new functionality and advanced features?