An end in sight

Specifically to do with publishing the observation that wins for me in the below example is how a magazine is finishable. I like this, seems pretty obvious but the impact as a design idea is central to the UX and at odds with our daily experience of the web.

As a magazine atoms become bits the opportunity to provide exhaustive content is apparent however can be at odds with the audience need. As someone who subscribes to Wired’s printed publication I get that. I want the editors insight. In the brief time I have available to read through a magazine this skilled encapsulation of a theme and coverage of an interest area is essential. Not only does the editor as cultural explorer bring all this good stuff together they can give me the hooks to undertake future sorties myself and goes some way to damped the information overload endemic in daily net living.

^ Mag+ touch screen protoype

The curiousness of children is infinite. My 18 month baby is into everything, looking, pointing, grabbing, pulling. As any parent will tell you, it is pretty relentless as the world is explored anew. With each discovery comes the instinctual need to communicate with us what they are thinking and feeling. It is phenomenal how much is actually being taken in but of course without language, deciphering the baa-baa-beedahh-dees feels like a task for Bletchley Park.

What has been incredibly enlightening however was how gesturing through sign language can help to bridge that gap. After several months of “Sign and Sign”, which is a baby group to teach basic sign language, I was able to communicate about specific things; abstract and literal. For example, if she sees a star then fanning the fingers out from a fist tells us or if she is hungry or has a pain then a simple gesture lets us know. The recognition of understanding and being able to communicate is self evident, it is what we all continue to try to achieve even after the nappies are off.

The parallels between this and gestural interaction are clear. If you can communicate with your audience using simple gestures they are likely to become engaged more easily as the threshold to participation is lowered. I no longer need to coordinate by hand with the mouse to cause a cursor to move to a specific point to click…baa-baa-beedahh… I just press, or circle or swipe.  It is inherent, immediate, intuitive and why these types of interfaces are becoming woven more tightly into our social fabric.

Of these the Touch addition, buried at the bottom of the list?! represents the biggest new playground for designers. Whilst touch interaction is nothing new, the native support for it into what will become the most installed OS around is huge.

Having Touch not only changes the way we interact with information but changes the way the information should be displayed.

Getting your screen hands dirty

As you’d expect the inventory of flicks, swipes, twofingercombomoves, taps and pinches is all there. Using the simple flick gestures we are able to move around the interface dragging up, down, moving back and forward as well as performing tasks such as copy, paste, undo, and delete, right there in and amongst it. w00t!

Practicalities aside what gets me hot is that this method of interaction allows the user to really get stuck in or as Ben Shneiderman would say directly manipulate the interface. It brings with it the high probability that we will see more minority report UI’s but more importantly it presents opportunities to break down the engagement barrier of having to operate a mouse and keyboard and in doing so opens up new richly immersive environments and online services where involvement is more than cerebral, it’s physical.

In doing so our audience suddenly got a lot broader. Gestural interaction lowers the threshold to participation, just look at the way the Wii has found a home in households. It means generations of older folk and those who do not work with computers everyday can do the things they want to without technological intimidation or hangups.

Look and Feel

A new aesthetic is also required to play in this world, one that takes cues from kiosk applications and the burgeoning world of iPhone and its immitators. Input controls need to be bigger to deal with our low fidelity fingers (sounds odd saying our fingers are low fidelity..) than the pixel perfect pointer.

Controls also need to be spaced further apart. This means throwing menus tight into the edges of your application isn’t the best move for Touch as it makes activating them more difficult. This changes what we’d traditionally expect according to Fitts’ Law which sates “the time required to interact with a target depends upon the size of the target and the distance to it. The smaller a target is, and the further away it is, the harder it is to use. But due to the large surface area of the fingertip, small controls that are too close together can also be difficult to target precisely.” MSDN guidelines

With the advent of Touch we are also seeing a renewed interest in haptic feedback. The lack of this has been one of my gripes with the iPhone and I’ll often turn on sounds to use the phone keypad as a way to give the buttons some weight. With haptic we can do things like vibrate the device when a button is pressed or use it to signal an event. This facet provides another way to make our Touch experience authentic and I’m interested to feel the nuances in design as interfaces and brands differentiate themselves through vibrations.

*Waves goodbye*

As Touch enabled computers permeate the market it means designing interfaces just got a lot more exciting. It also means things have got a lot more complicated as now we need to consider interaction across a new input device and all that this tactile one brings with it. In some ways it reminds me of creating a Flash site and an HTML site, both to essentially convey the same information albeit via a different experience. How do you design for both concurrently without compromise? Are users likely to stay in a mode or is it constantly in flux dependent upon task? How does it change what we already know about usability? What new services are going to appear that enrich this form of interaction? How will current ones adapt?…

How we choose to design for this will take time as we become au fait with the experience. In turn expectations will change and with it new patterns will undoubtedly arise. I’m currently working with the talented folk at Splendid who have developed some great applications and concepts for MS Surface and are inventing some of this future. More about this another time.

If you have worked on or seen some really great examples of multi-touch interfaces let me know about it in the comments, would love to check it out..

Related reading

Dan Saffer wrote a book about gestural interfaces
Microsoft’s Touch guidelines