Screens are disappearing.

There’s a delicious irony in that sentence, right? I mean, you’re probably reading this article on a screen right now, (unless you make a habit of printing out your morning reading). But look around: human-computer interactions no longer exclusively occur through the keyholes of our smartphones, smartwatches and TV screens – something that Bill Gates predicted would happen back in 2002:

“…computers themselves will gradually “disappear” into the fabric of our lives. We are still a long way from a world full of disembodied intelligent machines, but the computing experience of the coming decade will be so seamless and intuitive that–increasingly–we will barely notice it.” ~ Bill Gates, The Disappearing Computer

Granted, he guessed this transition would happen by 2010 – but he was only off by a few years, so give the guy some credit.

As voice recognition and chatbot technology improves, these “invisible” user interfaces will replace screens as the default medium of interaction. Just as many modern websites & applications today tout themselves as “Mobile-First”, it won’t be long before those same innovators are applying the “Voice-First” label to their new offerings. Indeed there’s a non-zero chance that the next killer app may launch with no visual UI at all! Thus, today’s UX designers face a stark choice – evolve beyond the pixel, or look for a new career.

In this post, I’m going to explore some of the reasons behind the sunset of visual-first design, and explain why designers must learn to wield their prose and stories as fluently as they do their imagery, in order to remain relevant in the age of invisible computing.

Let’s get to it, shall we?

Why visual-first design will soon decline

Words are the new pixels

What designers can do to keep their jobs

Why visual-first design will soon decline

If we’re to understand why designers must learn to tell stories without relying on visual aids, we must first grasp the drivers behind the decline of visual-first design.

It’s getting old

In short, predominantly visual design as a source of innovation is approaching the maturity phase of its life-cycle.

Just like any product or service, visual-first design is reaching its maturity

Take a look around – aren’t websites all starting to look kind of samey these days? This is no accident. As new design best practices have been shared, and higher conversion rates achieved, this standardized knowledge has propagated to businesses and website owners all across the web. But this wasn’t always the case. 

In its heyday in the early 2000’s, flashy web design was THE competitive differentiator for any business that wanted to make waves online. The arrival of Macromedia Flash (that’s Adobe Flash, to you kids), brought rich interactivity and visuals to the previously dull and static World Wide Web, and boutique rich media design studios like 2Advanced and Big Spaceship blew people’s minds by pushing the envelope of what we all thought was possible with web design and motion graphics. And fancy pre-loaders (ugh).

With unique and eye-catching design prioritized over everything else, it used to be a generally accepted workflow to have your web designer simply create visual “buckets”, (stuffed with Lorem Ipsum, of course), for the copywriter/client to fill with content after the fact.

We now know this is no longer an appropriate workflow for truly effective web design – in such circumstances, the actual content becomes subservient to the design, which diminishes the effectiveness of both.

It’s being commoditized by economic pressures

Visual design is cheaper, more accessible and more standardized than at any time in the history of the internet. Sites like Upwork, 99Designs and Envato have democratized (some might say commoditized) visual design, while free access to blog tutorials, website themes, and drag & drop tools like Canva, mean that anyone can invest a little time or money, and walk away with a presentable design.

Automated design is coming

Meanwhile, procedural design engines like The Grid and Act-On, can automatically generate entire layouts based solely on the content you feed them, and simultaneously A/B test like 8 gajillion different page variations to find the ultimate killer converting layout. While the output of these tools may not currently match human visual designers at the top of their game, there’s been more than enough interest around them to validate the existence of significant demand for cheaper, automated delivery of good visual design. It’s only a matter of time before the technology catches up – and it’s a problem that need only be solved successfully once to greatly reduce the need for human involvement in the visual design process.

“In 2010 only 2 per cent of Americans worked in agriculture and 20 per cent worked in industry, while 78 per cent worked as teachers, doctors, webpage designers and so forth. When mindless algorithms are able to teach, diagnose and design better than humans, what will we do?” ~ Yuval Noah Harari, Homo Deus: A Brief History of Tomorrow

Voice & text recognition technology has reached a tipping point

Following a powerhouse showing at CES2017, Amazon’s Alexa is the first application of voice interaction to have reached mainstream adoption, with almost 8 million Echo units sold since it debuted in 2015 – and more than two thirds of those sales happened last year.

One stunning stat in particular is that Echo owners have also increased their spending on Amazon by 10% in the last year. Consider all the effort that’s gone into optimizing Amazon to be the best-converting e-commerce store on the internet – and now consider that one of its biggest leaps forward came from removing the visual interface altogether!

It’s also worth noting that voice and chat interfaces are only just getting started, and haptic, gesture-driven interactions aren’t far behind.

The video above was posted in 2015, so who knows how far this technology has come since then?

Visual design is struggling to keep up with consumers’ needs

How many screens exist in the average urban-dweller’s life? Smartphone, TV, laptop, tablet, car, (maybe even the fridge, if they’re painfully early adopter). Effective visual designs today must solve for an ever-growing variety of contexts & circumstances – but the kicker is that each time there’s a new breakthrough in our display technologies and devices, we’re having to almost completely rethink our approach to creating visual interfaces that effectively capitalize on these new capabilities.

 

This is becoming unsustainable – we can’t keep redesigning our entire visual methodologies with each new innovation, so there’s an immediate need for an intuitive interface medium that works in almost any context, and has enough future-proofing built into it to stick around for a while.

Words are the new pixels

So, I’m just gonna throw this out there: humans have been communicating with words for about 70,000 years. We all know how to use them and interpret them, and I’d argue that words are the only truly responsive UI element for all computing devices, past, present and future.

Words: they worked back then, and they still work now

Words work at all screen resolutions, on all devices, across all global cultures, and in almost any context. This is an indispensable trait, since your responsibility as a designer is to guide users as they hop between individual interfaces within an overall guided experience.

Words are built for sharing experiences, ideas & stories

No matter how well-designed your website & mobile app are individually, if the transition between them is disjointed, it’s still a bad experience for the user.

As a result, customer preferences are shifting from favoring individually well-designed interfaces – Brand X’s mobile app, Brand Y’s website, and so on – to expecting a seamless overall experience within a single brand, regardless of the context. Businesses are discovering that this seamlessness is essential for driving repeat purchases from customers in a recurring cycle, nicknamed the Loyalty Loop.

In short, users need compelling narratives to guide them through the entire experience – not more infinitely-reconfigurable visual interfaces.

Wall-E is a masterclass in visual storytelling – but few can reach that bar consistently

 

Thing is though, unless you’re Pixar, it’s really hard to tell a compelling, understandable story without words. Thus, the shift towards designing cohesive narratives for customers across multiple channels is opening the door to competition with visual designers on their own turf. Copywriters, authors, linguists, voice actors, casting directors, screenwriters, hell even songwriters – are all about to get into the user experience game.

 

These folks are already familiar with creating engaging non-visual content – and demand for their expertise is about to explode. Although voice interaction has penetrated the mainstream, there’s still a dire need to build & maintain customer engagement. Alexa’s total library of almost 7,000 Skills (that’s Amazon-lish for “Apps”) currently averages only 3% retention after 2 weeks – ouch!

What designers can do to keep their jobs

LUKE: “With the blast shield down, I can’t even see! How am I supposed to fight?” OBI WAN: “Your eyes can deceive you. Don’t trust them.”

Effective storytelling is as big a differentiator for today’s UX designers as the “unicorn” status of designers who could also code in the ‘00’s and early ‘10’s – so here’s what visual designers should be doing to prepare for this shift.

Lorem Ipsum must die – Content IS the design, so it should be factored into your workflow from the outset of the project. No more punting consideration of content down the road (although Samuel L Ipsum is always welcome entertainment 😉

Understand the structure of a good story – There are tons of ways to do this – learn from storytelling masters like Pixar, read a “Choose your own adventure” book, study Joseph Campbell’s timeless classic “The Hero with a Thousand Faces”, or even play a text-based adventure game like Zork.

Tease apart and deconstruct these examples to learn how words alone can guide and compel users through an experience.

Learn the art of persuasive writing – Don’t fear the encroachment of writers on “your design turf” – embrace them, learn from them. They may know this new, invisible medium better than you do, but you know how to incorporate their work, and harness it to create compelling user experiences.

The legendary Zig Ziglar’s “5 obstacles to a sale”, and the Persuasive Triangle are great frameworks with which to start learning how to write persuasive, compelling copy.

In summary: Learn to use your words

Visual-first design is in decline, so designers must become familiar with telling stories via the invisible media of voice and text. There are a number of drivers behind this decline:

Words are the ideal medium for accommodating this next phase of human-computer interaction. They’re universally used and understood globally, and are easily woven into stories that can fit into any user context.

Designers who embrace the power of storytelling will be better positioned to navigate the transition from visible to invisible computing – and I, for one, can’t wait to see what kinds of stories you guys start telling.

 

Comments
  • Love this post, and think it is quite relevant in theory. In practice, you may be a little ahead of your time.

    I do think designers need to start getting better at being storytellers as a whole, but I think we are also a long way from a world where designers (especially as they relate to the experience of interacting with a product or application) are in short demand.

    If anything, I think the master designer’s stock is rising and will continue to do so for the next decade or more. And while I do think we may be interacting more and more with voice technology over the next few years, we will still be using our eyeballs as the primary source for input and interaction with digital devices. Especially as we step into the world of augmented and artificial reality.

    I think voice will be mostly for the navigation and direction of the software, and should be thought of as an additional navigational element as opposed to a complete replacement. At some level we will still need to see what we are doing, even if that projection is inside our eye rather than on a screen.

    So I guess all that is to say that the savvy designer is not stepping away from the things that make them so, just learning new skills and adapting to new technology. And that, just like words, will never go out of style.

    Much love from your fellow storyteller!

    • Cheers for reading man! =)

      “If anything, I think the master designer’s stock is rising and will continue to do so for the next decade or more. And while I do think we may be interacting more and more with voice technology over the next few years, we will still be using our eyeballs as the primary source for input and interaction with digital devices.”

      Great points! To me, it’s really about where we continue to devote manpower vs deploy automation – and that decision is ultimately driven by time and cost vs return.

      Totally agree that voice interaction and chat will quickly take over the Input part of the equation, with humans remaining in charge of constructing the visual Output (for now). But given the fact we’ve already got automated layout generators on the market, and decreasing use of visual UI as voice and chat rapidly improve, those days of human-controlled visual layout are numbered.

      Someone may be a master visual designer, but it’ll be like saying they’re an expert morse code radio operator – it’ll be a discipline that’s no longer as valuable or cost-effective as it used to be. Now, a designer of *experiences*, who’s able to seamlessly weave together disparate interactions into a compelling, cohesive story – agree, this is someone who’ll enjoy a longer, more fulfilling career in the space.

      I think it’ll surprise us how quickly the visual design function will be reduced to a voice prompt – just like how today, I can simply check a box in Mailchimp to automatically generate a plain-text version of my email campaign:

      “Raymmar, would you like to auto-generate a backup visual UI for this application? Yes/no?”

  • Philip Sutherland

    Great column! I totally agree with your basic premise, and not just because I’m both a UX Designer and writer. In a new world of multiple digital media, User Experience should be defined by (duh!) user needs and goals rather than by a particular means by which interaction is facilitated (such as the UI). Ultimately, we will design the experience that best serves our users (while also achieving business and technical requirements) and select the combination of interaction media (visual, audio, touch, etc.) that realizes that experience. We are moving from an era of multiple-device ecosystems to multiple-media ones. And, to your column’s point, a user’s experience in a multiple-media ecosystem can best be described (but not prototyped) through stories. I would add that the other major factor in UX that also can best be portrayed through story is AI/predictive analytics/machine learning. A user’s experience will be through multiple media, but it also may be dynamically orchestrated by the system based on prior interactions and other data-driven means. Customization and clarity through data, with story as the UX “spine.”

    • Thanks Philip! Yep, it’s funny how the basic approach hasn’t changed, right? Design has never been about the medium – it’s much more about the approach of elegantly solving people’s problems, rather than devoting ourselves to a specific set of tools, and ignoring anything else.

  • Maigen

    This was such a great read. I was interested because I’ve always been the writer in designer’s clothing (but not designer clothing!) and it’s been a struggle to design *without* being concerned about content. I especially appreciated the point about how Alexa is failing to maintain customer engagement – it’s such a clearly unmet need, but no one has quite solved it yet. Thanks for writing about it!

    • Right on, thanks for reading @disqus_hN2Di1nAJa:disqus! Yeah, I think the technology is enabling us all to shed the labels of our disciplines, and instead embrace the storytelling, regardless of how it’s done – via words, pictures, finger puppets, you name it.

      At the end of the day, no matter what the medium is, people need a good story in order to care about what it is you’re trying to get them to do.

  • Facebook User

    Great post! Some well though out ideas.