The recent emergence of new users, mobility, Internet of things, new form factors, multi input types and work environments presents a tipping point. A shift that force us to change the way we design productivity experiences.
Much like during Modernism, we are moving to design experiences that are Authentic to our present materials, the software we build and the way it is represented. These materials allow us to build applications that are free from old world metaphors.
Instead, they can be adaptive, contextually aware, focus on intent and function first, optimized to fit any output and accept any input.
Experiences that help users focus on their work, reduce the effort it is needed to achieve great outcomes, and offer relevant and meaningful choices. Experiences that are rooted in our present.
This presentation will discuss the nature of the changes, and how Modern Digital Experiences might shape our lives.
5. Image credit Maciek Lulko, Museum of Arts of the XXI century MAXXI , zaha hadid
Authentic to the present
Intent and function first
Simple to fit our lives
Adaptive to fit input and output
Effortless creation
Contextual & relevant
Modern Digital Experience
16. Existing mental model
New information
Form follow function
Accommodation
World perception
Assimilation
World perception
Reality Perception
17. Image credit The Faulkner Portable" by Gary Bridgman
Perfect Originals?
The combination of people,
procedures, and equipment
which transforms ideas
into printed communications
Intent focused
The combination of people,
procedures, and equipment
which transforms ideas
into meaningful outcome
27. Current designsContextual designs
Using contextual awareness to reduce information flatness
Level of
granularity
Level of
abstraction
Reduction
SimplificationPrioritization
Classification
Type of
representation
ondon Metro map 1912 (top), 1933 (bottom)
30. Free Table
Nice and sturdy, just come and pick up
Input appropriate manipulations Swipe signature moment Two fingers signature moment
Input authenticity
34. Image credit Chris Ballard
Having a cell phone by their desk
reduces productivity by
20%
35. Image credit Chris Ballard
They check their phones about
150 times a day, or every
6 minutes
36. Image credit Chris Ballard
It takes about
to return with full attention to a serious mental task
after they respond to an e-mail or instant message.
15 minutes
42. Image credit Maciek Lulko, Museum of Arts of the XXI century MAXXI , zaha hadid
Authentic to the present context
Intent and function first
Simple to fit our lives
Adaptive to fit input and output
Effortless creation
Contextual & relevant
Modern Digital Experience
Notes de l'éditeur
wait
Hi
My name is Erez Kikin-Gil, and I am a senior design Manager at Microsoft.
In the recent years, I focused on designing the next generation of productivity applications and their core UX framework for tablets and mobile phones,.
I During that time, I had the opportunity to examine their evolution first-hand.
The thing that stood up for me was that many productivity applications are based on old world mental models to signified functions, tasks, and their overall framework.
For example, Presentation applications are based on slideshow projector. Word processing are based on typewriter and paper, and so on.
This was done to increase familiarity, and to help people learn the new medium.
I also noticed another type of experiences. Modern experiences that left behind old world metaphors in favor of being authentic to the digital medium.
And that conflict is something that occurred in our past.
You see, Using design cues from earlier technological stages to gain people’s trust can be seen as early as the Greek architecture.
Architects imitated in stone the shapes that the wooden posts created, when laid in traditional wooden buildings.
And the in the 1920s, Modern architecture movement rejected that classical approach.
Instead, Modernism offered an approach that is based on science, on forms followed function, Simplicity and being authentic to the new materials, such as steel, iron, and sheet glass.
And then I realized that we are in the middle of a similar revolution.
That recent emergence of new users, mobility, Internet of things, new form factors, multi input types and work environments presents a tipping point. A shift that force us to change the way we design productivity experiences.
Much like during the Modernism, we are moving to design experiences that are Authentic to our present materials, the software we build and the way it is represented. These materials allow us to build applications that are free from old world metaphors.
Instead, they can be adaptive, contextually aware, focus on intent and function first, optimized to fit any output and accept any input.
Experiences that help users focus on their work, reduce the effort it is needed to achieve great outcomes, and offer relevant and meaningful choices. Experiences that are rooted in our present.
This presentation will discuss the nature of the changes, and how Modern Digital Experiences might shape our lives.
How did this change start?
Around 1980, social digital technologies such as Usenet and bulletin board systems came online.
Digital Natives, a term coined by Marc Prensky in 2001, are people that were born to that era, had access to networked digital technologies and the skills to use this wealth of information.
Others, typically titled Digital Immigrant, were born before that time, lacked that access, and had to learn how to adapt that reality, and adopt to it.
Born in to this world, Digital Natives take technology for granted.
They use it constantly, and depend on it.
In many ways, digital technology change their perception of the world, and expectation from it.
Kanye
When Digital Natives start to interact with some productivity applications, they encounter a world that might seem foreign.
A world where applications depend on imitation of the old world metaphors.
Back when these applications were designed, Filofax or Overhead Projector were useful to represent what is the app doing. They promoted easy adoptions, alleviated fear, tested well in the lab, and seemed familiar for users and decision makers.
For most productivity applications, embracing old-world mental models was a natural course of evolution.
Take Word processing for example.
After their invention in the 1860s, typewriters became a synonym for serious writing, and were widely used in business scenarios
At the end of the 1960s, when Word Processing applications were first developed, IBM Typewriter was used as the terminal text input device. Since CRT displays were not available yet, paper as the output channel.
In many ways, this defined the mental model for word processing for years to come.
But Digital Natives this mental model is no a great reference point. Their world is founded on Born-Digital experiences, like Spotify, Facebook, SoundCloud, Medium and Twitter .
Experiences that much like Modernism are focused on form follow function.
Experiences that strip down old-world mental models, in favor of being authentic to the digital medium.
Experiences that prefer to simple, and use direct signs and symbols, like Plus, Minus, & Arrows to signify function,
over old world metaphors like the real looking knobs and dials.
Experience that use Verbs over Nouns to guide the users.
And that is the path that productivity applications should follow as well.
A path that places function before form, a path that is founded on the Digital Natives point of reference.
this means changing the way we think about productivity applications
It means that being tided down to the form has also an adverse impact on the designers, as they design and evolve these experiences.
This is because of the unique way mental model impact our world perception.
You see, mental model is a cognitive structure that explains what something is, and how it works. A representation that helps us shape the perception of our surrounding, and helps us form the action and attitude towards it. Mental model helps mitigate unfamiliarity, by allowing us to form an opinion on the new information, based on the old. Jean Piaget, the originator of the constructivist theory, explains that through accommodation and assimilation, people construct new knowledge, based on their past experiences. In accommodation, people reframe their mental model, to fit the new experience. That is where new understandings are forming. In assimilation, people incorporate new experiences into the framework, without changing it. People might not modify the framework if they misjudged the input, or if it contradict their internal reasoning. This why mental models are a tool to understand the world, but also to shape it. This is also why using old-world mental models might help, but also might limit us, as we design and use digital based experiences. As designers and users, once we bound to a specific mental model, it is hard to break free.
Show mental model diagram
At first their main value proposition was to generate “Perfect Originals”.
For a short time, IBM, the company that coined the term “Word Processing”
played with the following definition :"the combination of people, procedures, and equipment which transforms ideas into printed communications".
And they were close.
What if we simply change the end and help user’s content presentable not just on paper?
This is the interesting part about mental models, and their relationship to product development process. It is a two-ways street.
Mental models help us understand the experience, how to use it, and develop a cognitive model for it. However, mental models also create an expectation for what it should be, as we design it. It helps us set a product definition, but at the same time, it can also prevent us from evolving the product beyond the original model.
Take for example a design sprint that is focused on developing brand new Corkscrew. Some process will start with competitive analysis, looking at existing solutions.
Typically, this would lead our minds to use the existing mental models as the starting point, which most likely would result in incremental changes, which sometimes is a fine goal.
The other problem with that is that it would also lead to system blindness, fear of braking taboos, and refusing to accept realities if they contradict internal reasoning, or impacted from one of the other many biases we humans suffer from.
Being authentic to the medium is another aspect of modern experiences.
With the proliferation of mobile devices and tablets, new challenges emerged. One of them was screen size resolution. If in the past, content and the application were optimized to fit a fixed screen size, designing for today’s world requires considering a verity of sizes. These sizes can range from 320X480 on the smallest phones, 768X1024 on mid-level Tablet, to 1366X768 and higher for laptops and desktops. On top of that, portrait and landscape views as well as soft keyboard needs to be considered ...
Responsive Design is a method that originated from web design, as websites had to deal with changing browser size.
Inspired by print and graphic design, Responsive Design aims to give the best viewing experience on a range of devices and screen sizes, by carefully rearranging the layout, based on a grid.
And this is where Modern Digital Experiences are headed to.
Scaling the application and user content, while maintaining their meaning.
In the past the general convention was that there is a parity between the way the document originally looked like, and its meaning.
A High fidelity document was a documents that looked the same as the original.
Another thing that contributed to this was that users had to invest a lot of effort in styling each and every bit of the content, they were emotionally invested in the way it looked like.
But in a multi-screen size world we have to change these and move to a new approach as the current one literally do not scale.
We need to move away from WYSIWYG, (what you see is what you get) to WYSIWYM , (what you see is what you mean).
And to do that, we need to understand content semantics, so we can rearrange it in the right way, on different screens.
We need should use inferred logic and layout analyzer to objectify things like page title, subtitles, images, charts, shapes, and their relationships.
And let me show you an example for that.
And finally, users can pick the a layout that fit their own desires, from verity of options.
This would dramatically reduce the effort people have to invest in the content styling, allow them to focus on their job, and would reduce their attachment on a specific layout design.
Lastly, users could view how their content looks on different devices, and make changes immediately.
That would ensure that the content is truly device agnostic, and allow the content to play its part,
regardless of the medium it is presented on. As Marshall McLuhan said: “The medium is the message”,
something that is somewhat ignored in modern applications.
Being authentic to the digital form
The calendar is another place where leaving old-world mental models behind could increase its usefulness.
calendar is a visual representation that tries to balance information density, space and type of representation to convey time and events.
Creating a good balance reduce perceived complexity that comes with long term planning, and large amounts of information.
Heavily influenced by Filofax and personal organizers in the 1980s, Modern calendars adopted many of their designs.
For Personal Organizer, the grid is an underlying structure.
People add event information, on top of the grid, but were not restricted to it.
In digital calendars, this is a different story, as events are restricted to a grid structure.
When information density become too high, the results is data loss, like the event title truncation, and so on.
What if we allow the grid to be adaptive to the event content?
What if we adjust it to be more meaningful for the act of planning forward, while maintaining a cognitive structure of a week?
After all, this grid is digital, it is not carved in stone. We can move it as needed…
Another aspect of modern digital experiences is form follows intent.
And in the calendar day view, user intent is to see how his day looks like, in a glance.
In todays’ calendars, adhering to a rigid grid, where the space events occupies is the same, regardless if it is a free of busy hour results in a limited view. You can barley see six hours.
But what if we find a way to make the grid flexible, allow it to be adaptive to the type of content it hosts
Another attribute of Modern Digital experiences is that they can be aware of the user information and action, to make our experiences much more meaningful and relevant to our lives.
Take for example the calendar month or year view.
Today this views show events in a very similar way.
They rarely priorities them, show little to no classification, and rely on users to indicate importance or typology.
But we could do better.
We could learn from other experiences like maps, and when we move to higher information density, show information that is relevant for that view. For yearly views these would be events that are critical on that level.
And to do that, we would need to capture event inferred information, like importance, priority, event type.
Just imagine when users add event, and based on the event title, people they invited, or location, agenda, and recurrence, the event will be classified accordingly, and perhaps also receive appropriate representation.
Being Input Authentic is another feature of being modern.
From their early days, productivity experiences used pointing devices to select and manipulate objects.
In recent years, touch input took over the role of pointing devices but it did it in a way that mimicked the mouse.
Which is funny as mouse mimics our hand.
And this kind of imitations leads to many problems.
The problem is that touch is great in some tasks and not others.
Mouse is a highly precise input, which allows a high density target surface.
Mouse has continuous screen presence (cursor), which affords hover scenarios.
Mouse is also is an indirect control, and its screen representation presents a very minimal occlusion.
Touch on the other hand is not an accurate input type, but it is emotionally rewarding. Touch contacts size is much larger then mouse, and the uniformity of contact size changes based on the size of the finger.
But when people use touch, specifically gestures, even if the outcome is less accurate, they still prefer it.
Touch is great for interacting with large targets, and certain object manipulations, like rotate and zoom. Touch is a less effective when it comes to interacting with small object selection.
The most striking example is in text manipulation, specifically when users need to place the Insertion Point.
The most striking example is text manipulation, specifically when users need to place the Insertion Point.
With touch, that interaction is extremely hard.
The insertion point (IP) is typically small, the finger occludes it as well as the content it is targeting.
Current designs are trying to predict where users wanted to place it, or offer a disambiguation tool, like the magnifying lens, when users finally give up.
This type of solutions are needed when one input type is mimicking other input.
In a Modern Digital Experience, focusing on the intent first would resolve it.
In the example on the left users try to fix the misspelled word.
Rather then adapting to place the insertion point with the finger, it would be easier to select the misspelled word, use the candidate window and add arrow keys for additional refinement.
So what is the role of touch in a digital world?
And one of the unique qualities is that touch can carry emotional value and bind the digital and physical world.
And we could use that for a greater brand experience.
Another aspect that has drastically changed in the last 20 years, is the workplace environment.
When productivity applications were originally designed, the work environment was much less distracting, typically take place in an office, with sufficient attention, focus, time and dedication to excel at learning and utilizing the application.
Applications that offered rich functionality in a one size fits all model, that addressed many different needs for many different scenarios.
They offer rich capabilities that allow users to manipulate every bit of their content.
But today’s productivity environment is very different.
Today people need to be successful in a On the Go, multi-tasking, highly distracting, multi input, multi-screen size environment.
And this has a cost. Research have shown that these changes makes them sicker, stressed, suffer from noise and become less productive.
Since they are always connected to information and technology, they can’t focus on their work more than 7 minutes at a time, before they turn their attention to switch a window, check their emails, or check Facebook.
Just having a cell phone by their desk reduces their productivity by 20%.
They check their phones about 150 times a day, or every 6 minutes on average.
It takes about 15 minutes to return with full attention to a serious mental task after you responded to an e-mail or instant message.
Modern Digital Experiences understands these constrains, and excel in offering novel interactions that reduce the effort needed to achieve great outcomes.
Rather then forcing users to manipulate every little aspect of every object, users are presented with well crafted set of curated outcomes to select from.
A model that is focus on the act of creation first, and manipulation later.
That hides commands until they are needed, and when they are, they are always within reach.
A model that adhere to Hick’s law and to the paradox of choice, and offer just what is needed.
A focus enabling model that reduces system distractions, across user devices, and enables flow. Perhaps when a user writes a document, communications and notifications are reduced to a minimum so users could focus on their tasks.
OMMwriter
The other aspect of Modern digital experiences is to utilize the information we know to the benefit of the user.
Offering a relevance driven model has huge potential
This type of model can learn the users’ context, communications, place, activities, device they use, and other signals to offer an experience that is tailored to their needs.
Yes, one way to think about this is showing different functionality to different users – or in other word- situated experiences.
But more interestingly is making a more relevant applications.
Take for example a task application, which typically suffers from information overload, makes the amount of tasks overwhelming and unmanageable.
But what if we use context awareness?
What if we allow applications to capture, expire, and reorder tasks based on what we know about the user?
In this example, tasks are ordered automatically based on the user’s location, time of the day, her upcoming events, her recent communications. The system can add tasks, based on incoming e-mails, or remove tasks if they are not relevant.
In a lastly, Modern Digital Experience like Microsoft Away, would allow users to focus on the act of authoring, reducing the hassle of adding content, formatting content, and sharing it.
The interesting part for experiences like Sway, is that they are Born-Digital.
They are not a Word document, or a Power Point presentation.
They are new way to express your self in a digitally authentic fashion.
In presentation we mentions how recent emergence of new users, mobility, Internet of things, new form factors, multi input types and work environments presents a tipping point. A shift that force us to change the way we design productivity experiences.
that Much like during the Modernism, we are moving to design experiences that are Authentic to our present materials, the software we build and the way it is represented. These materials allow us to build applications that are free from old world metaphors.
Instead, they can be adaptive, contextually aware, focus on intent and function first, optimized to fit any output and accept any input.
Experiences that help users focus on their work, reduce the effort it is needed to achieve great outcomes, and offer relevant and meaningful choices. Experiences that are rooted in our present.
This presentation will discuss the nature of the changes, and how Modern Digital Experiences might shape our lives.