From the True Value of an Internet to a Fluther of Q&A

Every week I read thousands of blog posts. For your weekend enjoyment, here are some of those highlights.  What are you reading this weekend?

01_intern

On Starting Up…

http://www.businessinsider.com/5-reasons-why-your-interns-are-better-at-social-media-than-you-are-2010-8
Leverage the power of the Intern to improve your social media engagement.

 
 

On Design & Product Experience…

http://woorkup.com/2010/08/09/best-practices-to-design-a-perfect-html-navigation-bar/
Achieving perfection in the navigation bar.

02_navigation
03_fluther

On Modular Innovation…

http://techcrunch.com/2010/08/09/federated-fluther-lets-third-parties-integrate-qa-with-a-few-lines-of-code/
A Fluther of Q&A within Modular Innovation.

 

Have a great weekend!

Jeremy Horn
The Product Guy

About these ads

Evaluating Accessibility: The Quick-UX Way

clip_image001Accessibility is the measure of how many differently skilled/abled types of people (including individuals with disabilities) in varying locations (e.g. mobile web) can make use of a given product. There exist many, very thorough, guidelines for determining the degree to which a product adheres to accepted accessibility standards. However, many can be very complex and time-consuming, also requiring the study of a good deal of the underlying code — much of which goes against the goals of the ‘quick’ part of Quick-UX.

Quick-UX

Quick-UX provides for the rapid, simple and quantifiable assessment of a product’s User Experience (UX). In answering the question of Usability, "Should I use it?" the sub-category of Accessibility represents one of the more complex components.

In Parts

Greater Accessibility provides greater benefits to people both with and without disabilities, from equal opportunity to facilitating perception and navigation.

There are many factors that go into achieving Comprehensive Flexibility.

Navigation
Orientation
Alternate Text
Scripting Usage
CSS Implementation
HTML Standards
and more…

As there are many factors, there are also many techniques and frameworks for evaluating them:

Web Content Accessibility Guidelines (WCAG)
http://www.w3.org/TR/WCAG20/

Accessible Rich Internet Applications (WAI-ARIA)
http://www.w3.org/TR/wai-aria/

User Agent Accessibility Guidelines (UAAG)
http://www.w3.org/TR/UAAG10/

Electronic and Information Technology Accessibility Standards (Section 508)
http://www.access-board.gov/sec508/standards.htm

Quantified

I use a robust (and free) proxy for quickly assessing a product’s Accessibility through the use of the Functional Accessibility Evaluator (FAE) link. The FAE’s resultant scores are averages which, in turn, are normalized to a range from zero to one to represent the value for Quick-UX‘s Accessibility variable.

01_fae_results

For a long time I used a simple normalizing of a product’s Passes, as determined by FAE, to a 0 – 1.0 scale. Over time websites have been improving due to the increased usage of templated languages, development libraries, and the improving skillsets of web developers. As a result, I found the need to shift my scale to more readily capture the increased quality and more clearly highlight the differences between the calculated Accessibility values.

The new equation I have been using to raise this bar on website Accessibility follows:

  1. Take the average of all 5 categories of FAE determined Passes. The result is X, the normalized Pass score, and falls between 0.0 and 1.0.
  2. Shift and expand the scale. The result is Y.
    • Y = 2X -1
  3. Finally, the Quick-UX Accessibility value, QUA, is bounded:
    • QUA = Y for Y ≥ 0
    • QUA = 0 for Y < 0

See the Quick-UX Worksheet for easy, automatic calculating of the QUA (and other Quick-UX variables).

Levels

Once quantified, a product falls into 1 of 5 levels that we will be exploring and discussing in the remainder of this series on Quick-UX Accessibility. They are:

  Comprehensive Accessibility QUA > 0.8
  Nearly Comprehensive Accessibility QUA > 0.6
  Moderate Accessibility QUA > 0.4
  Fair Accessibility QUA > 0.2
  Poor Accessibility QUA ≤ 0.2

Scope

For this discussion of Quick-UX Accessibility, I evaluated over 50 products and will be exploring a select subset in greater detail in the coming articles. The distribution of the evaluated products for this series can be seen in the following chart.

clip_image003

Quick & Usable

Over the next few weeks I will be exploring the ins-and-outs of a variety of products, and walking through real-world examples of the Quick-UX evaluation of Accessibility

Comprehensive Accessibility [RoundHouse & FAE]
Nearly Comprehensive Accessibility [UseIt & Eboy]
Moderate Accessibility [Borders, Bloomberg & NY1]
Fair Accessibility [CNET & Drudge Report & NBC NY]
Poor Accessibility [GoodReads & Barnes and Noble]

Quick-UX Accessibility Summary, Charts & Data

Subscribe now (click here) to make sure you don’t miss any part of this series exploring the Usefulness and Credibility components of Quick-UX, the quick and easy method of generating quantifiable and comparable metrics representing the understanding of the overall User Experience of a product, as well as other insightful posts from The Product Guy.

Enjoy!

Jeremy Horn
The Product Guy

The Product Guy’s Weekend Reading (September 18, 2009)

Every week I read thousands of blog posts. Here, for your weekend enjoyment, are some highlights from my recent reading, for you.

01_social_business

On Starting Up…

http://blog.opensocial.org/2009/09/business-of-social-applications.html
An introductory look at the business models of social applications.

 
 

On Design & Product Experience…

http://buildinternet.com/2009/09/principles-of-effective-web-navigation/
A thorough walkthrough of many guiding principles of web navigation.

02_web-nav
03_google-dlf

On Modular Innovation…

http://www.webpronews.com/topnews/2009/09/14/google-wants-you-to-be-able-to-leave-if-you-want
Support of increased Modular Innovation from Google’s Data Liberation Front.

 

Have a great weekend!

Jeremy Horn
The Product Guy

Add to Social Bookmarks: Stumbleupon Del.ico.us Furl Reddit Google Add to Mixx!

Can I use it? Evaluating Usability through Quick-UX.

user-useit The first of the 3 primary components of Quick-UX, of which I will be discussing in greater depth, is the one of Usability. Put simply, Usability is a measure of how easy something is to use.

In sticking with the primary goals of Quick-UX (quick assessment for summary, directional guidance, and quantitative comparison) the variables constituting the minimal representative subset for Usability are…

  • Accessibility,
  • Consistency,
  • Recognition,
  • Navigation, and
  • Page Load Time.

Accessibility

Accessibility is the measure of how many differently skilled/abled types of people (including individuals with disabilities) in varying locations (e.g. mobile web) can make use of a given product. There exist many, very thorough, guidelines for determining the degree to which a product adheres to accepted accessibility standards. However, many can be very complex and time-consuming, also requiring the study of a good deal of the underlying code — much of which goes against the goals of the ‘quick’ part of Quick-UX.

I use a robust (and free) proxy for quickly assessing a product’s Accessibility through the use of the Functional Accessibility Evaluator (fae) link. The fae’s resultant scores are averages which, in turn, are normalized to a range from zero to one to represent the value for Quick-UX‘s Accessibility variable.

Consistency

Consistency is a fundamental component of Usability. The less learning a new user has to do to use a product the more usable is that product. Products should not have multiple interface elements, page layouts, or content that are used for the same purposes, but vary depending on how the user got their or where they are currently looking.

For example, if the product/site is in the travel industry and the site often references ‘travel search engines,’ a consistency that can grow confusing (inconsistent) is when the language that describes the same engines varies from instance to instance, from ‘engines’ to ‘tse’s,’ to ‘search travel engines,’ etc.

The determining of the value for the Consistency variable is done through the brief surveying of the product, and assigning a…

  • 1 if there are no apparent inconsistencies,
  • 0.5 if only minor, non-intrusive inconsistencies are found,
  • 0 if there exist inconsistencies on major element(s) or a majority of minor elements. Inconsistencies on major elements lead to immediate confusion and second guessing information being conveyed.

Recognition

The measure of the Recognition and intuitiveness of a product conveys how easily an average user of a product can immediately grasp how to use it. When evaluating this Usability variable remember… YOU are NOT an AVERAGE user. The Recognition variable is assessed from the perspective of an average user and is assigned a value of…

  • 1 if the interface and product, in general, feels familiar and is easy to use,
  • 0.5 if some poking, finesse, and interaction are required before the user will be able to gather his or her bearings in the use of the product,
  • 0 if the average user will have clear difficulty understanding (1) how to use the product and (2) what the product is trying to communicate.

Navigation

Evaluating the Navigation variable as it relates to Usability (and Quick-UX) also includes, in addition to site navigation, the review of the site’s flow, transitions, interactivity, and clear communication of progress. If a user can’t figure out how to get from point A to point B, or is not presented with clear information as to how he or she got to point C or that there remain points D through Z to still travel, the overall Usability of the product can be sorely damaged.

The Navigation variable is assigned the value of…

  • 1 if the product presents a straightforward decision process, leveraging animated transitions when appropriate, providing clear feedback, and communicating progress within each multi-stage task,
  • 0.5 if the two following conditions are met:
  1. occasional, but easily correctable, mis-steps in accomplishing tasks and/or completing processes occur, and
  2. there exists a visible current progress indicator for all multi-step tasks,
  • 0 if any of the following scenarios occurs with frequency:
    • resultant Interaction or other resultant event occurs contrary to the desired decision path,
    • surprised by result of interaction, or
    • no communication of progress, flow, or navigation.

Page Load Time

There are some products out there (Twitter comes to mind) that could not possibly have an easier to use interface coupled with a simpler purpose (to say what you are doing) that are frequently rendered barely, or completely, unusable due to entirely unacceptable product responsiveness.

A company can have the best product around, but if the pages are too sluggish, they can achieve a real pain-point in the overall user experience, rendering a product unusable.

Assessing the Page Load Time variable requires very little of your time. However, I do recommend you average at least a few data points over the course of a day, or days, to make sure you have an accurate sense of the normal product responsiveness.

  • If the product typically loads the information promptly (within acceptable expectations) then the Page Load Time variable is assigned the value of 1.
  • If the product exhibits the occasional, inconsistent delay, use 0.5.
  • And, if the product (like Twitter, at the current moment) has frequent and long delays (including outages) the value for Page Load Time variable is 0.

Usability. Quickly. Done.

The quantitative assessment of these variables are structured to provide a quick and painless method of evaluation to form a summary, directional guidance, and/or values that facilitate inter-product comparisons through the answering of the basic question…

Can I use it?

When answers to the above question of Usability is combined with…

Should I use it? (Usefulness)

Do I want it? (Desirability)

… the result is a product’s overall, repeatable, quantitative assessment of User eXperience.

Enjoy! (and discuss)

Jeremy Horn
The Product Guy

Quick-UX. Quick Heuristics for User eXperience.

heuristic Introducing… Quick-UX

There are many procedures, rubrics, methods, analyses and theories with respect to assessing the overall User eXperience of a product. Most User eXperience assessment approaches require a heavy investment of time, analysis and effort.

Often, a quick assessment of User eXperience is more aptly called for. A quick assessment allows for rapid compilation of simple heuristics that can be very handy in providing…

  • a summarized view of a product’s overall User eXperience,
  • directional guidance for a product’s future development, and/or
  • metrics for comparison with other products.

More detailed and extensive heuristics (many with hundreds of variables to evaluate) exist that delve into the finer details that lead to more directly actionable steps, but they are neither cheap in time nor money.

Quick-UX is a method that I have developed and refined over time and frequently utilize when quick assessments are best suited to the task. The method that I describe below is a great way to build a summary description with quantifiable and comparable metrics, representing the understanding of the overall User eXperience of a product.

The Quick-UX evaluates the degree to which a product successfully addresses the following 3 questions:

The elements evaluated in response to each question constitute a minimal representative subset that accurately addresses the question posed while adhering to the goals of Quick-UX.

Evaluating Usability

Whether or not something can actually be used is critical to a product. Quickly evaluating the ease with which the typical consumer can use a product consists of looking at the following variables:

  • Accessibility,
  • Consistency,
  • Recognition (also including Intuitiveness),
  • Navigation (also including site-flow, transitions, and interactions), and
  • Page Load Time.

Each variable here, as well as those making up the other 2 evaluation categories (‘questions’), possess specific rubrics to generate repeatable and quantifiable values (each normalized to be of the range from 0 through 1 or 2) that can consistency be understood and compared to like evaluations. For the Quick-UX, each category can, through the summing-up of each of its values, achieve a maximum category score of 5 (minimum being 0).

Evaluating Usefulness

What good is a product if it isn’t useful? Does the product solve a new problem, or an existing problem? Does it do so in an innovative and creative way? The quick evaluation of Usefulness is constituted by an assessment of these variables:

  • Functional Expectations (expectations are created via marketing, content, branding, etc.; put another way, ‘were the functional expectations of the product, from the perspective of the consumer, achieved?’),
  • Errors (including handling, recovery, and prevention),
  • Product Differentiation (including memorability),
  • Findability (i.e. search engine friendliness), and
  • Credibility.

Evaluating Desirability

The Desirability of the product, its appearance and the feelings it can stir in the user through the methods of presentation, can often be a good proxy for the organic word-of-mouth campaigns and buzz that spring up around it. Desirability taps into the emotions of the product’s users through:

  • Aesthetics (and Minimal Design),
  • Page Layout,
  • Color Scheme (including Contrast), and
  • Typography.

Desirability consists of only 4 variables. Aesthetics, unlike all of the other variables in the Quick-UX, is normalized to a range from 0 through 2, due to its greater impact on the overall desirability of a given product.

Try it. Use it. Tune it.

All of the values, when summed up (max. value of 15), form the UX (User eXperience) Rating for the evaluated product. The higher the rating, the better the product’s overall User eXperience. My favorite use for this evaluation is to quickly compare the User eXperience of multiple products with one another.

As the Internet and online products evolve I update and adapt my approach to quick evaluations. Let me know how the Quick-UX works for you. Tweak it, adjust it to suit your particular goals. Please share your findings.

What sort of quick User eXperience evaluation methods do you use?

More Information

You can read more about alternate User eXperience evaluation heuristics and theories at these websites…

  • Ten Usability Heuristics (link)
  • Stanford Guidelines for Web Credibility (link)
  • The User Experience Wheel (link)
  • Metrics for Heuristics: Quantifying User Experience (part 1 part 2)
  • User Experience Design (link)
  • User Experience Strategy (link)
  • How To Quantify the User Experience (link)
  • Designing Interfaces (link)

Enjoy & Post experiences with Quick-UX and other methodologies.

Jeremy Horn
The Product Guy