The changing face of usability testing: Optimal Workshop releases free service called Treejack

With the downturn in the economy, companies are trying to do more with less. Some are outsourcing jobs, others are laying off contractors, and still others are firing all their consultants. Usability testing is no exception–especially since consultants usually charge between $5,000 and $20,000 per project.

chalkmark

A New Zealand company called Optimal Workshop is trying to disrupt the usability space by offering free software that replaces consultants. Instead of hiring someone, you can use Optimal’s web-based products to test mockups, usability, navigation, and site architecture. They just released their third Software-as-a-service product focused on testing menu navigation.

Sam Ng, one of the founders, told me:

If we succeed with these tools, we’re working ourselves out of a job (we’re usability consultants by day). However, we think the user experience scene will soon experience a paradigm shift from consultant services to software for do-it-yourselfers. We’d still like to have jobs, which is why we’re doing this.

Their second product, Chalkmark, lets you do “micro” user tests remotely by uploading an image of your design, setting a task for that image and sending it to participants as an online “survey”. It’s a painless way to verify your website presents data intuitively–for example, the survey I tried asked me where I should click to find more info about advertising on VentureBeat. (Try it yourself here.) The screenshots can come from paper drawings, Photoshop, or working prototypes.

treejackThe newest product, called Treejack, is aimed at websites with a lot of content. It tests information architecture with end users in the form of an online survey. It helps designers answer questions like, “Does this shallow structure work?”, “What do people think about this label?”, “ Can we use 5 top level categories instead of 7?” (Try it here.)

Currently, ChalkMark and Treejack are completely free; however, the company plans to start charging a subscription fee within the next two months. Basic versions of the software will remain free. Sam also mentioned an increase in demand based on the tight economy:

We’ve literally had a few people tell us they aren’t hiring consultants and will use our tools instead (and their own time).

It’s certainly an interesting idea–a consultancy working itself out of a job. And it seems to be working: Optimal Workshop’s products are used by four of the top ten banks, five of the top ten telecommunications providers, and four of the top ten computer hardware manufacturers.

Reduced costs might stimulate usability studies in previously unexplored territory. What if it were cost-effective to test navigation on the corporate intranet?

Next Story: Kinoma makes finding mobile content a snap on Windows, Nokia’s Ovi
Previous Story: Apple splitting the iPhone into high-end and low-end versions?

Bookmark and Share
Photo of Jeff Widman

About the Author, Jeff Widman

Jeff Widman writes irregularly for VentureBeat whenever he stumbles across interesting news...

He tap dances between his home in Mountain View, CA and Bellingham, WA--where he is a full-time student at Western Washington University.

In addition, he works as a Facebook Fan Page marketing consultant--clients include Mint.com, Microsoft BizSpark, and The David Allen Company (Getting Things Done).

Past internships include TechCrunch, Seth Godin, and TechStars.

  • They should have people test the designs on Mechanical Turk. Great idea all around.
  • That's a great idea! For many, wanting the "right" type of participants will be important. For many others, simply having some feedback will be better than no feedback. Thanks for your suggestion.
  • Very cool!
  • my $.02
    Yes, but...

    Your results will be moot if you're asking the wrong questions of your users, and even a specialist can get this wrong if the objectives aren't clear ahead of time. Good research planning takes practice and skill, which is what you're paying for when you hire out.

    Also, just because those top-tier commpanies are using the tools doesn't mean they're firing their usability consultants. I'm an internal consultant at one of those entities and I've been using Optimal Sort tools as part of my projects--they're just good tools. They will never be a panacea for all of your research needs or a substitute for the advice of an experienced practitioner. Or face-to-face feedback from your users! :-)
  • Can't agree more. We don't imagine that usability consultants will be replaced because there will never be a replacement for human experience and skill. We do think though that these tools make it more enticing for people who may otherwise not bother with "usability" to dip their toes. Its arguable whether this segment of people would otherwise hire a usability consultant, but our hope is that this is enough to get them thinking enough about usability in order to include it in future projects.

    Glad to hear you're using OptimalSort! I hope you have a great experience with Treejack and Chalkmark as well!
  • ShirleyW
    Looks like some great products. But anyone who's interested in doing online, unmoderated user testing should also check out Loop11 (www.loop11.com).