Smart™ 3D usability benchmarking

Before proceeding with design changes for Smart™ 3D, it was essential that benchmark tests be conducted on current version of Smart 3D to compare and contrast the UX improvements over time.

Project goals and methods In this project we focused on understanding the strength and weakness of property pages as implemented in the current Smart 3D. Various aspects of the property pages were identified (based on task analysis) for testing, leading up to user tasks for tests. Usability tests were conducted in our in house labs with twelve participants.

Metrics measured A combination of both qualitative and quantitative data was collected, with quantitative data providing the crux of evidence for usability findings. Performance metrics measured – time to complete tasks, success rates, number of attempts and mouse clicks. Perception metrics – ease of use, perceived time to complete tasks, satisfaction and feelings about the task before and after use.

Documenting findings Qualitative data was reported as issues and illustrations arranged by task. Quantitative data was predominantly reported as charts for every category of data, along with Summative Usability Metric (SUM) method for single-scoring and ranking usability.

Details on request.