M-Files: Enterprise Document Management System Usability Testing

M-Files: Enterprise Document Management System Usability Testing

Enabling knowledge workers to create, update, search, and share with less hassle.

Role

Moderator, Observer

Team

3-member team

Duration

2 months (2022)

Tools

Parsec Remote desktop, Microsoft Forms

Overview

M-Files is a metadata-driven document management platform that enables knowledge workers to instantly find the right information in any context, automate business processes, and enforce information control. The project aim was to evaluate how usable and intuitive features of the updated M-Files desktop client is such as navigation, search, resource creation and modification, and sharing.

Solution

We conducted a usability evaluation of the M-Files desktop platform focusing on key features such as file creation and editing, searching, and sharing. 7 usability issues were identified affecting new users' navigation experience using the system.

Process

Plan

  • Identify objectives

  • Participant recruitment

  • Create test tasks

  • Identify equipment needed

  • Procedure/test script

  • Consent & NDA

  • Identify objectives

  • Participant recruitment

  • Create test tasks

  • Identify equipment needed

  • Procedure/test script

  • Consent & NDA

Facilitate

  • Walk participants through process

  • Observe participants

  • Identify issues

  • Interview participants


Analyse

  • Analyse task results

  • Thematic analysis of interviews/think-aloud comments

  • Analyse post-test questionnaire


Document

  • Review video recordings

  • Summarise background info

  • Report test method

  • Report findings/test results

  • Propose recommendations

Document

  • Review video recordings

  • Summarise background info

  • Report test method

  • Report findings/test results

  • Propose recommendations

Deliverables

7 usability issues were identified:

  1. Document class creation process is complex for non-tech and novice users

  2. New document creation process for non-default file types (.html, .js) should be clear

  3. Document check-in/check-out function should not have countdown timer, and process simplified to support novice users.

  4. Advanced Search function and indexing needs to be improved and simplified

  5. Error handling and messages should be improved for non-tech users

  6. Quick access to deleted files is not available by default

  7. Navigation UI needs to be consistent across views


Test session overview

  • Remote Usability testing (done using Parsec Remote desktop)

  • 1:1 Session (with 3 observers)

  • Post-test questionnaire -System Usability Scale (SUS)

  • Light help provided to participants

  • 60+ mins test/participant



Reflections

Enhance systems' user experience through novice-centric system design approach

Enhance systems' user experience through novice-centric system design approach

Through this project, I learnt to conduct a comprehensive usability evaluation, developing my skills in user testing and task analysis. Need for Plan B This usability test was the first for the team. We had some participants not show up at the last minute which threw us off-guard. Thankfully, a member had a participant willing to do the test within short notice.

Through this project, I learnt to conduct a comprehensive usability evaluation, developing my skills in user testing and task analysis. Need for Plan B This usability test was the first for the team. We had some participants not show up at the last minute which threw us off-guard. Thankfully, a member had a participant willing to do the test within short notice.