Charles Chung

What's the issue

We conducted a comprehensive evaluation of the mobile app of Hope English, the leading brand of English learning in Taiwan. Evaluational methods conducted includes Interaction map, Interviews, Persona & Scenario, Comparative Analysis, Survey, Heuristic Evaluation, and Usability Test.

What evaluational methods are conducted

To understand the app thoroughly and provide insightful suggestion to improve the user experience, we utilized the techniques mentioned below.

Interaction Map

In the Interaction Map, we analyzed the views of the app and the relationship between each view (or activity). This step gave us a comprehensive understanding of our target product.

Interview, Persona & Scenario

In order to determine the target audience of the product, we conducted an interview to understand peoples' incentives and behaviors in online language learning activities. By digging into their scenarios, attitudes, and experiences, we established three main Personas and their corresponding Scenarios of our target audience.

Survey

A Survey was conducted following qualitative analysis to further collect the quantitative data. We collected participants' characteristics, attitudes, and behaviors in online language learning activities. Furthermore, we collect participants' self-report usability evaluation of our target product using the System Usability Scale (SUS).

Comparative Analysis

A Comparative Analysis is conducted to better understand how other comparators design their products. We compare our client's design with others' to learn from the good ones and avoid poor design choices.

Heuristic Evaluation

A Heuristic Evaluation is conducted by the researchers. Based on the 10 Heuristic principles established by Jakob Nielsen, we set up scenarios, then each of us provided an individual evaluation of the violations of heuristic principles occurs in the scenario. We then generated our findings after debriefing and discussion.

Usability Test

The last evaluation we conducted was a Usability Test. Unlike the Heuristic Evaluation, Usability Test invited the user to participate in our experiment. The participants were asked to perform the tasks planed by the researchers. The researchers evaluated difficulties participants faced when performing tasks. Participants were also asked to fill out questionnaires to provide their perceived experience during the task. We then generated our findings after data analysis and discussion.

What I learn from this

Due to the Non-Disclosure Agreement I cannot present the detail results here.

I learned a lot from this experience. The evaluation training I received will definitely serve as my stepping stone to pursue advanced HCI evaluation knowledge. Moreover, this project provided me a chance to develop hands-on experience, work with a field supervisor, and gain capability to address obstacles and challenges arise in real-world projects.