ICACT20220380 Question.1
Questioner: degunk@telkomuniversity.ac.id 2022-02-15 오후 4:28:42 |
ICACT20220380 Answer.1
Answer by Auhor yudhi.paramartha@undiksha.ac.id 2022-02-15 오후 4:28:42
Chrome  Click!! |
| Dear author, How many responden that you used at this paper? There are any suggestion to how to decide the number of participant and who will be the participant if I want to make usability testing like this paper did.
thank you |
good afternoon. We are using 25 participants from 4 groups, namely 7 participants from high school students, 3 participants from high school teacher, 13 participants from university student, and 2 participant from lecturer. Deciding participant for usability testing like in this study usually don't required many participant to capture usability problem. Many publications and best practices suggest about 5-8 participant for URUT and SUS are good enough to conduct a usability study. |
ICACT20220380 Question.2
Questioner: tomayoon@ieee.org 2022-02-15 오후 4:34:13 |
ICACT20220380 Answer.2
Answer by Auhor yudhi.paramartha@undiksha.ac.id 2022-02-15 오후 4:34:13
Chrome Click!! |
| First of all, thank you for the good research paper and presentation contents. I would like to know more about the research environment used in this study, and also in detail about the equipment & operating systems, development languages and software libraries you used. |
Good afternoon, the research ware conducted by Unmoderated Remote Usability Testing (URUT) that benefited to the fact that the participants could participate in their own environments (home, school, workplace, etc). The app itself are based one Android operating system that we developed using Flutter. The tools that we ware using for this study mainly using Maze to capture user performance and Google Form to capture user perception. |
ICACT20220380 Question.3
Questioner: salsabilarinaldi@gmail.com 2022-02-15 오후 4:42:02 |
ICACT20220380 Answer.3
Answer by Auhor yudhi.paramartha@undiksha.ac.id 2022-02-15 오후 4:42:02
Chrome Click!! |
| Dear author, how do you calculate the result of the URUT method and the SUS method? Thank you |
Good afternoon, for performance evaluation we are using Maze to calculate the result of the study. Maze automatically produced the performance score based on success rate, misclick rate, duration, and bounce rate. SUS is a common 5 points likert scale usability questionnaire that have 10 questions. the score was calculated by the average of user response of the questionnaire. |
ICACT20220380 Question.4
Questioner: lehonglam@vnu.edu.vn 2022-02-15 오후 4:49:38 |
ICACT20220380 Answer.4
Answer by Auhor yudhi.paramartha@undiksha.ac.id 2022-02-15 오후 4:49:38
Chrome Click!! |
| Hi, Paramartha et al.
I think your research is very good, it helps a lot to organize teaching-learning.
What language and operating system are you building on the user interface? Are the hardware requirements high? Can users submit content with images, videos, or text? |
Good afternoon, we are designing our user interface using Figma, then implement the UI to the app using Flutter. The end result of the development is an Android app (actually we are developing iOS app as well, but not in this study). The hardware requirement for developing the app is a standard laptop with minimal of 8GB of RAM and SSD storage are enough for us. User can submit images and text, and we are still developing video content upload for the final release. |
ICACT20220380 Question.5
Questioner: namacabale@gmail.com 2022-02-16 오후 3:28:06 |
ICACT20220380 Answer.5
Answer by Auhor yudhi.paramartha@undiksha.ac.id 2022-02-16 오후 3:28:06
Chrome Click!! |
| Dear Author, you have a good research. Are there any existing technology(ies) almost similar to your proposal that have been deployed in real world environment? What do they lack that your work specifically addressed? Thank you and stay safe. |
We choose URUT using Maze for performance evaluation and SUS to measure user perception. These two methods are two of the best practices around UX researcher. We use URUT especially because the covid-19 condition that we cannot meet with the participants. |
ICACT20220380 Question.6
Questioner: rabiulsikdereee@kaist.ac.kr 2022-02-16 오후 3:18:30 |
ICACT20220380 Answer.6
Answer by Auhor yudhi.paramartha@undiksha.ac.id 2022-02-16 오후 3:18:30
Chrome Click!! |
| Thank you for your research. Could you tell feasibility of applying the machine learning approach in the research method that you have proposed? |
Thank you for the question. I think in this phase applying mechine learning approach isn't needed (regarding it is possible). But ML approach may be required to analyze the users behavior in the production phase. |
ICACT20220380 Question.7
Questioner: lusongfeng@hust.edu.cn 2022-02-16 오후 3:23:48 |
ICACT20220380 Answer.7
Answer by Auhor yudhi.paramartha@undiksha.ac.id 2022-02-16 오후 3:23:48
Chrome Click!! |
| Dear authors, your research is related to usability evaluation of an interactive educational mobile application. I would like to know more about the detail about your research algorithms. In addition to statistical methods, are there any algorithms that use artificial intelligence? |
We didn't apply any AI in the evaluation. We are using an application called Maze to evaluate user performance. Maze gives us measure that may be uses some statistical or AI to calculate the score internally (which is we don't know what the internal algorithm that they use). |
