ICACT20240471 Slide.24
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
Initiating positive policy changes for the betterment of society goes beyond the scope of this study. Let's join forces and collaborate! You can reach out to me via the email displayed on your screen. Once again, thank you for listening and it has been a pleasure to be a part of the International Conference on Advanced Communications Technology 2024!
|
|
ICACT20240471 Slide.23
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
Furthermore, we extend our gratitude to all those individuals who have played a pivotal role in helping us accomplish our goals. Their support and contributions have been indispensable to our success.
|
|
ICACT20240471 Slide.22
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
Our team would like to extend our heartfelt appreciation to the Commission on Higher Education for their generous funding through the LAKAS program. We would also like to express our profound gratitude to Bicol University and National University for their invaluable support, which has been instrumental in successfully achieving the goals of this endeavor.
|
|
ICACT20240471 Slide.21
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
In summary, our assessment identified key improvement areas—specifically in search engine and image optimization. Addressing these aspects is vital for the ongoing development of BOSESKO. Looking ahead, future initiatives may delve into evaluating the security and portability of BOSESKO. This step aims to enhance the toolkit's overall robustness and efficiency, contributing to a more effective digital participatory platform. These enhancements ultimately seek to encourage greater civic engagement in the policy-making process within the Philippines.
|
|
ICACT20240471 Slide.20
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
In conclusion, our study, AppTest, evaluated BOSESKO, a toolkit for public engagement in Philippine policies . Initial findings revealed a commendable user rating, with an average weighted mean of 4.36 across different usability sub-characteristics as evaluated by 346 respondents. BOSESKO excelled in user interface aesthetics, appropriateness recognizability, learnability, operability, user error protection, and accessibility, showcasing its potential for civic engagement in policy-making. For performance, with the use of automated tools, BOSESKO scored 89% for the web and 76% for mobile, with room for improvement in search and image optimization.
|
|
ICACT20240471 Slide.19
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
In terms of usability evaluation, usability test results indicate that respondents indicate an overall acceptable level of user agreement with the system's adherence to usability sub-characteristics as evident in this table. User interface aesthetics led with the highest weighted mean of 4.41, followed closely by appropriateness, recognizability, and learnability. Overall user agreement with the system's usability resulted in an acceptable overall weighted mean of 4.36, meeting predefined criteria in table 1.
|
|
ICACT20240471 Slide.18
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
The Usability test evaluation were conducted during data collection events held at various partner SUCs in the Philippines as shown here.
|
|
ICACT20240471 Slide.17
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
After conducting a series of performance efficiency tests using five distinct automated tools, the average performance score of of the web platform is 89%. In contrast, the mobile platform using only four tools, got a slightly lower average score of 76%. The substantial gap between the web application and mobile efficiency is evident. Identified gap underscores the need for targeted improvements, particularly in search engine and image optimization, to enhance overall system efficiency, especially on the mobile platform.
|
|
ICACT20240471 Slide.16
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
Aside from employing open-source software tools for testing, the researchers utilized Pingdom, a proprietary software, to assess whether there were significant differences in the results. Ultimately, the result generated from this tool as shown in the figure, closely aligned with those obtained from other tools, yielding a performance score of 88 out of 100, corresponding to a descriptive mark of B which means efficient.
|
|
ICACT20240471 Slide.15
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
The Yellow Lab Tools assessed the system using ten metrics, rating from A as the highest to C as the lowest. The system excelled, earning an A for seven metrics, including Requests, DOM Complexity, JS Complexity, Bad JS, jQuery, CSS Complexity, and Web Fonts. Server Configuration got a score of B for both web and mobile app and the Page weight received a B as well for the mobile app. Notably, an image optimization issue was identified, offering potential savings of 255 KB by optimizing 8 images. Server configuration problems included an HTTP protocol issue and 11 disabled caching instances. The Bad CSS metric received a C due to a parsing error during testing, affecting other CSS metrics and scores.
|
|
ICACT20240471 Slide.14
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
The PageSpeed Insights results reveal performance disparities between the web and mobile platforms. The web application boasts an impressive score of 92, while the mobile platform lags behind at 65. Despite this, the mobile platform exhibits superior accessibility (83) compared to the web (82). Both platforms excel in adhering to best practices with a perfect score of 100. In terms of SEO performance, the web application outperforms the mobile (80 vs. 79). Notably, the web application demonstrates faster load times in various metrics, including the first contentful paint (0.5 seconds vs. 1.3 seconds). The web application experiences significantly lower total blocking time (80 milliseconds vs. 1710 milliseconds) and a quicker speed index (0.9 seconds vs. 6.9 seconds) compared to the mobile. Analyzing the largest contentful paint, the web application achieves faster loading (1.7 seconds vs. 2.3 seconds), with no cumulative layout shift observed on both platforms.
|
|
ICACT20240471 Slide.13
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
Four (4) metrics, namely performance, accessibility, best practices, and search engine optimization (SEO), were evaluated using Google Lighthouse. Figure 2 shows that the system demonstrated satisfactory results, achieving 98% in performance, 83% in accessibility, and a perfect score of 100% in best practices. However, the SEO metric showed a slightly lower result at 80%. According to the tool's assessment criteria, the system's overall performance falls within the 90-100% range, categorizing it as a good score, while the mobile platform, as presented in Figure 3, got 76%, which needs improvement.
|
|
ICACT20240471 Slide.12
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
The WebPageTest tool revealed significant performance issues in the system, notably a slow first-byte time of 1.504 seconds, prolonged server connection, and response time. Pixels began appearing at 2.700 seconds, and the first contentful paint loaded at 2.673 seconds, with a slow speed index of 2.750 seconds. The largest contentful paint (LCP) recorded a high value of 2.673 seconds, attributed to an image element. Optimization recommendations were made to expedite image fetching. On a positive note, no cumulative layout shift occurred, and the main thread experienced no significant blockage, taking only 0.945 seconds. The page weight was determined to be 1559 KB, highlighting the overall size of the webpage.
|
|
ICACT20240471 Slide.11
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
While conducting usability analysis, we employed quantitative descriptive analysis. This method included calculating the frequency distribution of scores based on the quantitative values assigned to each category on the five-point Likert scale.
|
|
ICACT20240471 Slide.10
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
To conduct system testing from the user’s perspective, we transformed the usability questionnaire into an online survey using Google Forms. A total of 346 respondents, specifically students aged between 19 and 24 from various state universities—key users of the BOSESKO application—participated. The demographic makeup included 48.1% women, 46.6% men, and the remaining 5.3% identified with the LGBTQ+ community.
|
|
ICACT20240471 Slide.09
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
In evaluating the performance efficiency of BOSESKO, we used open-source automated tools like WebPageTest, Google Lighthouse, PageSpeed Insights, and Yellow Lab. Additionally, proprietary software, Pingdom, was also used to check if disparities would emerge in the results compared to those generated from free tools. Whereas a usability questionnaire with 36 items, addressing each of the six sub-characteristics namely appropriateness recognizability, learnability, operability, user error protection, user interface aesthetics, and accessibility was adapted into an online survey using Google Forms. A five-point Likert scale was used to determine user’s perception.
|
|
ICACT20240471 Slide.08
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
In this research, our goal is to assess the BOSESKO system using the ISO 25010 standard quality model. The evaluation was conducted using a mix of manual and automated testing, combining user feedback with statistical data from automated tools in use.
|
|
ICACT20240471 Slide.07
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
The comprehensive evaluation of system performance involves utilizing specialized tools such as WebPageTest, Google Lighthouse, Pagespeed Insights, and Pingdom.
|
|
ICACT20240471 Slide.06
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
Some studies demonstrate the utilization of questionnaire-based methods for usability evaluation. Participants played a vital role by providing valuable feedback on their experiences with the developed websites, contributing to a user-oriented assessment approach. On the other hand, certain studies focused on performance efficiency, employing automated testing tools.
|
|
ICACT20240471 Slide.05
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
These are the software quality attributes for comprehensive evaluation of software performance, usability, reliability, and security. Addressing each aspect is essential for developing high-quality software that aligns with user needs and industry standards. This study focusses on Evaluation of Performance Efficiency and Usability.
|
|
ICACT20240471 Slide.04
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
Several studies used ISO/IEC 25010 to assess software quality both internally and externally. Researchers acknowledge its universality, simplifying adaptation to various specialized quality models.
|
|
ICACT20240471 Slide.03
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
This research study seeks to assess the quality of the BOSESKO system. WHAT IS BOSESKO? It is an acronym for Building on Opinions and SEntiments Sustainability and Knowledge Opportunities - an inclusive, deliberative, and multilingual eParticipation toolkit that streamlines the collection, processing, and analysis of responses by integrating the ISO 25010 standard quality model.
|
|
ICACT20240471 Slide.02
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
The journey of software development extends beyond completion, leading to a meticulous phase of testing and evaluation. In our presentation, we spotlight the crucial elements of this process and their integration into assessing the system named BOSESKO (My Voice in English) using the ISO 25010 Quality Model. Software quality is our focal point, addressing its significance in both industrial applications and daily life.
Software testing is essential for analyzing software quality, minimizing project costs, and ensuring timely delivery. In essence, software testing involves an in-depth evaluation, either manually or by automated methods, to ensure that the system meets outlined standards
|
|
ICACT20240471 Slide.01
[Big slide for presentation]
|
Chrome Text-to-Speach Click!! |
 |
My presentation outline will be as follows: Introduction, Related Works, Objectives, Methodology, Results and Discussion, Conclusions and Future Works.
|
|
ICACT20240471 Slide.00
[Big slide for presentation]
[YouTube] |
Chrome Text-to-Speach Click!! |
 |
Good day, everyone! I am Jennifer L. Llovido, a faculty member of Bicol University College of Science, Computer Science and Information Technology Department. On behalf of my colleagues, we are privileged to be here today to present our paper entitled “AppTest: Assessing the Usability and Performance Efficiency of BOSESKO for Digital Participation” at this 26th International Conference on Advanced Communications Technology.
|
