How does the Analytic Hierarchy Process (AHP) help evaluate the effectiveness of VR and 3D educational content, and what were the key criteria considered?
In the paper, AHP (Analytic Hierarchy Process) is used as a structured decision-making method to evaluate how effective the VR/360°/3D educational content is by:
1. Comparing evaluation criteria pairwise (experts/users judge which factor is more important than another), then
2. Normalizing the comparison matrix to standardize judgments and derive priority weights (a ranking of what matters most), and
3. Checking consistency (via Consistency Ratio, CR) to confirm the judgments are logically reliable.
Key criteria considered
For evaluating 360° and 3D web-based educational content, the AHP model used six core criteria:
Content Quality
VR Design
User Interface
Assessment
Learning Outcome
User Satisfaction
The resulting weights show the top factors were:
User Satisfaction (17.6%) and Learning Outcome (17.0%), followed by VR Design / Content Quality / Assessment (~16.4%), and User Interface (16.1%).
Consistency (validity) of the evaluation
The AHP judgments were consistent because CR < 0.1 (e.g., CR ≈ 0.006 in one reported analysis), meaning the priority weights are trustworthy for design and academic decisions.
