Open Access

ARTICLE

Video Preview Generation for Interactive Educational Digital Resources Based on the GUI Traversal

Xiaohong Shi^1,3, Chao Ma², Yongsheng Rao^3,*, Xiangping Chen⁴, Jingzhong Zhang³

1 School of Mathematics and Information Science, Guangzhou University, Guangzhou, 510006, China
2 National Engineering Research Center of Digital Life, Sun Yat-sen University, Guangzhou, 510006, China
3 Institute of Computing Science and Technology, Guangzhou University, Guangzhou, 510006, China
4 Guangdong Key Laboratory for Big Data Analysis and Simulation of Public Opinion, School of Communication and Design, Sun Yat-sen University, Guangzhou, 510006, China

* Corresponding Author: Yongsheng Rao. Email:

Intelligent Automation & Soft Computing 2020, 26(5), 917-932. https://doi.org/10.32604/iasc.2020.010124

Abstract

The interactive educational digital resources (IEDRs) are more and more prevalent in all levels of education. With the proliferation of the Internet, more and more IEDRs are being shared online. How to aid users to explore helpful resources effectively and efficiently has become a challenge. The static preview of resources that current research has mainly focused on is ineffective for the IEDRs, because of the unique feature of the IEDRs that the knowledge is crucial for the users’ comprehension and is hidden in the process of interaction. To unfold the hidden crucial knowledge and ensure a users’ fast acquisition, we proposed a novel approach to generate video previews for the IEDRs, which has achieved a better visualization of the IEDRs. First, the interactive element set and the events set, as well as the dependencies between the interactive elements of the resource are collected. Afterwards, by analyzing the dependencies, the interaction sequence is generated. Consequently, by automatically executing the interaction sequence based on the GUI traversal, the manual interaction is simulated, and the process is recorded into a video. The approach was applied into a dynamic mathematics educational system, SuperSketchpad, and its effectiveness was validated by a user study, in which it was compared with the random event method and event permutation method in correctness, completeness and redundancy.

---

Keywords

---

Citations