Primary supervisorChunyang Chen
Screen recordings of mobile applications are easy to obtain and capture a wealth of information pertinent to users (e.g., tutorials, feature usages), making them a popular mechanism for crowdsourced app usage. Manually following the screen recordings to replay the app usage can be a time consuming process, due to the long length of the recordings and UI bias between screens. Therefore, for users and developers, it is crucial to accelerate the replay process.
Toward that goal, we have finished a series of works in automated recording replay by leveraging image processing and deep learning techniques . Watch our live demo here . This project will invent an app shortcut mechanism for helping users (the elders and the disabilities who cannot conveniently utilize the app) quickly reproduce the usage .
 Feng, S., & Chen, C. (2021). GIFdroid: Automated Replay of Visual Bug Reports for Android Apps. Accepted to 44th International Conference on Software Engineering (ICSE 2022)
 GIFdroid tool. Available: https://youtu.be/G0Zytwpsabk
 Project of copy-paste. Available: https://docs.google.com/presentation/d/1OXFjazW7I4TE1COjaab3LYOb8zzRT1zGuaQe8xng7QQ/edit?usp=sharing
- Strong programming background.
- Android development.
- Basic understanding in image processing, deep learning will be of added advantage.