FeedAIde: Guiding App Users to Submit Rich Feedback Reports by Asking Context-Aware Follow-Up Questions
Organizations: University of Hamburg, Hamburg, Germany
Abstract
User feedback is essential for the success of mobile apps, yet what users report and what developers need often diverge. Research shows that users often submit vague feedback and omit essential contextual details. This leads to incomplete reports and time-consuming clarification discussions. To overcome this challenge, we propose FeedAIde, a context-aware, interactive feedback approach that supports users during the reporting process by leveraging the reasoning capabilities of Multimodal Large Language Models. FeedAIde captures contextual information, such as the screenshot where the issue emerges, and uses it for adaptive follow-up questions to collaboratively refine with the user a rich feedback report that contains information relevant to developers. We implemented an iOS framework of FeedAIde and evaluated it on a gym's app with its users. Compared to the app's simple feedback form, participants rated FeedAIde as easier and more helpful for reporting feedback. An assessment by two industry experts of the resulting 54 reports showed that FeedAIde improved the quality of both bug reports and feature requests, particularly in terms of completeness. The findings of our study demonstrate the potential of context-aware, GenAI-powered feedback reporting to enhance the experience for users and increase the information value for developers.
Figures & tables
| Participant | Age | Gender | Occupation |
|---|---|---|---|
| P1 | 21 | M | Fitness trainer |
| P2 | 51 | M | Club General Manager |
| P3 | 21 | M | Fitness Trainer |
| P4 | 25 | F | Fitness Trainer & Service |
| P5 | 25 | M | Personal & Fitness Trainer |
| P6 | 27 | M | Team Leader |
| After completing all scenarios (per system) | |
|---|---|
| Q1 | How easy did you find the process of submitting your feedback? |
| Scale: Very difficult (1) – Somewhat difficult (2) – Somewhat easy (3) – Very easy (4) | |
| Q2 | How helpful do you find the system for submitting your feedback? |
| Scale: Not helpful (1) – Somewhat helpful (2) – Helpful (3) – Very helpful (4) | |
| At the end of the session (Responses given verbally) | |
| Q3 | Explain which feedback system you prefer. |
| Participant | Traditional | Preference | |||
| Ease | Helpfulness | E. | H. | ||
| P1 | 3 | 1 | 3 | 4 | New |
| P2 | 3 | 2 | 3 | 3 | New |
| P3 | 4 | 1 | 4 | 3 | New |
| P4 | 3 | 1 | 4 | 4 | New |
| P5 | 3 | 1 | 4 | 4 | New |
| Quality Dimension | Traditional | |
|---|---|---|
| Observed Behavior | 0.93 | 1.50 |
| Expected Behavior | 2.00 | 2.00 |
| Steps to Reproduce | 0.14 | 2.00 |
| Quality Dimension | Traditional (%) | (%) |
|---|---|---|
| Summary | 100.0 | 100.0 |
| Description | 0.0 | 100.0 |
| Specify problem | 0.0 | 53.8 |
| Correct summary | 69.2 | 92.3 |
| Product version | 0.0 | 100.0 |
| Correct language | 92.3 | 100.0 |