Microsoft is a multinational and industry-leading technology company best known for developing numerous operating systems, software, and online computing service platforms. Microsoft’s Intune Company Portal is a data and device management system that is used by tens of thousands of companies worldwide and requires individual employees to install its app on their devices.

User feedback about Intune Company Portal provides insight that developers can use to create and maintain a premium user experience. However, collecting and analyzing reviews is a tedious and time-consuming task, requiring manually searching dozens of review websites and plotting the data.

Our Feedback Prompt for Ratings in the Google Play Store system improves the overall review collection and analysis through an easy-to-use in-app review prompt for users, and automated review collection and analysis for Microsoft engineers.

To facilitate easier and more representative review collection, we integrate an automated in-app review prompt that actively promotes user feedback for the Intune application on Android. Our system removes the need for users to navigate to the Play Store and makes leaving a review quick and easy.

Our system employs a suite of web scrapers that search the internet for reviews of Intune and saves them for future analysis. We use natural language processing and machine learning to search for patterns in user reviews that might signify any bugs or issues and to determine sentiment towards the app. The results of the analysis are sent to Microsoft engineers using a Microsoft Teams Bot that delivers monthly analysis.

The front end uses the Microsoft Bot Framework and Android Studio for the in-app prompt. The back end consists of a SQL Server database hosted on Azure. The analysis pipeline is hosted on Azure and utilizes Node.js web scrapers and Python scripts.