Apps have become one of the leading customer-facing assets for many brands and the outcomes, both emotional and functional, that customers achieve with the app reflect their overall impression of your brand. Ipiphany™, Touchpoint Group’s AI customer analytics tool, offers a comprehensive analysis of mobile app feedback against similar brands in the banking sector to uncover insights in market positioning, app performance and customer perception resulting in key opportunities to optimise your app.
The following use case details how Ipiphany™ can be leveraged to help a Tier 1 bank gain greater insight into the performance of their Mobile App through publicly available customer feedback data.
Use Case Business: JP Morgan Chase & Co
JP Morgan Chase & Co is a Tier 1 bank in the United States, and one of the largest banking institutions in the world. Their app is used by thousands of customers every day to manage transactions, investments, and trading worldwide. This use case analyses;
Using the AI Analyst, Ipiphany™ - Touchpoint Group was able to extract insights from unstructured text data, readily available through public review platforms. The objective was to understand in detail the insights customers were sharing around preference, usability, issues and their overall perception of a product they rely on for daily use.
Using public data captured by third parties gives a business a rich insight into what customers really think about a product as they’re rating it on an unbiased platform with no incentive. Better yet, it gives us [Touchpoint Group] open access to a large repository of data and the ability to benchmark organisations against their direct competitors within the industry, locally and internationally, without having to undertake expensive market research initiatives.
With the supervised AI training of Ipiphany™ to read and categorise customer comments specific to the banking industry, we were able to extract insights from the text data focusing on;
The following use case introduces a broad idea as to what is possible with Ipiphany™, with examples drawn from the data analysed for JP Morgan Chase & Co.
By benchmarking the overall score of JP Morgan Chase & Co against competitors - Wells Fargo, Citibank, and Bank of America, we are able to gain a high-level overview of customer app perception and market positioning.
JP Morgan Chase & Co scored 3.9 out of 5* overall with the next closest competitor - Bank of America - at a significantly higher 4.5. We then used the AI Analyst, Ipiphany™, to read the text and apply sentiment analysis to the data. Two specific aspects influencing the rating were noted as;
Understanding the impact that these two features have on customer perception and the overall score of 3.9 gives JP Morgan Chase & Co specific opportunities for improvement against a major competitor.
Comparing the strengths and weaknesses of competitors in the market allows for a detailed analysis of positioning and reveals market insights, as well as key areas of focus that will provide the highest impact on JP Morgan Chase & Co’s ranking against its competitors.
By focusing on competitors’ strengths, we gain a better understanding of market positioning, and by focusing on JP Morgan Chase & Co’s weaknesses we can pinpoint clear avenues for improvements that will drive the most impact. By analysing the text data by customer segment, we are able to drill down to a granular level to uncover these insights,
We understand from this data that there are pain points across the board with app users wishing to deposit cheques, but JP Morgan Chase & Co has an opportunity to drive impact by improving this feature in their app. As an identified weakness in the market overall, this improvement would have the most significant impact on the overall ranking.
Read more about Competitor Analysis
The Touchpoint Ipiphany™ app benchmarking tool uses four classifications to categorise analysis into the way users interact with and regard an app. These are the S.U.R.F (Security, Usability, Reliability, and Functionality) pillars. By analysing these pillars and the way they relate to each other, we are able to gain a complete understanding of issues plaguing users.
Analysing the JP Morgan Chase & Co App review data against each SURF Pillar at a high level allows for an easy understanding of where to focus first.
From the chart above, we can surmise the following:
The SURF Analysis quickly reveals a hierarchy we can use to direct focus. Usability ranks at a steady 4.0, so although investigation may reveal small improvements, it’s not a major concern for immediate focus. However, Security and Functionality, and reliability saw significant decreases this quarter, presenting an immediate opportunity for investigation and improvement.
Detailed analysis reveals one major issue that is connected to all three of these pillars. There is a recent and significant problem with the Touch ID functionality of the JP Morgan Chase & Co app, which is leading to an overall decrease in trust in the security of the app. By investigating this in parallel, we are able to perform a granular analysis and identify the root cause of the problem.
Read more about the SURF Pillar Analysis
In the high-level SURF analysis, we used Ipiphany™ to uncover a pain point leading to a significant decrease in the score, relating to both the Security and Functionality pillars. The next step is to investigate the detail of this pain point in a Root Cause Analysis.
A high frequency of users detail intermittent but consistent issues with the Touch ID functionality in the JP Morgan Chase & Co app. These users report that the touch function often works once before shutting down from within the app, requiring users to re-install the app, reset their settings, or in some cases causing the phone to crash. By comparing user segments within the app review data, we are able to use Ipiphany™ to provide enough information on the cause of this issue in order to provide actionable recommendations to fix this pain point.
This issue will continue to increase in frequency as users update their operating systems, so addressing this pain point becomes increasingly important. 78.3% of those reviewing the JP Morgan Chase & Co app are Android users, so this issue affects a large portion of the user base. The distress users are experiencing is leading to an overall decrease in the perception of reliability and security, and it should be addressed promptly in order to maintain a competitive position in the market. The level of detail achieved by the Ipiphany™ AI provides enough information for JP Morgan Chase & Co to hand over to its app development team for further investigation and resolution.
Read more about root cause analysis to discover another insight hidden in this data.
*12month date refers to May 2019 - May 2020. The data does not include structured feedback or rating feedback with no comments.
** Score will differ to the score found on App stores. This is a combined score from both Google Play & Apple App stores, any reviews not containing comments have been removed from this data set.
To read this case study and receive a digital copy enter your email address below.*
To learn more about our mobile banking app performance analysis, the findings from our study, or the other 30 banks we investigated worldwide, get in touch with our team of experts.