Customers’ emotional impact on star rating and thumbs-up behavior towards food delivery service Apps

Le Li, Noor Azlin Ismail, Choo Wei Chong, Peng Sun, Mst. Dilara Pervin, Md Shamim Hossain

Article ID: 5311
Vol 8, Issue 7, 2024

VIEWS - 338 (Abstract) 137 (PDF)

Abstract


This study explores the intricate relationship between emotional cues present in food delivery app reviews, normative ratings, and reader engagement. Utilizing lexicon-based unsupervised machine learning, our aim is to identify eight distinct emotional states within user reviews sourced from the Google Play Store. Our primary goal is to understand how reviewer star ratings impact reader engagement, particularly through thumbs-up reactions. By analyzing the influence of emotional expressions in user-generated content on review scores and subsequent reader engagement, we seek to provide insights into their complex interplay. Our methodology employs advanced machine learning techniques to uncover subtle emotional nuances within user-generated content, offering novel insights into their relationship. The findings reveal an inverse correlation between review length and positive sentiment, emphasizing the importance of concise feedback. Additionally, the study highlights the differential impact of emotional tones on review scores and reader engagement metrics. Surprisingly, user-assigned ratings negatively affect reader engagement, suggesting potential disparities between perceived quality and reader preferences. In summary, this study pioneers the use of advanced machine learning techniques to unravel the complex relationship between emotional cues in customer evaluations, normative ratings, and subsequent reader engagement within the food delivery app context.


Keywords


machine learning; sentiment analysis; emotional features; food delivery service apps; user evaluations; thumbs-up behavior

Full Text:

PDF


References


Al-Subaihin, A. A., Sarro, F., Black, S., et al. (2019). App Store Effects on Software Engineering Practices. IEEE Transactions on Software Engineering, 47(2), 300–319. https://doi.org/10.1109/tse.2019.2891715

Annaraud, K., & Berezina, K. (2020). Predicting satisfaction and intentions to use online food delivery: What really makes a difference? Journal of Foodservice Business Research, 23(4), 305–323. https://doi.org/10.1080/15378020.2020.1768039

Ashton-James, C. E., & Ashkanasy, N. M. (2008). Chapter 1 Affective events theory: A strategic perspective. In: Zerbe, W. J., Härtel, C. E. J., & Ashkanasy, N. M. (editors). Emotions, Ethics and Decision-Making. Emerald Group Publishing Limited.

Askalidis, G., & Malthouse, E. C. (2016). The Value of Online Customer Reviews. In: Proceedings of the 10th ACM Conference on Recommender Systems.

Chandrasekhar, N., Gupta, S., & Nanda, N. (2019). Food Delivery Services and Customer Preference: A Comparative Analysis. Journal of Foodservice Business Research, 22(4), 375–386. https://doi.org/10.1080/15378020.2019.1626208

Chen, C.-F. (2023). Investigating the Effects of Job Stress on the Distraction and Risky Driving Behaviors of Food Delivery Motorcycle Riders. Safety and Health at Work, 14(2), 207–214. https://doi.org/10.1016/j.shaw.2023.03.004

Chuah, S. H.-W., & Yu, J. (2021). The future of service: The power of emotion in human-robot interaction. Journal of Retailing and Consumer Services, 61, 102551. https://doi.org/10.1016/j.jretconser.2021.102551

Coombs, W. T., & Holladay, S. J. (2007). An exploratory study of stakeholder emotions: Affect and crises. In: Research on Emotion in Organizations. Emerald Group Publishing Limited.

Dąbrowski, J., Letier, E., Perini, A., et al. (2022). Analysing app reviews for software engineering: a systematic literature review. Empirical Software Engineering, 27(2). https://doi.org/10.1007/s10664-021-10065-7

Dąbrowski, J., Letier, E., Perini, A., et al. (2023). Mining and searching app reviews for requirements engineering: Evaluation and replication studies. Information Systems, 114, 102181. https://doi.org/10.1016/j.is.2023.102181

Davidow, M. (2000). The Bottom Line Impact of Organizational Responses to Customer Complaints. Journal of Hospitality & Tourism Research, 24(4), 473–490. https://doi.org/10.1177/109634800002400404

Diekson, Z. A., Prakoso, M. R. B., Putra, M. S. Q., et al. (2023). Sentiment analysis for customer review: Case study of Traveloka. Procedia Computer Science, 216, 682–690. https://doi.org/10.1016/j.procs.2022.12.184

Elahi, M., Khosh Kholgh, D., Kiarostami, M. S., et al. (2023). Hybrid recommendation by incorporating the sentiment of product reviews. Information Sciences, 625, 738–756. https://doi.org/10.1016/j.ins.2023.01.051

Fernandes, S., Panda, R., Venkatesh, V. G., et al. (2022). Measuring the impact of online reviews on consumer purchase decisions – A scale development study. Journal of Retailing and Consumer Services, 68, 103066. https://doi.org/10.1016/j.jretconser.2022.103066

Ghasemaghaei, M., Eslami, S. P., Deal, K., et al. (2018). Reviews’ length and sentiment as correlates of online reviews’ ratings. Internet Research, 28(3), 544–563. https://doi.org/10.1108/intr-12-2016-0394

Hossain, M. S., & Rahman, M. F. (2023a). Customer Sentiment Analysis and Prediction of Insurance Products’ Reviews Using Machine Learning Approaches. FIIB Business Review, 12(4), 386–402. https://doi.org/10.1177/23197145221115793

Hossain, M. S., & Rahman, M. F. (2023b). Detection of readers’ emotional aspects and thumbs-up empathy reactions towards reviews of online travel agency apps. Journal of Hospitality and Tourism Insights, 7(1), 142–171. https://doi.org/10.1108/jhti-10-2022-0487

Hossain, M. S., & Rahman, M. F. (2022). Detection of potential customers’ empathy behavior towards customers’ reviews. Journal of Retailing and Consumer Services, 65, 102881. https://doi.org/10.1016/j.jretconser.2021.102881

Hu, N., Koh, N. S., & Reddy, S. K. (2014). Ratings lead you to the product, reviews help you clinch it? The mediating role of online review sentiments on product sales. Decision Support Systems, 57, 42–53. https://doi.org/10.1016/j.dss.2013.07.009

Islam, Md. J., Datta, R., & Iqbal, A. (2023). Actual rating calculation of the zoom cloud meetings app using user reviews on google play store with sentiment annotation of BERT and hybridization of RNN and LSTM. Expert Systems with Applications, 223, 119919. https://doi.org/10.1016/j.eswa.2023.119919

Jiménez-Zafra, S. M., Martín-Valdivia, M. T., Maks, I., & Izquierdo, R. (2017). Analysis of patient satisfaction in Dutch and Spanish online reviews. Procesamiento del Lenguaje Natural, 58, 101-108.

Kaur, M., Verma, R., & Otoo, F. N. K. (2021). Emotions in leader’s crisis communication: Twitter sentiment analysis during COVID-19 outbreak. Journal of Human Behavior in the Social Environment, 31(1–4), 362–372. https://doi.org/10.1080/10911359.2020.1829239

Kesner, L., & Horáček, J. (2017). Empathy-Related Responses to Depicted People in Art Works. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00228

Lai, X., Wang, F., & Wang, X. (2021). Asymmetric relationship between customer sentiment and online hotel ratings: the moderating effects of review characteristics. International Journal of Contemporary Hospitality Management, 33(6), 2137–2156. https://doi.org/10.1108/ijchm-07-2020-0708

Leon, R. D. (2019). Hotel’s online reviews and ratings: a cross-cultural approach. International Journal of Contemporary Hospitality Management, 31(5), 2054–2073. https://doi.org/10.1108/ijchm-05-2018-0413

Leung, X. Y., & Yang, Y. (2020). Are all five points equal? Scaling heterogeneity in hotel online ratings. International Journal of Hospitality Management, 88, 102539. https://doi.org/10.1016/j.ijhm.2020.102539

Li, H., Yu, B. X. B., Li, G., et al. (2023). Restaurant survival prediction using customer-generated content: An aspect-based sentiment analysis of online reviews. Tourism Management, 96, 104707. https://doi.org/10.1016/j.tourman.2022.104707

Li, H., Liu, H., & Zhang, Z. (2020). Online persuasion of review emotional intensity: A text mining analysis of restaurant reviews. International Journal of Hospitality Management, 89, 102558. https://doi.org/10.1016/j.ijhm.2020.102558

Lin, X.-M., Ho, C.-H., Xia, L.-T., et al. (2021). Sentiment analysis of low-carbon travel APP user comments based on deep learning. Sustainable Energy Technologies and Assessments, 44, 101014. https://doi.org/10.1016/j.seta.2021.101014

Liu, Y., & Li, S. (2023). An economic analysis of on-demand food delivery platforms: Impacts of regulations and integration with ride-sourcing platforms. Transportation Research Part E: Logistics and Transportation Review, 171, 103019. https://doi.org/10.1016/j.tre.2023.103019

Liu, Z., & Park, S. (2015). What makes a useful online review? Implication for travel product websites. Tourism Management, 47, 140–151. https://doi.org/10.1016/j.tourman.2014.09.020

Longobardi, C., Borello, L., Thornberg, R., et al. (2019). Empathy and defending behaviours in school bullying: The mediating role of motivation to defend victims. British Journal of Educational Psychology, 90(2), 473–486. Portico. https://doi.org/10.1111/bjep.12289

Maimaiti, M., Zhao, X., Jia, M., et al. (2018). How we eat determines what we become: opportunities and challenges brought by food delivery industry in a changing world in China. European Journal of Clinical Nutrition, 72(9), 1282–1286. https://doi.org/10.1038/s41430-018-0191-1

Mariani, M. M., & Borghi, M. (2018). Effects of the Booking.com rating system: Bringing hotel class into the picture. Tourism Management, 66, 47–52. https://doi.org/10.1016/j.tourman.2017.11.006

McGlohon, M., Glance, N., & Reiter, Z. (2010). Star Quality: Aggregating Reviews to Rank Products and Merchants. Proceedings of the International AAAI Conference on Web and Social Media, 4(1), 114–121. https://doi.org/10.1609/icwsm.v4i1.14019

Mellinas, J. P., María-Dolores, S. M. M., & García, J. J. B. (2016). Effects of the Booking.com scoring system. Tourism Management, 57, 80-83. https://doi.org/10.1016/j.tourman.2016.05.015

Ossai, C. I., & Wickramasinghe, N. (2023). Sentiments prediction and thematic analysis for diabetes mobile apps using Embedded Deep Neural Networks and Latent Dirichlet Allocation. Artificial Intelligence in Medicine, 138, 102509. https://doi.org/10.1016/j.artmed.2023.102509

Pandey, S., Chawla, D., & Puri, S. (2022). Food delivery apps (FDAs) in Asia: an exploratory study across India and the Philippines. British Food Journal, 124(3), 657–678. https://doi.org/10.1108/bfj-01-2020-0074

Parboteeah, D. V., Valacich, J. S., & Wells, J. D. (2009). The Influence of Website Characteristics on a Consumer’s Urge to Buy Impulsively. Information Systems Research, 20(1), 60–78. https://doi.org/10.1287/isre.1070.0157

Pashchenko, Y., Rahman, M. F., Hossain, M. S., et al. (2022). Emotional and the normative aspects of customers’ reviews. Journal of Retailing and Consumer Services, 68, 103011. https://doi.org/10.1016/j.jretconser.2022.103011

Peterson, R. A., & Merino, M. C. (2003). Consumer information search behavior and the internet. Psychology & Marketing, 20(2), 99–121. Portico. https://doi.org/10.1002/mar.10062

Plutchik, R. (1980). A general psychoevolutionary theory of emotion. Theories of Emotion, 3–33. https://doi.org/10.1016/b978-0-12-558701-3.50007-7

Puh, K., & Bagić Babac, M. (2022). Predicting sentiment and rating of tourist reviews using machine learning. Journal of Hospitality and Tourism Insights, 6(3), 1188–1204. https://doi.org/10.1108/jhti-02-2022-0078

Qi, H., & Li, F. (2021). Travelers’ emotional experiences during the COVID-19 outbreak: The development of a conceptual model. Journal of Hospitality and Tourism Management, 47, 389–397. https://doi.org/10.1016/j.jhtm.2021.04.013

Rajeswari, B., Madhavan, S., Venkatesakumar, R., et al. (2020). Sentiment analysis of consumer reviews – a comparison of organic and regular food products usage. Rajagiri Management Journal, 14(2), 155–167. https://doi.org/10.1108/ramj-05-2020-0022

Ramachandran, R., Sudhir, S., & Unnithan, A. B. (2021). Exploring the relationship between emotionality and product star ratings in online reviews. IIMB Management Review, 33(4), 299–308. https://doi.org/10.1016/j.iimb.2021.12.002

Ratnasari, R. T., Gunawan, S., Mawardi, I., & Kirana, K. C. (2020). Emotional experience on behavioral intention for halal tourism. Journal of Islamic Marketing, 12(4), 864–881. https://doi.org/10.1108/JIMA-12-2019-0256

Rita, P., Ramos, R., Borges-Tiago, M. T., et al. (2022). Impact of the rating system on sentiment and tone of voice: A Booking.com and TripAdvisor comparison study. International Journal of Hospitality Management, 104, 103245. https://doi.org/10.1016/j.ijhm.2022.103245

Sánchez-Franco, M. J., Arenas-Márquez, F. J., & Alonso-Dos-Santos, M. (2021). Using structural topic modelling to predict users’ sentiment towards intelligent personal agents. An application for Amazon’s echo and Google Home. Journal of Retailing and Consumer Services, 63, 102658. https://doi.org/10.1016/j.jretconser.2021.102658

Sarkar, A. R., & Ahmad, S. (2021). A new approach to expert reviewer detection and product rating derivation from online experiential product reviews. Heliyon, 7(7), e07409. https://doi.org/10.1016/j.heliyon.2021.e07409

Sayfuddin, A., & Chen, Y. (2021). The signaling and reputational effects of customer ratings on hotel revenues: Evidence from TripAdvisor. International Journal of Hospitality Management, 99, 103065. https://doi.org/10.1016/j.ijhm.2021.103065

Su, D. N., Nguyen-Phuoc, D. Q., Duong, T. H., et al. (2022). How does quality of mobile food delivery services influence customer loyalty? Gronroos’s service quality perspective. International Journal of Contemporary Hospitality Management, 34(11), 4178–4205. https://doi.org/10.1108/ijchm-08-2021-1039

Suhartanto, D., Helmi Ali, M., Tan, K. H., et al. (2019). Loyalty toward online food delivery service: the role of e-service quality and food quality. Journal of Foodservice Business Research, 22(1), 81–97. https://doi.org/10.1080/15378020.2018.1546076

Trivedi, S. K., & Singh, A. (2021). Twitter sentiment analysis of app based online food delivery companies. Global Knowledge, Memory and Communication, 70(8/9), 891–910. https://doi.org/10.1108/gkmc-04-2020-0056

Umasuthan, H., Park, O.-J., & Ryu, J.-H. (2017). Influence of empathy on hotel guests’ emotional service experience. Journal of Services Marketing, 31(6), 618–635. https://doi.org/10.1108/JSM-06-2016-0220 https://doi.org/10.1108/JSM-06-2016-0220

Wang, X., Zhao, F., Tian, X., et al. (2022). How online food delivery platforms contributed to the resilience of the urban food system in China during the COVID-19 pandemic. Global Food Security, 35, 100658. https://doi.org/10.1016/j.gfs.2022.100658

Weiss, H. M., & Cropanzano, R. (1996). Affective Events Theory: A theoretical discussion of the structure, causes and consequences of affective experiences at work. In: Staw, B. M. & Cummings, L. L. (editors). Research in Organizational Behavior: An Annual Series of Analytical Essays and Critical Reviews. Elsevier Science/JAI Press.

Yaiprasert, C., & Hidayanto, A. N. (2023). AI-driven ensemble three machine learning to enhance digital marketing strategies in the food delivery business. Intelligent Systems with Applications, 18, 200235. https://doi.org/10.1016/j.iswa.2023.200235

Zhang, Z., Liang, S., Li, H., et al. (2019). Booking now or later: Do online peer reviews matter? International Journal of Hospitality Management, 77, 147–158. https://doi.org/10.1016/j.ijhm.2018.06.024

Zhao, Y., Yang, S., Narayan, V., & Zhao, Y. (2013). Modeling consumer learning from online product reviews. Marketing Science, 32(1), 153–169. https://doi.org/10.1287/mksc.1120.0755




DOI: https://doi.org/10.24294/jipd.v8i7.5311

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Le Li, Noor Azlin Ismail, Choo Wei Chong, Peng Sun, Mst. Dilara Pervin, Md Shamim Hossain

License URL: https://creativecommons.org/licenses/by/4.0/

This site is licensed under a Creative Commons Attribution 4.0 International License.