Customers’ emotional impact on star rating and thumbs-up behavior towards food delivery service Apps

Le Li, Noor Azlin Ismail, Choo Wei Chong, Peng Sun, Mst. Dilara Pervin, Md Shamim Hossain

Article ID: 5311
Vol 8, Issue 7, 2024

VIEWS - 2045 (Abstract)

Abstract


This study explores the intricate relationship between emotional cues present in food delivery app reviews, normative ratings, and reader engagement. Utilizing lexicon-based unsupervised machine learning, our aim is to identify eight distinct emotional states within user reviews sourced from the Google Play Store. Our primary goal is to understand how reviewer star ratings impact reader engagement, particularly through thumbs-up reactions. By analyzing the influence of emotional expressions in user-generated content on review scores and subsequent reader engagement, we seek to provide insights into their complex interplay. Our methodology employs advanced machine learning techniques to uncover subtle emotional nuances within user-generated content, offering novel insights into their relationship. The findings reveal an inverse correlation between review length and positive sentiment, emphasizing the importance of concise feedback. Additionally, the study highlights the differential impact of emotional tones on review scores and reader engagement metrics. Surprisingly, user-assigned ratings negatively affect reader engagement, suggesting potential disparities between perceived quality and reader preferences. In summary, this study pioneers the use of advanced machine learning techniques to unravel the complex relationship between emotional cues in customer evaluations, normative ratings, and subsequent reader engagement within the food delivery app context.


Keywords


machine learning; sentiment analysis; emotional features; food delivery service apps; user evaluations; thumbs-up behavior

Full Text:

PDF


References

  1. Al-Subaihin, A. A., Sarro, F., Black, S., et al. (2019). App Store Effects on Software Engineering Practices. IEEE Transactions on Software Engineering, 47(2), 300–319. https://doi.org/10.1109/tse.2019.2891715
  2. Annaraud, K., & Berezina, K. (2020). Predicting satisfaction and intentions to use online food delivery: What really makes a difference? Journal of Foodservice Business Research, 23(4), 305–323. https://doi.org/10.1080/15378020.2020.1768039
  3. Ashton-James, C. E., & Ashkanasy, N. M. (2008). Chapter 1 Affective events theory: A strategic perspective. In: Zerbe, W. J., Härtel, C. E. J., & Ashkanasy, N. M. (editors). Emotions, Ethics and Decision-Making. Emerald Group Publishing Limited.
  4. Askalidis, G., & Malthouse, E. C. (2016). The Value of Online Customer Reviews. In: Proceedings of the 10th ACM Conference on Recommender Systems.
  5. Chandrasekhar, N., Gupta, S., & Nanda, N. (2019). Food Delivery Services and Customer Preference: A Comparative Analysis. Journal of Foodservice Business Research, 22(4), 375–386. https://doi.org/10.1080/15378020.2019.1626208
  6. Chen, C.-F. (2023). Investigating the Effects of Job Stress on the Distraction and Risky Driving Behaviors of Food Delivery Motorcycle Riders. Safety and Health at Work, 14(2), 207–214. https://doi.org/10.1016/j.shaw.2023.03.004
  7. Chuah, S. H.-W., & Yu, J. (2021). The future of service: The power of emotion in human-robot interaction. Journal of Retailing and Consumer Services, 61, 102551. https://doi.org/10.1016/j.jretconser.2021.102551
  8. Coombs, W. T., & Holladay, S. J. (2007). An exploratory study of stakeholder emotions: Affect and crises. In: Research on Emotion in Organizations. Emerald Group Publishing Limited.
  9. Dąbrowski, J., Letier, E., Perini, A., et al. (2022). Analysing app reviews for software engineering: a systematic literature review. Empirical Software Engineering, 27(2). https://doi.org/10.1007/s10664-021-10065-7
  10. Dąbrowski, J., Letier, E., Perini, A., et al. (2023). Mining and searching app reviews for requirements engineering: Evaluation and replication studies. Information Systems, 114, 102181. https://doi.org/10.1016/j.is.2023.102181
  11. Davidow, M. (2000). The Bottom Line Impact of Organizational Responses to Customer Complaints. Journal of Hospitality & Tourism Research, 24(4), 473–490. https://doi.org/10.1177/109634800002400404
  12. Diekson, Z. A., Prakoso, M. R. B., Putra, M. S. Q., et al. (2023). Sentiment analysis for customer review: Case study of Traveloka. Procedia Computer Science, 216, 682–690. https://doi.org/10.1016/j.procs.2022.12.184
  13. Elahi, M., Khosh Kholgh, D., Kiarostami, M. S., et al. (2023). Hybrid recommendation by incorporating the sentiment of product reviews. Information Sciences, 625, 738–756. https://doi.org/10.1016/j.ins.2023.01.051
  14. Fernandes, S., Panda, R., Venkatesh, V. G., et al. (2022). Measuring the impact of online reviews on consumer purchase decisions – A scale development study. Journal of Retailing and Consumer Services, 68, 103066. https://doi.org/10.1016/j.jretconser.2022.103066
  15. Ghasemaghaei, M., Eslami, S. P., Deal, K., et al. (2018). Reviews’ length and sentiment as correlates of online reviews’ ratings. Internet Research, 28(3), 544–563. https://doi.org/10.1108/intr-12-2016-0394
  16. Hossain, M. S., & Rahman, M. F. (2023a). Customer Sentiment Analysis and Prediction of Insurance Products’ Reviews Using Machine Learning Approaches. FIIB Business Review, 12(4), 386–402. https://doi.org/10.1177/23197145221115793
  17. Hossain, M. S., & Rahman, M. F. (2023b). Detection of readers’ emotional aspects and thumbs-up empathy reactions towards reviews of online travel agency apps. Journal of Hospitality and Tourism Insights, 7(1), 142–171. https://doi.org/10.1108/jhti-10-2022-0487
  18. Hossain, M. S., & Rahman, M. F. (2022). Detection of potential customers’ empathy behavior towards customers’ reviews. Journal of Retailing and Consumer Services, 65, 102881. https://doi.org/10.1016/j.jretconser.2021.102881
  19. Hu, N., Koh, N. S., & Reddy, S. K. (2014). Ratings lead you to the product, reviews help you clinch it? The mediating role of online review sentiments on product sales. Decision Support Systems, 57, 42–53. https://doi.org/10.1016/j.dss.2013.07.009
  20. Islam, Md. J., Datta, R., & Iqbal, A. (2023). Actual rating calculation of the zoom cloud meetings app using user reviews on google play store with sentiment annotation of BERT and hybridization of RNN and LSTM. Expert Systems with Applications, 223, 119919. https://doi.org/10.1016/j.eswa.2023.119919
  21. Jiménez-Zafra, S. M., Martín-Valdivia, M. T., Maks, I., & Izquierdo, R. (2017). Analysis of patient satisfaction in Dutch and Spanish online reviews. Procesamiento del Lenguaje Natural, 58, 101-108.
  22. Kaur, M., Verma, R., & Otoo, F. N. K. (2021). Emotions in leader’s crisis communication: Twitter sentiment analysis during COVID-19 outbreak. Journal of Human Behavior in the Social Environment, 31(1–4), 362–372. https://doi.org/10.1080/10911359.2020.1829239
  23. Kesner, L., & Horáček, J. (2017). Empathy-Related Responses to Depicted People in Art Works. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00228
  24. Lai, X., Wang, F., & Wang, X. (2021). Asymmetric relationship between customer sentiment and online hotel ratings: the moderating effects of review characteristics. International Journal of Contemporary Hospitality Management, 33(6), 2137–2156. https://doi.org/10.1108/ijchm-07-2020-0708
  25. Leon, R. D. (2019). Hotel’s online reviews and ratings: a cross-cultural approach. International Journal of Contemporary Hospitality Management, 31(5), 2054–2073. https://doi.org/10.1108/ijchm-05-2018-0413
  26. Leung, X. Y., & Yang, Y. (2020). Are all five points equal? Scaling heterogeneity in hotel online ratings. International Journal of Hospitality Management, 88, 102539. https://doi.org/10.1016/j.ijhm.2020.102539
  27. Li, H., Yu, B. X. B., Li, G., et al. (2023). Restaurant survival prediction using customer-generated content: An aspect-based sentiment analysis of online reviews. Tourism Management, 96, 104707. https://doi.org/10.1016/j.tourman.2022.104707
  28. Li, H., Liu, H., & Zhang, Z. (2020). Online persuasion of review emotional intensity: A text mining analysis of restaurant reviews. International Journal of Hospitality Management, 89, 102558. https://doi.org/10.1016/j.ijhm.2020.102558
  29. Lin, X.-M., Ho, C.-H., Xia, L.-T., et al. (2021). Sentiment analysis of low-carbon travel APP user comments based on deep learning. Sustainable Energy Technologies and Assessments, 44, 101014. https://doi.org/10.1016/j.seta.2021.101014
  30. Liu, Y., & Li, S. (2023). An economic analysis of on-demand food delivery platforms: Impacts of regulations and integration with ride-sourcing platforms. Transportation Research Part E: Logistics and Transportation Review, 171, 103019. https://doi.org/10.1016/j.tre.2023.103019
  31. Liu, Z., & Park, S. (2015). What makes a useful online review? Implication for travel product websites. Tourism Management, 47, 140–151. https://doi.org/10.1016/j.tourman.2014.09.020
  32. Longobardi, C., Borello, L., Thornberg, R., et al. (2019). Empathy and defending behaviours in school bullying: The mediating role of motivation to defend victims. British Journal of Educational Psychology, 90(2), 473–486. Portico. https://doi.org/10.1111/bjep.12289
  33. Maimaiti, M., Zhao, X., Jia, M., et al. (2018). How we eat determines what we become: opportunities and challenges brought by food delivery industry in a changing world in China. European Journal of Clinical Nutrition, 72(9), 1282–1286. https://doi.org/10.1038/s41430-018-0191-1
  34. Mariani, M. M., & Borghi, M. (2018). Effects of the Booking.com rating system: Bringing hotel class into the picture. Tourism Management, 66, 47–52. https://doi.org/10.1016/j.tourman.2017.11.006
  35. McGlohon, M., Glance, N., & Reiter, Z. (2010). Star Quality: Aggregating Reviews to Rank Products and Merchants. Proceedings of the International AAAI Conference on Web and Social Media, 4(1), 114–121. https://doi.org/10.1609/icwsm.v4i1.14019
  36. Mellinas, J. P., María-Dolores, S. M. M., & García, J. J. B. (2016). Effects of the Booking.com scoring system. Tourism Management, 57, 80-83. https://doi.org/10.1016/j.tourman.2016.05.015
  37. Ossai, C. I., & Wickramasinghe, N. (2023). Sentiments prediction and thematic analysis for diabetes mobile apps using Embedded Deep Neural Networks and Latent Dirichlet Allocation. Artificial Intelligence in Medicine, 138, 102509. https://doi.org/10.1016/j.artmed.2023.102509
  38. Pandey, S., Chawla, D., & Puri, S. (2022). Food delivery apps (FDAs) in Asia: an exploratory study across India and the Philippines. British Food Journal, 124(3), 657–678. https://doi.org/10.1108/bfj-01-2020-0074
  39. Parboteeah, D. V., Valacich, J. S., & Wells, J. D. (2009). The Influence of Website Characteristics on a Consumer’s Urge to Buy Impulsively. Information Systems Research, 20(1), 60–78. https://doi.org/10.1287/isre.1070.0157
  40. Pashchenko, Y., Rahman, M. F., Hossain, M. S., et al. (2022). Emotional and the normative aspects of customers’ reviews. Journal of Retailing and Consumer Services, 68, 103011. https://doi.org/10.1016/j.jretconser.2022.103011
  41. Peterson, R. A., & Merino, M. C. (2003). Consumer information search behavior and the internet. Psychology & Marketing, 20(2), 99–121. Portico. https://doi.org/10.1002/mar.10062
  42. Plutchik, R. (1980). A general psychoevolutionary theory of emotion. Theories of Emotion, 3–33. https://doi.org/10.1016/b978-0-12-558701-3.50007-7
  43. Puh, K., & Bagić Babac, M. (2022). Predicting sentiment and rating of tourist reviews using machine learning. Journal of Hospitality and Tourism Insights, 6(3), 1188–1204. https://doi.org/10.1108/jhti-02-2022-0078
  44. Qi, H., & Li, F. (2021). Travelers’ emotional experiences during the COVID-19 outbreak: The development of a conceptual model. Journal of Hospitality and Tourism Management, 47, 389–397. https://doi.org/10.1016/j.jhtm.2021.04.013
  45. Rajeswari, B., Madhavan, S., Venkatesakumar, R., et al. (2020). Sentiment analysis of consumer reviews – a comparison of organic and regular food products usage. Rajagiri Management Journal, 14(2), 155–167. https://doi.org/10.1108/ramj-05-2020-0022
  46. Ramachandran, R., Sudhir, S., & Unnithan, A. B. (2021). Exploring the relationship between emotionality and product star ratings in online reviews. IIMB Management Review, 33(4), 299–308. https://doi.org/10.1016/j.iimb.2021.12.002
  47. Ratnasari, R. T., Gunawan, S., Mawardi, I., & Kirana, K. C. (2020). Emotional experience on behavioral intention for halal tourism. Journal of Islamic Marketing, 12(4), 864–881. https://doi.org/10.1108/JIMA-12-2019-0256
  48. Rita, P., Ramos, R., Borges-Tiago, M. T., et al. (2022). Impact of the rating system on sentiment and tone of voice: A Booking.com and TripAdvisor comparison study. International Journal of Hospitality Management, 104, 103245. https://doi.org/10.1016/j.ijhm.2022.103245
  49. Sánchez-Franco, M. J., Arenas-Márquez, F. J., & Alonso-Dos-Santos, M. (2021). Using structural topic modelling to predict users’ sentiment towards intelligent personal agents. An application for Amazon’s echo and Google Home. Journal of Retailing and Consumer Services, 63, 102658. https://doi.org/10.1016/j.jretconser.2021.102658
  50. Sarkar, A. R., & Ahmad, S. (2021). A new approach to expert reviewer detection and product rating derivation from online experiential product reviews. Heliyon, 7(7), e07409. https://doi.org/10.1016/j.heliyon.2021.e07409
  51. Sayfuddin, A., & Chen, Y. (2021). The signaling and reputational effects of customer ratings on hotel revenues: Evidence from TripAdvisor. International Journal of Hospitality Management, 99, 103065. https://doi.org/10.1016/j.ijhm.2021.103065
  52. Su, D. N., Nguyen-Phuoc, D. Q., Duong, T. H., et al. (2022). How does quality of mobile food delivery services influence customer loyalty? Gronroos’s service quality perspective. International Journal of Contemporary Hospitality Management, 34(11), 4178–4205. https://doi.org/10.1108/ijchm-08-2021-1039
  53. Suhartanto, D., Helmi Ali, M., Tan, K. H., et al. (2019). Loyalty toward online food delivery service: the role of e-service quality and food quality. Journal of Foodservice Business Research, 22(1), 81–97. https://doi.org/10.1080/15378020.2018.1546076
  54. Trivedi, S. K., & Singh, A. (2021). Twitter sentiment analysis of app based online food delivery companies. Global Knowledge, Memory and Communication, 70(8/9), 891–910. https://doi.org/10.1108/gkmc-04-2020-0056
  55. Umasuthan, H., Park, O.-J., & Ryu, J.-H. (2017). Influence of empathy on hotel guests’ emotional service experience. Journal of Services Marketing, 31(6), 618–635. https://doi.org/10.1108/JSM-06-2016-0220 https://doi.org/10.1108/JSM-06-2016-0220
  56. Wang, X., Zhao, F., Tian, X., et al. (2022). How online food delivery platforms contributed to the resilience of the urban food system in China during the COVID-19 pandemic. Global Food Security, 35, 100658. https://doi.org/10.1016/j.gfs.2022.100658
  57. Weiss, H. M., & Cropanzano, R. (1996). Affective Events Theory: A theoretical discussion of the structure, causes and consequences of affective experiences at work. In: Staw, B. M. & Cummings, L. L. (editors). Research in Organizational Behavior: An Annual Series of Analytical Essays and Critical Reviews. Elsevier Science/JAI Press.
  58. Yaiprasert, C., & Hidayanto, A. N. (2023). AI-driven ensemble three machine learning to enhance digital marketing strategies in the food delivery business. Intelligent Systems with Applications, 18, 200235. https://doi.org/10.1016/j.iswa.2023.200235
  59. Zhang, Z., Liang, S., Li, H., et al. (2019). Booking now or later: Do online peer reviews matter? International Journal of Hospitality Management, 77, 147–158. https://doi.org/10.1016/j.ijhm.2018.06.024
  60. Zhao, Y., Yang, S., Narayan, V., & Zhao, Y. (2013). Modeling consumer learning from online product reviews. Marketing Science, 32(1), 153–169. https://doi.org/10.1287/mksc.1120.0755


DOI: https://doi.org/10.24294/jipd.v8i7.5311

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Le Li, Noor Azlin Ismail, Choo Wei Chong, Peng Sun, Mst. Dilara Pervin, Md Shamim Hossain

License URL: https://creativecommons.org/licenses/by/4.0/

This site is licensed under a Creative Commons Attribution 4.0 International License.