Improving Deep Reinforcement Learning-Based Recommender Systems: Overcoming Issues with Usability, Profitability, and User Preferences


Authors : Navin Kumar Sehgal ; Kartik Tyagi

Volume/Issue : Volume 10 - 2025, Issue 3 - March


Google Scholar : https://tinyurl.com/mrnkhz85

Scribd : https://tinyurl.com/mr9jdbna

DOI : https://doi.org/10.38124/ijisrt/25mar1967

Google Scholar

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.

Note : Google Scholar may take 15 to 20 days to display the article.


Abstract : Recommender systems play a important role in personalizing user experiences across digital platforms. Usual recommendation methods often struggle with balancing both user satisfaction and business profitability, leading to inefficiencies in recommendation accuracy and engagement. This study proposes a Deep Reinforcement Learning (DRL)- based recommender system that integrates utility-based optimization, profitability-driven strategies, and user preferences. The methodology uses real-world Amazon product review data to find key insights into review helpfulness, brand engagement, and category-based preferences. Data analysis revealed strong correlations between review helpfulness and product ratings. Experiment was conducted by simulating environment on python using DQN. The recommendations were predicted based on data and user interactions. The experiment highlighted the importance of leveraging high-quality reviews in recommendations. Additionally, brand popularity was identified as a significant factor influencing user engagement, emphasizing the need for brand-aware recommendation strategies. The study introduces a framework that balances utility, business profitability, and consumer effort. By incorporating reinforcement learning techniques, the proposed model adapts to evolving user preferences while improving recommendation efficiency. Experimental results find that the DRL-based system enhances recommendation accuracy, improves long-term engagement and increasing overall business profitability. This research contributes to the improvement of AI-driven recommendation models by offering a scalable, adaptive, and viable solution for recommender systems. Future work will explore real-time adaptability and further refinements in reward modeling to enhance computational efficiency and user experience.

Keywords : Deep Reinforcement Learning, Recommender Systems, Personalized Recommendations, User Preferences, UtilityBased Recommendation, Profit-Driven Recommender System, E-commerce Recommendation Systems, Long-Term User Engagement, Multi-Objective Framework.

References :

  1. S. Krishnamoorthi and K. Gopal Shyam, “Review of Deep Reinforcement Learning-Based Recommender Systems,” in Proceedings of the Third International Conference on Smart Technologies in Computing, Electrical and Electronics (ICSTCEE), Bengaluru, India, pp. 1-6, Dec. 2022.
  2. N. Nie, “Research on Personalized Recommendation Algorithm of Internet Platform Goods Based on Knowledge Graph,” in Highlights in Science, Engineering and Technology, vol. 14, pp. 35-42, Jul. 2023.
  3. Z. Ren, N. Huang, Y. Wang, P. Ren, J. Ma, J. Lei, X. Shi, H. Luo, J. Jose, and X. Xin, “Contrastive State Augmentations for Reinforcement Learning-Based Recommender Systems,” in Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, Taipei, Taiwan, pp. 922-931, Jul. 2023.
  4. T. Mahmood and F. Ricci, “Learning and Adaptivity in Interactive Recommender Systems,” in Proceedings of the Ninth International Conference on Electronic Commerce (ICEC), Minneapolis, MN, USA, pp. 75-84, Aug. 2007.
  5. J. McAuley, R. Pandey, and J. Leskovec, “Inferring Networks of Substitutable and Complementary Products,” in Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’15), Sydney, Australia, pp. 785-794, Aug. 2015.
  6. X. He, K. Deng, X. Wang, Y. Li, Y. Zhang, and M. Wang, “LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation,” in Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Xi’an, China, pp. 639-648, Jul. 2020.

 

Recommender systems play a important role in personalizing user experiences across digital platforms. Usual recommendation methods often struggle with balancing both user satisfaction and business profitability, leading to inefficiencies in recommendation accuracy and engagement. This study proposes a Deep Reinforcement Learning (DRL)- based recommender system that integrates utility-based optimization, profitability-driven strategies, and user preferences. The methodology uses real-world Amazon product review data to find key insights into review helpfulness, brand engagement, and category-based preferences. Data analysis revealed strong correlations between review helpfulness and product ratings. Experiment was conducted by simulating environment on python using DQN. The recommendations were predicted based on data and user interactions. The experiment highlighted the importance of leveraging high-quality reviews in recommendations. Additionally, brand popularity was identified as a significant factor influencing user engagement, emphasizing the need for brand-aware recommendation strategies. The study introduces a framework that balances utility, business profitability, and consumer effort. By incorporating reinforcement learning techniques, the proposed model adapts to evolving user preferences while improving recommendation efficiency. Experimental results find that the DRL-based system enhances recommendation accuracy, improves long-term engagement and increasing overall business profitability. This research contributes to the improvement of AI-driven recommendation models by offering a scalable, adaptive, and viable solution for recommender systems. Future work will explore real-time adaptability and further refinements in reward modeling to enhance computational efficiency and user experience.

Keywords : Deep Reinforcement Learning, Recommender Systems, Personalized Recommendations, User Preferences, UtilityBased Recommendation, Profit-Driven Recommender System, E-commerce Recommendation Systems, Long-Term User Engagement, Multi-Objective Framework.

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe