Sentiment Analysis of Marketplace Review with Islamic Perspective using Fine-Tuning DistilBERT
DOI:
https://doi.org/10.15575/kjrt.v2i2.1118Keywords:
DistilBERT, e-Commerce, Islamic Perspective, Sentiment Analysis, Shopee, TokopediaAbstract
E-commerce apps have become an important part of modern life, with user reviews playing a crucial role in assessing platform performance and identifying areas for improvement. This research aims to apply the Distilled Bidirectional Encoder Representations from Transformers (DistilBERT) model to analyze the sentiment contained in user reviews of Tokopedia and Shopee apps on the Google Play Store. Along with the rapid growth of e-commerce in Indonesia, platforms such as Tokopedia and Shopee have become an important component in facilitating fast and easy online transactions. User reviews on these platforms are a valuable source of information for evaluating customer satisfaction, but the increasing volume of reviews makes manual sentiment analysis inefficient. This research uses a dataset of Indonesian-language reviews on Tokopedia and Shopee Apps on Google Play Store to classify sentiments into positive and negative categories by utilizing DistilBERT, which is a lightweight variant of BERT with the ability to efficiently process large data without sacrificing accuracy. The results of this analysis provide insights that can assist e-commerce platforms in improving user experience as well as support data-driven decision-making for application development. This research contributes to the application of natural language processing (NLP) technology for sentiment analysis in the context of e-commerce in Indonesia.
References
[1] A. Ahdian, “5 E-Commerce dengan Pengunjung Terbanyak Sepanjang 2023,” Databoks. Accessed: Nov. 25, 2024. [Online]. Available: https://databoks.katadata.co.id/teknologitelekomunikasi/statistik/3c9132bd3836eff/5-e-commerce%20dengan-%20pengunjung-terbanyak-sepanjang-2023
[2] L. Bharadwaj, “Sentiment Analysis in Online Product Reviews: Mining Customer Opinions for Sentiment Classification,” International Journal For Multidisciplinary Research, vol. 5, no. 5, Sep. 2023, doi: 10.36948/ijfmr.2023.v05i05.6090.
[3] Oluwatosin Abdul-Azeez, Alexsandra Ogadimma Ihechere, and Courage Idemudia, “Enhancing business performance: The role of data-driven analytics in strategic decision-making,” International Journal of Management & Entrepreneurship Research, vol. 6, no. 7, pp. 2066–2081, Jul. 2024, doi: 10.51594/ijmer.v6i7.1257.
[4] Y. Wu, Z. Jin, C. Shi, P. Liang, and T. Zhan, “Research on the application of deep learning-based BERT model in sentiment analysis,” Applied and Computational Engineering, vol. 67, no. 1, pp. 280–286, May 2024, doi: 10.54254/2755-2721/67/2024MA.
[5] R. Silva Barbon and A. T. Akabane, “Towards Transfer Learning Techniques—BERT, DistilBERT, BERTimbau, and DistilBERTimbau for Automatic Text Classification from Different Languages: A Case Study,” Sensors, vol. 22, no. 21, p. 8184, Oct. 2022, doi: 10.3390/s22218184.
[6] B. D. Samudera, N. Nurdin, and H. A. K. Aidilof, “Sentiment Analysis of User Reviews on BSI Mobile and Action Mobile Applications on the Google Play Store Using Multinomial Naive Bayes Algorithm,” International Journal of Engineering, Science and Information Technology, vol. 4, no. 4, pp. 101–112, Oct. 2024, doi: 10.52088/ijesty.v4i4.581.
[7] D. R. Wijaya, G. M. A. Sasmitha, and W. O. Vihikan, “Sentiment Analysis of Indonesian Citizens on Electric Vehicle Using FastText and BERT Method,” Journal of Information Systems and Informatics, vol. 6, no. 3, pp. 1360–1372, Sep. 2024, doi: 10.51519/journalisi.v6i3.784.
[8] A. Alhadlaq and A. Altheneyan, “Distilroberta2gnn: a new hybrid deep learning approach for aspect-based sentiment analysis,” PeerJ Comput Sci, vol. 10, p. e2267, Aug. 2024, doi: 10.7717/peerj-cs.2267.
[9] Cindy Caterine Yolanda, Syafriandi Syafriandi, Yenni Kurniawati, and Dina Fitria, “Sentiment Analysis of DANA Application Reviews on Google Play Store Using Naïve Bayes Classifier Algorithm Based on Information Gain,” UNP Journal of Statistics and Data Science, vol. 2, no. 1, pp. 48–55, Feb. 2024, doi: 10.24036/ujsds/vol2-iss1/147.
[10] N. Agustina, D. H. Citra, W. Purnama, C. Nisa, and A. R. Kurnia, “Implementasi Algoritma Naive Bayes untuk Analisis Sentimen Ulasan Shopee pada Google Play Store,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 2, no. 1, pp. 47–54, Apr. 2022, doi: 10.57152/malcom.v2i1.195.
[11] N. Chintalapudi, G. Battineni, and F. Amenta, “Sentimental Analysis of COVID-19 Tweets Using Deep Learning Models,” Infect Dis Rep, vol. 13, no. 2, pp. 329–339, Apr. 2021, doi: 10.3390/idr13020032.
[12] S. Wei, D. Yu, and C. Lv, “A Distilled BERT with Hidden State and Soft Label Learning for Sentiment Classification,” J Phys Conf Ser, vol. 1693, no. 1, p. 012076, Dec. 2020, doi: 10.1088/1742-6596/1693/1/012076.
[13] S.-L. Peng, S.-Y. Hsieh, S. Gopalakrishnan, and B. Duraisamy, Intelligent Computing and Innovation on Data Science, vol. 248. Singapore: Springer Nature Singapore, 2021. doi: 10.1007/978-981-16-3153-5.
[14] A. Joshy and S. Sundar, “Analyzing the Performance of Sentiment Analysis using BERT, DistilBERT, and RoBERTa,” in 2022 IEEE International Power and Renewable Energy Conference (IPRECON), IEEE, Dec. 2022, pp. 1–6. doi: 10.1109/IPRECON55716.2022.10059542.
[15] S. Tabinda Kokab, S. Asghar, and S. Naz, “Transformer-based deep learning models for the sentiment analysis of social media data,” Array, vol. 14, p. 100157, Jul. 2022, doi: 10.1016/j.array.2022.100157.
[16] A. Areshey and H. Mathkour, “Exploring transformer models for sentiment classification: A comparison of BERT, RoBERTa, ALBERT, DistilBERT, and XLNet,” Expert Syst, vol. 41, no. 11, Nov. 2024, doi: 10.1111/exsy.13701.
[17] S. Ikiss, N. Daoudi, M. Abourezq, and M. Bellafkih, “Exploring the potential of DistilBERT architecture for automatic essay scoring task,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 36, no. 2, p. 1234, Nov. 2024, doi: 10.11591/ijeecs.v36.i2.pp1234-1241.
[18] S. V et al., “The DistilBERT Model: A Promising Approach to Improve Machine Reading Comprehension Models,” International Journal on Recent and Innovation Trends in Computing and Communication, vol. 11, no. 8, pp. 293–309, Sep. 2023, doi: 10.17762/ijritcc.v11i8.7957.
[19] C. Schröer, F. Kruse, and J. M. Gómez, “A Systematic Literature Review on Applying CRISP-DM Process Model,” Procedia Comput Sci, vol. 181, pp. 526–534, 2021, doi: 10.1016/j.procs.2021.01.199.
[20] U. Kannengiesser and J. S. Gero, “Modelling the Design of Models: An Example Using CRISP-DM,” Proceedings of the Design Society, vol. 3, pp. 2705–2714, Jul. 2023, doi: 10.1017/pds.2023.271.
[21] M. Muhammad and M. R. Muhammad, “Building trust in e-commerce: A proposed shari’ah compliant model,” Journal of Internet Banking and Commerce, vol. 18, Dec. 2013.
[22] M. Akram, N. Khan, and M. N. Anjum, “Perceived Financial Transparency and Loyalty in the Islamic Banking Sector of Pakistan: Exploring the Role of Trust and Age,” Contemporary Issues in Social Sciences and Management Practices, vol. 3, no. 2, pp. 14–25, Jun. 2024, doi: 10.61503/cissmp.v3i2.160.
[23] M. A. Khan, “Justice in economics: an Islamic perspective,” in Islamic Economics and Human Well-being, Edward Elgar Publishing, 2024, pp. 66–108. doi: 10.4337/9781035333691.00012.
[24] M. Roberts-Lombard and D. J. Petzer, “Do you want my loyalty? Then understand what drives my trust – a conventional and Islamic banking perspective,” International Journal of Islamic and Middle Eastern Finance and Management, vol. 17, no. 3, pp. 532–551, Jul. 2024, doi: 10.1108/IMEFM-10-2023-0412.
[25] E. Elmahjub, “Artificial Intelligence (AI) in Islamic Ethics: Towards Pluralist Ethical Benchmarking for AI,” Philos Technol, vol. 36, no. 4, p. 73, Dec. 2023, doi: 10.1007/s13347-023-00668-x.
[26] K. Albar, A. Abubakar, and A. Arsyad, “Islamic Business Ethics in Online Commerce: A Perspective from Maqashid Shariah by Imam Haramain,” vol. 07, no. 2, pp. 273–289, 2023, doi: 10.33852/jurnalin.v7i2.501.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Reza Fahlevi Reza, Muhmmad Thoriq, Rd. Imam Saepul Millah
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
Share — copy and redistribute the material in any medium or format
Adapt — remix, transform, and build upon the material for any purpose, even commercially.
The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.