Sentiment Analysis of Honkai: Star Rail Indonesian Language Reviews on Google Play Store Using Bidirectional Encoder Representations from Transformers Method

Zekri Fitra Ramadhan, Achmad Benny Mutiara

Abstract


Online games are a type of entertainment that is done by humans to have fun and forget all the problems in everyday life. Honkai: Star Rail is a new online game application owned by miHoYo which is currently popular and widely downloaded on the Google Play Store. Reviews on the Honkai: Star Rail app are increasing over time so this makes it difficult for app developers to know past user reviews on their apps. Therefore, the author conducted a study to analyze sentiment towards Honkai: Star Rail application reviews in Indonesian on the Google Play Store using the Bidirectional Encoder Representations from Transformers (BERT) method to determine user sentiment towards the Honkai: Star Rail application and then processed further so that it becomes a record for developers, users, and prospective users of the Honkai: Star Rail application. This study uses Indonesian language review data from users of the Honkai: Star Rail application found on the Google Play Store website as many as 6000 reviews. The BERT method applied in this study consisted of data collection, dataset labeling, data preprocessing, dataset splitting, modeling, model training, and evaluation. Based on the evaluation results that have been carried out on the test data, 97 data are true positive with 27 data are false positive, 4 data are true neutral with 47 data are false neutral, and 381 data are true negative with 37 data are false negative. So, it can be concluded that the model still has difficulty predicting reviews with neutral sentiment but is good enough at predicting reviews with positive and negative sentiment. In addition, the accuracy of the model is 81% with a precision of 63% for positive sentiment reviews, 36% for neutral sentiment reviews, and 89% for negative sentiment reviews.


Keywords


BERT, Classification, Online Game, Sentiment Analysis

Full Text:

PDF

References


V. Bonta, N. Kumaresh, and N. Janardhan, “A Comprehensive Study on Lexicon Based Approaches for Sentiment Analysis,” Asian Journal of Computer Science and Technology, vol. 8, no. S2, pp. 1–6, Mar. 2019, doi: 10.51983/ajcst-2019.8.s2.2037.

D. Darwis, E. S. Pratiwi, and A. F. O. Pasaribu, “PENERAPAN ALGORITMA SVM UNTUK ANALISIS SENTIMEN PADA DATA TWITTER KOMISI PEMBERANTASAN KORUPSI REPUBLIK INDONESIA,” Edutic - Scientific Journal of Informatics Education, vol. 7, no. 1, Nov. 2020, doi: 10.21107/edutic.v7i1.8779.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, Minnesota: Association for Computational Linguistics, Jun. 2019, pp. 4171–4186, doi: 10.18653/v1/N19-1423.

X. Han et al., “Pre-trained models: Past, present and future,” AI Open, vol. 2, pp. 225–250, Jan. 2021, doi: 10.1016/j.aiopen.2021.08.002.

S. Kemp, “Digital 2023: Indonesia,” https://datareportal.com/reports/digital-2023-indonesia, Feb. 09, 2023.

F. Koto, A. Rahimi, J. H. Lau, and T. Baldwin, “IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP,” CoRR, vol. abs/2011.00677, 2020, doi: 10.48550/arXiv.2011.00677.

B. Kurniawan, A. Ari Aldino, and A. Rahman Isnain, “SENTIMEN ANALISIS TERHADAP KEBIJAKAN PENYELENGGARA SISTEM ELEKTRONIK (PSE) MENGGUNAKAN ALGORITMA BIDIRECTIONAL ENCODER REPRESENTATIONS FROM TRANSFORMERS (BERT),” Jurnal Teknologi dan Sistem Informasi (JTSI), vol. 3, no. 4, pp. 98-106, 2022. [Online]. Available: http://jim.teknokrat.ac.id/index.php/JTSI

R. Kusnadi, Y. Yusuf, A. Andriantony, R. Ardian Yaputra, and M. Caintan, “ANALISIS SENTIMEN TERHADAP GAME GENSHIN IMPACT MENGGUNAKAN BERT,” Rabit : Jurnal Teknologi dan Sistem Informasi Univrab, vol. 6, no. 2, pp. 122–129, Jul. 2021, doi: 10.36341/rabit.v6i2.1765.

S. Maulida and A. Slamet Rusydiana, “Islamic Microinsurance: Problem, Future Prospect and Sentiment Analysis,” Tamkin Journal, vol. 2, no. 1, 2023, [Online]. Available: http://journals.smartinsight.id/index.php/TJ/index

H. T. Phan, N. T. Nguyen, and D. Hwang, “Convolutional attention neural network over graph structures for improving the performance of aspect-level sentiment analysis,” Inf Sci (N Y), vol. 589, pp. 416–439, Apr. 2022, doi: 10.1016/j.ins.2021.12.127.

M. W. Prihatmono and Ida, “KOMPARASI ALGORITMA KLASIFIKASI UNTUK SENTIMEN ANALYSIS DJ.ID PADA TWITTER”, Progres, vol. 12, no. 1, pp. 1-11, Apr. 2020.

S. B. Rajeshwari and J. S. Kallimani, “Development of Optimized Linguistic Technique Using Similarity Score on BERT Model in Summarizing Hindi Text Documents,” in Innovative Data Communication Technologies and Application, J. S. Raj, K. Kamel, and P. Lafata, Eds., Singapore: Springer Nature Singapore, 2022, pp. 767–781, doi: 10.1007/978-981-16-7167-8_56.

J. Serrano-Guerrero, F. P. Romero, and J. A. Olivas, “Fuzzy logic applied to opinion mining: A review,” Knowl Based Syst, vol. 222, p. 107018, 2021, doi: 10.1016/j.knosys.2021.107018.

A. Vaswani et al., “Attention Is All You Need,” CoRR, vol. abs/1706.03762, 2017, doi: 10.48550/arXiv.1706.03762.

B. Wilie et al., “IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding,” CoRR, vol. abs/2009.05387, 2020, doi: 10.48550/arXiv.2009.05387.




DOI: https://doi.org/10.52088/ijesty.v3i3.462

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Zekri Fitra Ramadhan, Achmad Benny Mutiara

International Journal of Engineering, Science and Information Technology (IJESTY) eISSN 2775-2674