IndoT5 (Text-to-Text Transfer Transformer) Algorithm for Paraphrasing Indonesian Language Islamic Sermon Manuscripts
DOI:
https://doi.org/10.15575/kjrt.v2i2.1093Keywords:
IndoT5, Text-to-Text Transfer Transformer, Sistem Parafrase, Pemrosesan Bahasa AlamiAbstract
Pengembangan sistem parafrase otomatis
dalam bahasa Indonesia semakin relevan seiring dengan
meningkatnya kebutuhan aplikasi pemrosesan bahasa
alami. Penelitian ini berfokus pada penerapan algoritma
IndoT5 (Text-to-Text Transfer Transformer) untuk
membangun sistem parafrase otomatis dalam bahasa
Indonesia. Sistem ini dievaluasi menggunakan metrik
BLEU, ROUGE, dan METEOR untuk mengukur
kesamaan antara teks parafrase yang dihasilkan model
dengan teks target yang diinginkan. Hasil evaluasi
menunjukkan nilai BLEU sebesar 0,28, ROUGE-1 sebesar 0,59,
ROUGE-2 sebesar 0,40, ROUGE-L sebesar 0,55, dan METEOR
sebesar 0,50. Hal ini menunjukkan bahwa model mampu
menghasilkan parafrase dengan tingkat kesamaan yang
moderat dan mempertahankan makna semantik yang cukup
baik.
References
[1] U. Saokani, M. Irfan, D. S. Maylawati, R. J. Abidin, I. Taufik, and R. N. Hay’s, “Comparison of the Fisher-Yates Shuffle and the Linear Congruent Algorithm for Randomizing Questions in Nahwu Learning Multimedia,” Khazanah Journal of Religion and Technology, vol. 1, no. 1, pp. 10–14, Jun. 2023, doi: 10.15575/kjrt.v1i1.159.
[2] M. Urva Madani and R. Ardianti, “Prosiding Seminar Nasional PBSI-III Tahun 2020 Tema: Inovasi Pembelajaran Bahasa dan Sastra Indonesia Guna Mendukung Merdeka Belajar pada Era Revolusi Industry 4.0 dan Society TEKNIK PARAFRASE DALAM KETRAMPILAN MENULIS UNTUK MENGHINDARI PLAGIARISME.”
[3] A. F. Sberdevices and R. Sberbank, “Russian Paraphrasers: Paraphrase with Transformers,” 2021. [Online]. Available: https://huggingface.co/
[4] admin, “Bahasa Indonesia Disetujui Menjadi Bahasa Resmi Sidang Umum UNESCO,” badanbahasa.kemdikbud.go.id. Accessed: Dec. 15, 2024. [Online]. Available: https://badanbahasa.kemdikbud.go.id/berita-detail/4081/bahasa-indonesia-disetujui-menjadi-bahasa-resmi-sidang-umum-unesco
[5] L. Xue et al., “mT5: A massively multilingual pre-trained text-to-text transformer,” Oct. 2020, [Online]. Available: http://arxiv.org/abs/2010.11934
[6] M. Fuadi, A. Dharma Wibawa, and S. Sumpeno, “idT5: Indonesian Version of Multilingual T5 Transformer.” [Online]. Available: https://huggingface.co/muchad/idt5-base
[7] Admin, “APJII Jumlah Pengguna Internet Indonesia Tembus 221 Juta Orang,” apjii.or.id. Accessed: Dec. 15, 2024. [Online]. Available: https://apjii.or.id/berita/d/apjii-jumlah-pengguna-internet-indonesia-tembus-221-juta-orang
[8] A. Wulandari, “PEMBELAJARAN BAHASA INDONESIA YANG INOVATIF DAN KREATIF DI SMP PADA ERA KURIKULUM MERDEKA.”
[9] H. Judul, “Halaman Depan (cover).”
[10] Bunga Dea Laraswati, “Transformer dalam Machine Learning: Model Dibalik GPT, BERT, dan T5,” blog.algorit.ma. Accessed: Dec. 18, 2024. [Online]. Available: https://blog.algorit.ma/transformer-machine-learning/
[11] M. Yani, N. Siti Khodijah, and M. Mustamiin, “Aplikasi Peringkas Teks Bahasa Indonesia Menggunakan Model Text-to-Text Transfer Transformer (T5)”, doi: 10.37817/ikraith-informatika.v9i2.
[12] Belajar Data Science di Rumah, “Tren Terbaru dalam NLP Machine Learning,” dqlab.id. Accessed: Dec. 15, 2024. [Online]. Available: https://dqlab.id/tren-terbaru-dalam-nlp-machine-learning
[13] L. Xue et al., “mT5: A massively multilingual pre-trained text-to-text transformer,” Oct. 2020, [Online]. Available: http://arxiv.org/abs/2010.11934
[14] M. Fuadi, A. Dharma Wibawa, and S. Sumpeno, “idT5: Indonesian Version of Multilingual T5 Transformer.” [Online]. Available: https://huggingface.co/muchad/idt5-base
[15] A. F. Sberdevices and R. Sberbank, “Russian Paraphrasers: Paraphrase with Transformers,” 2021. [Online]. Available: https://huggingface.co/
[16] E. Sugiri, S. Sodiq, and A. Yusuf, “Penggunaan Variasi Bahasa Dalam Khotbah Salat Jumat Berdasarkan Stratifikasi Sosial Jamaah Di Masjid-Masjid Wilayah Provinsi Jawa Timur: Suatu Kajian Sosiolinguistik,” 2018.
[17] Z. Nuryana, “Pemanfaatan Teknologi Informasi dalam Pendidikan Agama Islam,” TAMADDUN, vol. 19, no. 1, p. 75, Mar. 2019, doi: 10.30587/tamaddun.v0i0.818.
[18] M. Alamsyah, “Pemanfaatan Perkembangan Teknologi Informasi Dan Komunikasi Untuk Meningkatkan Mutu Dakwah,” Jurnal An-nasyr: Jurnal Dakwah Dalam Mata Tinta, vol. 10, no. 1, pp. 48–62, Apr. 2023, doi: 10.54621/jn.v10i1.605.
[19] P. Yualita, “Menulis Paragraf dengan Teknik Parafrasa Menggunakan Software Paraphraser,” Jurnal Kajian Bahasa, Sastra dan Pengajaran (KIBASP), vol. 7, no. 1, pp. 12–26, Aug. 2023, doi: 10.31539/kibasp.v7i1.6409.
[20] U. Primakara, “IMPLEMENTASI PERINGKAS DOKUMEN BERBAHASA INDONESIA MENGGUNAKAN METODE TEXT TO TEXT TRANSFER TRANSFORMER (T5) I Nyoman Purnama 1) , Ni Nengah Widya Utami 2) Program Studi Sistem Informasi 1) , Sistem Informasi Akutansi 2).”
[21] Q. A. Itsnaini, M. Hayaty, A. D. Putra, and N. A. M. Jabari, “Abstractive Text Summarization using Pre-Trained Language Model ‘Text-to-Text Transfer Transformer (T5),’” ILKOM Jurnal Ilmiah, vol. 15, no. 1, pp. 124–131, Apr. 2023, doi: 10.33096/ilkom.v15i1.1532.124-131.
[22] J. Gabín, M. E. Ares, and J. Parapar, “Enhancing Automatic Keyphrase Labelling with Text-to-Text Transfer Transformer (T5) Architecture: A Framework for Keyphrase Generation and Filtering,” Sep. 2024, [Online]. Available: http://arxiv.org/abs/2409.16760
[23] M. Yani, N. Siti Khodijah, and M. Mustamiin, “Aplikasi Peringkas Teks Bahasa Indonesia Menggunakan Model Text-to-Text Transfer Transformer (T5)”, doi: 10.37817/ikraith-informatika.v9i2.
[24] M. Yani, N. S. Khodijah, R. Rendi, and M. Mustamiin, “Aplikasi Peringkas Teks Bahasa Indonesia Menggunakan Model Text-to-Text Transfer Transformer (T5),” IKRA-ITH Informatika : Jurnal Komputer dan Informatika, vol. 9, no. 2, pp. 78–86, Oct. 2024, doi: 10.37817/ikraith-informatika.v9i2.4392.
[25] I Nyoman Purnama and Ni Nengah Widya Utami, “Implementasi Peringkas Dokumen Berbahasa Indonesia Menggunakan Metode Text-to-Text Transfer Transformer (T5),” Jurnal Teknologi Informasi dan Komputer, vol. 9, no. 4, Aug. 2023, doi: 10.36002/jutik.v9i4.2531.
[26] J. Gabín, M. E. Ares, and J. Parapar, “Enhancing Automatic Keyphrase Labelling with Text-to-Text Transfer Transformer (T5) Architecture: A Framework for Keyphrase Generation and Filtering,” Preprint submitted to Elsevier, p. 1, Sep. 2024.
[27] D. Kubal and H. Palivela, “Unified Model for Paraphrase Generation and Paraphrase Identification,” Apr. 23, 2021. doi: 10.20944/preprints202104.0630.v1.
[28] Q. A. Itsnaini, M. Hayaty, A. D. Putra, and N. A. M. Jabari, “Abstractive Text Summarization using Pre-Trained Language Model ‘Text-to-Text Transfer Transformer (T5),’” ILKOM Jurnal Ilmiah, vol. 15, no. 1, pp. 124–131, Apr. 2023, doi: 10.33096/ilkom.v15i1.1532.124-131.
[29] E. Egonmwan and Y. Chali, “Transformer and seq2seq model for Paraphrase Generation,” in Proceedings of the 3rd Workshop on Neural Generation and Translation, Stroudsburg, PA, USA: Association for Computational Linguistics, 2019, pp. 249–255. doi: 10.18653/v1/D19-5627.
[30] C. Schröer, F. Kruse, and J. M. Gómez, “A systematic literature review on applying CRISP-DM process model,” in Procedia Computer Science, Elsevier B.V., 2021, pp. 526–534. doi: 10.1016/j.procs.2021.01.199.
[31] M. Muhammad and M. R. Muhammad, “Building trust in e-commerce: A proposed shari’ah compliant model,” Journal of Internet Banking and Commerce, vol. 18, Dec. 2013.
[32] M. Akram, N. Khan, and M. N. Anjum, “Perceived Financial Transparency and Loyalty in the Islamic Banking Sector of Pakistan: Exploring the Role of Trust and Age,” Contemporary Issues in Social Sciences and Management Practices, vol. 3, no. 2, pp. 14–25, Jun. 2024, doi: 10.61503/cissmp.v3i2.160.
[33] M. A. Khan, “Justice in economics: an Islamic perspective,” in Islamic Economics and Human Well-being, Edward Elgar Publishing, 2024, pp. 66–108. doi: 10.4337/9781035333691.00012.
[34] M. Roberts-Lombard and D. J. Petzer, “Do you want my loyalty? Then understand what drives my trust – a conventional and Islamic banking perspective,” International Journal of Islamic and Middle Eastern Finance and Management, vol. 17, no. 3, pp. 532–551, Jul. 2024, doi: 10.1108/IMEFM-10-2023-0412.
[35] E. Elmahjub, “Artificial Intelligence (AI) in Islamic Ethics: Towards Pluralist Ethical Benchmarking for AI,” Philos Technol, vol. 36, no. 4, p. 73, Dec. 2023, doi: 10.1007/s13347-023-00668-x.
[36] K. Albar, A. Abubakar, and A. Arsyad, “Islamic Business Ethics in Online Commerce: A Perspective from Maqashid Shariah by Imam Haramain,” vol. 07, no. 2, pp. 273–289, 2023, doi: 10.33852/jurnalin.v7i2.501.
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Winda Puspitasari, Dani Ramdani, Aditya Muhamad Maulana
This work is licensed under a Creative Commons Attribution 4.0 International License.
You are free to:
Share — copy and redistribute the material in any medium or format
Adapt — remix, transform, and build upon the material for any purpose, even commercially.
The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.