Evaluasi Pengalaman Pengguna (User Experience): Analisis Bahasa pada Fitur Chatbot Aisyah - Layanan Nasabah Perbankan Syariah Berbahasa Inggris
DOI:
10.70211/sakalima.v3i1.681Published:
2026-03-31Downloads
Abstract
Digital transformation in Islamic banking has accelerated the adoption of artificial intelligence-based customer service, including chatbot systems that are expected to provide fast, accessible, and inclusive banking assistance. This study aims to evaluate the user experience of Aisyah Chatbot as an English-speaking virtual assistant in Islamic banking services by focusing on linguistic quality, UX writing, conversational relevance, and language-related communication breakdowns. This study employed a descriptive qualitative approach using simulated English chat transcripts as the primary data source. The data were analyzed through an interactive model consisting of data reduction, data display, and conclusion drawing, supported by UX writing principles, Gricean conversational maxims, and linguistic breakdown analysis. The findings indicate that Aisyah Chatbot performs relatively well in informational and educational service scenarios, particularly when users ask clear and formal questions about Islamic banking products and digital account services. However, weaknesses remain in complaint-handling scenarios, especially when users employ natural English, informal expressions, broken grammar, or context-specific problem statements. These weaknesses appear in the form of irrelevant fallback responses, limited understanding of Islamic banking terminology, insufficient empathy, and failure to provide actionable solutions. The study concludes that language quality is a central determinant of chatbot user experience in Islamic banking because linguistic accuracy, pragmatic relevance, and empathetic response design directly influence service efficiency, user trust, and customer satisfaction. The implication of this study is that Islamic banking chatbots should be optimized through stronger English corpora for sharia banking terminology, improved natural language understanding, more contextual fallback responses, and seamless handoff mechanisms to human customer service when automated responses fail.
Keywords:
Aisyah Chatbot Customer Service Islamic Banking Linguistic Breakdowns Natural Language Processing User Experience UX WritingReferences
[1] L. Tudor Car et al., “Conversational agents in health care: Scoping review and conceptual analysis,” J. Med. Internet Res., vol. 22, no. 8, p. e17158, Aug. 2020. https://doi.org/10.2196/17158
[2] L. Nicolescu and M. T. Tudorache, “Human-computer interaction in customer service: The experience with AI chatbots—A systematic literature review,” Electronics, vol. 11, no. 10, p. 1579, May 2022. https://doi.org/10.3390/electronics11101579
[3] M. Shahbandi, “AI chatbots vs. human customer service: Impact on consumer satisfaction and purchase decisions,” Int. Bus. Econ. Stud., vol. 7, no. 3, p. p36, May 2025. https://doi.org/10.22158/ibes.v7n3p36
[4] G. Graham, T. M. Nisar, G. Prabhakar, R. Meriton, and S. Malik, “Chatbots in customer service within banking and finance: Do chatbots herald the start of an AI revolution in the corporate world?,” Comput. Human Behav., vol. 165, p. 108570, Apr. 2025. https://doi.org/10.1016/j.chb.2025.108570
[5] P. R. D. Redjo, D. W. Ningsih, and T. L. Gojayev, “Improving customer service and satisfaction in Indonesian digital banks with AI-powered chatbots,” Manag. Dyn. Int. J. Manag. Digit. Sci., vol. 1, no. 1, pp. 42–49, Jan. 2024. https://doi.org/10.70062/managementdynamics.v1i1.418
[6] S. Singh, B. Sharma, and Y. Awasthi, “Chatbots in banking,” in Cultural Sensitivity, Cross-Border Logistics, and E-Commerce in Global Marketing, IGI Global Scientific Publishing, 2025, pp. 375–396. https://doi.org/10.4018/979-8-3373-0528-8.ch018
[7] A. Chivkula and D. Pokhriyal, “The role of AI-driven chatbots in enhancing sustainable customer service: A survey-based study on consumer perceptions,” J. Innov. Entrep., vol. 15, no. 1, p. 40, Apr. 2026. https://doi.org/10.1186/s13731-026-00653-6
[8] M. M. Abdilah, N. S. N. Alifah, and V. Y. Pratama, “Analisis teknologi chatbot Shopee dalam meningkatkan kepuasan pengguna di Kota Pekalongan,” J. Bersama Ilmu Ekon., vol. 2, no. 1, pp. 15–27, Feb. 2026. https://doi.org/10.55123/ekonom.v2i1.400
[9] Y. J. Oh, J. M. Hu, R. Zhu, J. I. Lim, and X. Zhang, “Artificial intelligence chatbots as relational agents: A systematic review of human-AI chatbot relationships,” Int. J. Human-Computer Interact., pp. 1–25, Apr. 2026. https://doi.org/10.1080/10447318.2026.2648799
[10] R. B. Ikhsan, Y. Fernando, H. Prabowo, Yuniarty, A. Gui, and E. A. Kuncoro, “An empirical study on the use of artificial intelligence in the banking sector of Indonesia by extending the TAM model and the moderating effect of perceived trust,” Digit. Bus., vol. 5, no. 1, p. 100103, Jun. 2025. https://doi.org/10.1016/j.digbus.2024.100103
[11] S. Sidra and S. M. Wagan, “How artificial intelligence enabled marketing activities will change consumer behavior,” Discov. Artif. Intell., vol. 6, no. 1, p. 17, Dec. 2025. https://doi.org/10.1007/s44163-025-00735-6
[12] S. Çam, M. F. Tuna, and T. Bayır, “Exploring the customer experience regarding AI-powered fintech chatbots in terms of SOR theory,” J. Theor. Appl. Electron. Commer. Res., vol. 21, no. 2, p. 49, Feb. 2026. https://doi.org/10.3390/jtaer21020049
[13] N. Amanda and N. Amanda, “AI chatbot to improve customer service and financial literacy in sharia internet banking,” J. Digit. Islam. Econ. Dev., pp. 58–67, Dec. 2025. https://doi.org/10.70992/kmyp9x61
[14] M. Aisyah, Y. S. Sesunan, and A. T. S. Wicaksono, “Customers’ trust in Islamic banking post-cyberattack leads to digital service breakdowns in Indonesia,” Sustain. Futur., vol. 10, p. 101530, Dec. 2025. https://doi.org/10.1016/j.sftr.2025.101530
[15] M. N. D. Miharja, M. H. Fahamsyah, and A. T. Nugroho, “Chatbot development on an interactive services on sharia contracts using natural language processing (NLP),” 2023, p. 020132. https://doi.org/10.1063/5.0120210
[16] I. Hamadou, A. Yumna, H. Hamadou, and M. S. Jallow, “Unleashing the power of artificial intelligence in Islamic banking: A case study of Bank Syariah Indonesia (BSI),” Mod. Financ., vol. 2, no. 1, pp. 131–144, Jun. 2024. https://doi.org/10.61351/mf.v2i1.116
[17] M. Rauschenberger, M. Schrepp, M. P. Cota, S. Olschner, and J. Thomaschewski, “Efficient measurement of the user experience of interactive products: How to use the User Experience Questionnaire (UEQ). Example: Spanish language version,” Int. J. Interact. Multimed. Artif. Intell., vol. 2, no. 1, pp. 39–45, Mar. 2013. https://doi.org/10.9781/ijimai.2013.215
[18] M. Schrepp, A. Hinderks, and J. Thomaschewski, “Design and evaluation of a short version of the User Experience Questionnaire (UEQ-S),” Int. J. Interact. Multimed. Artif. Intell., vol. 4, no. 6, pp. 103–108, Dec. 2017. https://doi.org/10.9781/ijimai.2017.09.001
[19] A. Pratama, A. Faroqi, and E. P. Mandyartha, “Evaluation of user experience in integrated learning information systems using User Experience Questionnaire (UEQ),” J. Inf. Syst. Informatics, vol. 4, no. 4, pp. 1019–1029, Nov. 2022. https://doi.org/10.51519/journalisi.v4i4.394
[20] A. Vizcarra, G. Quiroz, and J. Cornejo, “The impact of user interface and experience (UI/UX) design on visual ergonomics: A technical approach for reducing human error in industrial settings,” Designs, vol. 10, no. 1, p. 8, Jan. 2026. https://doi.org/10.3390/designs10010008
[21] M. M. Soares, E. Rosenzweig, and A. Marcus, Eds., Design, User Experience, and Usability: Design Thinking and Practice in Contemporary and Emerging Technologies, vol. 13323. Cham: Springer International Publishing, 2022. https://doi.org/10.1007/978-3-031-05906-3
[22] M. Schrepp et al., “On the importance of UX quality aspects for different product categories,” Int. J. Interact. Multimed. Artif. Intell., vol. 8, no. 2, pp. 232–246, Jun. 2023. https://doi.org/10.9781/ijimai.2023.03.001
[23] A. Howcroft and H. Blake, “Empathy by design: Reframing the empathy gap between AI and humans in mental health chatbots,” Information, vol. 16, no. 12, p. 1074, Dec. 2025. https://doi.org/10.3390/info16121074
[24] H. Chin, G. Baek, C. Cha, and M. Cha, “Chatbots’ empathetic conversations and responses: A qualitative study of help-seeking queries on depressive moods across 8 commercial conversational agents,” JMIR Form. Res., vol. 9, pp. e71538–e71538, Nov. 2025. https://doi.org/10.2196/71538
[25] A. P. Chaves, J. Egbert, T. Hocking, E. Doerry, and M. A. Gerosa, “Chatbots language design: The influence of language variation on user experience with tourist assistant chatbots,” ACM Trans. Comput. Interact., vol. 29, no. 2, pp. 1–38, Apr. 2022. https://doi.org/10.1145/3487193
[26] D. L. Sihite, T. I. Sari, R. B. Beru PA, and D. Setiawan, “Tantangan guru dalam meningkatkan nilai moral siswa Generasi Z: Studi kasus bullying di sekolah dasar,” Indones. J. Learn. Educ. Stud., vol. 1, no. 2, pp. 121–132, 2023. https://doi.org/10.62385/ijles.v1i2.58
[27] C. Chan, “An exploratory study of a narrative therapy chatbot with social work students,” J. Technol. Hum. Serv., pp. 1–28, Sep. 2025. https://doi.org/10.1080/15228835.2025.2559342
[28] T. Podmajersky, Strategic Writing for UX. O’Reilly Media, Inc., 2019.
[29] “The role of user experience in effective product design exercises strategies for incorporating user-centric approaches and data analysis with business intelligence,” Int. Res. J. Mod. Eng. Technol. Sci., 2024. https://doi.org/10.56726/IRJMETS56245
[30] S. Zia, M. W. Iqbal, M. Noor, M. Aqeel, and K. Hamid, “User experience (UX) enrichment through digital branding,” 2025, pp. 37–50. https://doi.org/10.1007/978-3-031-77617-5_4
[31] T. Firdaus, L. Y. Bakari, D. S. Octarianto, R. Khoirunnisa, D. R. Malini, and M. Mukarromah, “Applying Grice’s maxims and speech act theory to analyze pragmatics in ChatGPT and Gemini AI dialogues,” Int. J. Lang. Transl. Stud., vol. 5, no. 1, pp. 34–53, Jun. 2025. https://doi.org/10.63673/Lotus.1631745
[32] I. Lysova, L. Ahmed, B. Cunningham, Y. Huang, and M. Wiltschko, “Do chatbots dream of AI sheep? A semantic-pragmatic investigation of ‘naturalness’ in human-AI interaction,” AI Soc., vol. 41, no. 2, pp. 1053–1062, Feb. 2026. https://doi.org/10.1007/s00146-025-02595-1
[33] C. V. Misischia, F. Poecze, and C. Strauss, “Chatbots in customer service: Their relevance and impact on service quality,” Procedia Comput. Sci., vol. 201, pp. 421–428, 2022. https://doi.org/10.1016/j.procs.2022.03.055
[34] W.-J. Lee, “Service failure by human, service recovery by AI chatbot: The impact of justice, AI efficacy on recovery effort,” Virtual Econ., vol. 7, no. 4, pp. 48–63, Dec. 2024. https://doi.org/10.34021/ve.2024.07.04(3)
[35] M. Ashfaq, J. Yun, S. Yu, and S. M. C. Loureiro, “I, chatbot: Modeling the determinants of users’ satisfaction and continuance intention of AI-powered service agents,” Telemat. Informatics, vol. 54, p. 101473, Nov. 2020. https://doi.org/10.1016/j.tele.2020.101473
[36] M. Adam, M. Wessel, and A. Benlian, “AI-based chatbots in customer service and their effects on user compliance,” Electron. Mark., vol. 31, no. 2, pp. 427–445, Jun. 2021. https://doi.org/10.1007/s12525-020-00414-7
[37] J. Trivedi, “Examining the customer experience of using banking chatbots and its impact on brand love: The moderating role of perceived risk,” J. Internet Commer., vol. 18, no. 1, pp. 91–111, Jan. 2019. https://doi.org/10.1080/15332861.2019.1567188
[38] H. H. Isnaini and T. Tulasmi, “Analysis of factors affecting the satisfaction of using Aisyah BSI Chatbot using UTAUT 2 Theory,” J. Islam. Econ. Lariba, vol. 10, no. 2, pp. 1021–1042, Dec. 2024. https://doi.org/10.20885/jielariba.vol10.iss2.art21
[39] Y. Huang and D. Gursoy, “Customers’ online service encounter satisfaction with chatbots: Interaction effects of language style and decision-making journey stage,” Int. J. Contemp. Hosp. Manag., vol. 36, no. 12, pp. 4074–4091, Oct. 2024. https://doi.org/10.1108/IJCHM-11-2023-1800
License
Copyright (c) 2026 Yeni Susanti
This work is licensed under a Creative Commons Attribution 4.0 International License.
