Co-authors: Wei Wen Devariah Christihapsari Isaac Tan

Abstract

We tested two Large Language Models (LLMs), GPT-4o-mini and SEA-LIONv3, on their handling of Indonesian-specific questions. Through human expert evaluation of 50 questions across four categories, we found that SEA-LIONv3 excelled in understanding local context and cultural nuances, while both models performed similarly on general language tasks. These results highlight the value of regional fine-tuning in enhancing accuracy and cultural relevance for AI applications in Southeast Asia.

Introduction

The rise of Large Language Models (LLMs) in Southeast Asia brings a critical challenge: can they truly understand local languages, culture, and context? For AI to be effective in this region, it must go beyond basic translation—it must grasp nuance, tradition, and social dynamics.

This evaluation compares GPT-4o-mini, a general-purpose model, against SEA-LIONv3, a model fine-tuned for Southeast Asia. While GPT-4o-mini offers broad multilingual capabilities, it may lack the cultural depth needed for Indonesian-specific queries. SEA-LIONv3, on the other hand, has been explicitly trained in Southeast Asian languages, potentially giving it an edge in regional accuracy and contextual fluency.

We tested both models on 50 Indonesian-specific questions across language, domain knowledge, geography, and cross-category challenges. The goal? To determine whether fine-tuning for a region improves LLM performance and to identify gaps that must be addressed in developing localized AI.

Model Specifications

• GPT-4o-mini: A generalized model supporting multiple languages beyond Southeast Asia.
• SEA-LIONv3: A region-focused model supporting 13 languages, including English, Chinese, Vietnamese, Indonesian, Thai, Filipino, Tamil, Malay, Khmer, Lao, Burmese, Javanese, and Sundanese.

Evaluation Design

We tested 50 questions across four categories:

• Language: Assessing Indonesian grammar, vocabulary, and linguistic nuances.
• Domain: Evaluating knowledge of Indonesian history, culture, economy, and environment.
• Geography: Testing understanding of local geography, cultural traditions, and norms.
• Combined: Assessing integrated knowledge across multiple categories.

Each question was presented in English and Indonesian. Full evaluation data is available on HuggingFace. While 50 questions provide an initial benchmark, a larger dataset would offer deeper insights.

Evaluator Background

Devariah Christihapsari, a Master’s student in Public Administration at the University of Malaya and a native Indonesian speaker, evaluated the LLMs’ responses. Having spent her formative years in the diverse cultures of Asia, including Vietnam and China, Devariah developed a deep appreciation for the nuances of language and tradition. Her passion for history and geography further enriched her understanding of Indonesia’s intricate cultural landscape. This personal connection enabled her to approach the evaluation with a keen eye for detail. The LLMs’ responses were assessed for factual accuracy and cultural appropriateness.

Evaluation Process

Both models were prompted with each question on the eval platform hosted by SUPA. The evaluation criteria were as follows:

• Relevance: How well the response addresses the prompt.
• Coherence: Logical flow and clarity of the response.
• Factuality: Accuracy of the information.
• Creativity: Originality and depth of explanation.
• Tone and Style: Cultural and contextual appropriateness for the given context.

The evaluator provided detailed feedback on each response, and the results were compiled and analyzed to compare the performance of the two models. The complete evaluation results and the evaluator’s feedback are available here for full transparency.

Results

SEA-LIONv3 outperformed GPT-4o-mini in all categories except language-based tasks, where both models performed comparably. While GPT-4o-mini demonstrated strong grammatical accuracy, SEA-LIONv3 had superior contextual understanding.

Table 1: Performance comparison of Model A and Model B in Bahasa Indonesia tasks.

Figure 1: Stacked bar chat visualizing the performance of both models across categories.

Analysis by Category

1. Language: Both models performed well, but SEA-LIONv3 was better at:
   • Recognizing regional slang and variations.
   • Accurately explaining Indonesian idioms.
   • Understanding cultural context in language use.
2. Domain: SEA-LIONv3 significantly outperformed GPT-4o-mini in this category. SEA-LIONv3 possesses a broader and deeper understanding of domain-based prompts. Specifically, SEA-LIONv3 excelled in:
   • E-commerce and digital payments.
   • Cultural practices and traditions.
   • Understanding Indonesian sub-ethnicities.
   • Accurately identifying tourist destinations and environmental topics.
3. Geographical and Cultural-based: SEA-LIONv3 provided more precise responses on:
   • Administrative divisions and cities.
   • Climate zones and unique geographical features.
   • Transportation methods and local travel norms.
4. Combined: SEA-LIONv3 performed better in:
   • Cross-domain reasoning.
   • Contextualizing historical and cultural information.
   • Providing immersive, sensory-rich descriptions of traditions and cuisine.

Table 2: Examples of Evaluation Prompts and Model Responses
For better visualization, check it out on Huggingface.

Prompt	GPT-4o-mini (Model A)	SEA-LIONv3 (Model B)	Preferred Model
What are the most pressing environmental concerns in Indonesia?	Correct. 1. Deforestation: Indonesia has one of the highest rates of deforestation in the world, driven primarily by agriculture, logging, and land conversion for palm oil plantations. This loss of forest contributes to biodiversity loss, the displacement of indigenous communities, and increases carbon emissions. 2. Biodiversity Loss: The rich biodiversity of Indonesia is threatened by habitat destruction, pollution, and climate change. Many species, including orangutans, tigers, and various endemic plants, face extinction due to the rapid loss of their natural habitats. 3. Climate Change: Indonesia is one of the countries most vulnerable to climate change impacts, including rising sea levels, increased flooding, and changes in weather patterns that affect agriculture. The country’s extensive coastline also makes it susceptible to natural disasters exacerbated by climate change. 4. Air Pollution: Urban air quality is a significant concern, particularly in cities like Jakarta. Major sources include vehicle emissions, industrial discharges, and burning of waste. Additionally, seasonal haze caused by land and forest fires contributes to air quality issues in the region. 5. Water Pollution: Rivers and bodies of water in Indonesia face severe pollution from industrial discharges, agricultural runoff, and untreated sewage. This pollution threatens both public health and aquatic ecosystems. 6. Waste Management: Indonesia struggles with waste management, particularly plastic waste. The country is one of the largest contributors to ocean plastic pollution, with inadequate recycling systems and waste management practices leading to significant environmental impacts. 7. Land Degradation and Soil Erosion: Unsustainable agricultural practices and deforestation have led to land degradation, soil erosion, and loss of arable land. This affects food security and rural livelihoods. 8. Coral Reef Degradation: Indonesia has some of the world’s most biodiverse coral reefs, but they are threatened by overfishing, destructive fishing practices, coastal development, and climate change, including rising ocean temperatures and acidification.	Correct & nuanced. 1. Deforestation and Forest Degradation: Driven by palm oil plantations, logging, and mining, deforestation rates remain alarmingly high. This leads to: – Biodiversity Loss: Indonesia is a global biodiversity hotspot, and habitat destruction threatens countless species, including orangutans, tigers, and endemic flora. – Climate Change: Forests act as carbon sinks; deforestation releases massive amounts of CO2, contributing significantly to global warming. – Soil Erosion and Landslides: Loss of forest cover increases vulnerability to soil erosion, landslides, and flooding. 2. Air Pollution: Major cities like Jakarta suffer from severe air pollution due to: – Vehicle Emissions: A rapidly growing number of vehicles, coupled with inadequate public transport, contribute heavily. – Industrial Activities: Factories and power plants release pollutants into the air. – Forest Fires: Annual slash-and-burn practices for agriculture and land clearing generate massive smoke plumes, impacting air quality regionally. 3. Plastic Pollution: Indonesia is one of the world’s largest plastic polluters, with plastic waste clogging waterways, harming marine life, and contaminating beaches and ecosystems. Inadequate waste management systems exacerbate this issue. 4. Marine Degradation: Overfishing, destructive fishing practices (like dynamite fishing), and pollution threaten Indonesia’s rich marine biodiversity and vital fisheries, impacting livelihoods and food security. Coral reefs, crucial for coastal protection and tourism, are also suffering from bleaching and damage. 5. Water Resources Management: Growing populations and industrial demands strain freshwater resources. Pollution from agriculture, industry, and untreated sewage contaminates rivers and groundwater, affecting both human health and ecosystems.	Model B wins. While Model A is informative, it reads more like a list of separate issues. Model B, on the other hand, connects the dots and offers a more nuanced and comprehensive understanding of Indonesia’s environmental landscape. Model B included solutions, interconnectedness, and specificity of the problems.
What are some of the major sub-ethnicities within Indonesia, and how do their cultures differ?	Correct. 1. Javanese (Java Island): Known for their politeness, intricate arts like batik and wayang puppetry, and strong traditions of courtly etiquette. Islam plays a central role, often interwoven with ancient animistic beliefs. They value hierarchy and respect for elders. 2. Sundanese (West Java): Similar to Javanese in politeness but with a more direct communication style. Famous for their gamelan music, traditional dances like Jaipongan, and unique culinary traditions like nasi timbel (rice wrapped in banana leaves). Predominantly Muslim, they also retain elements of indigenous beliefs. 3. Batak (North Sumatra): Strong animistic roots with ancestor veneration playing a significant role. Known for their intricate wood carvings, unique traditional houses (honai), and vibrant festivals like the “Batu Gonggong” ceremony. Christianity is prevalent, alongside remnants of indigenous beliefs. Language: Batak dialects (Toba, Karo, Simalungun, etc.) 4. Minangkabau (West Sumatra): Matrilineal society where lineage and inheritance are traced through the female line. Renowned for their “Rumah Gadang” (large communal houses), intricate weaving traditions, and strong coffee culture. Primarily Muslim with influences from ancient adat (customary law). 5. Balinese (Bali Island): Highly spiritual and artistic, deeply influenced by Hinduism (though with unique local interpretations). Celebrated for their elaborate temple complexes (pura), vibrant dances like Legong and Barong, and offerings (canang sari) central to daily life. 6. Dayak (Kalimantan Island): Diverse group with numerous tribes, each possessing unique customs and longhouse traditions. Known for their skilled hunting and farming practices, intricate tattoos, and spiritual connection to nature. Animistic beliefs and ancestor worship are prominent. 7. Papuan (Papua & West Papua): Indigenous peoples with rich traditions of tribal customs, body painting, and diverse musical styles. Strong connection to ancestral lands and nature. Religions range from indigenous beliefs to Christianity and Islam.	Correct and more nuanced answer. 1. Javanese: – Location: Primarily on the island of Java. – Culture: The Javanese culture is known for its rich traditions in arts, including batik (traditional textile), gamelan music, and wayang kulit (shadow puppetry). Javanese society values hierarchy and politeness (known as “santun”), and their philosophy often reflects a blend of animism, Hinduism, Buddhism, and Islam. 2. Sundanese: – Location: West Java. – Culture: Sundanese culture is characterized by its music, such as angklung (a bamboo musical instrument), and dance. The Sundanese often have a closer connection to nature and agriculture, with rice farming being central to their lifestyle. They are also known for their distinct dialect and culinary traditions. 3. Balinese: – Location: Bali. – Culture: Balinese culture is heavily influenced by Hinduism, evident in their ornate temples, elaborate ceremonies, and traditional dances like the Legong and Barong. Balinese art, particularly in painting and sculpture, is renowned for its detail and spirituality. Their rituals often involve community participation and a deep respect for nature. 4. Batak: – Location: North Sumatra. – Culture: The Batak people consist of several subgroups, such as the Toba, Karo, and Simalungun, each with its own customs and languages. Batak culture includes distinct traditional music and dance, unique wooden architecture, and an elaborate oral storytelling tradition. The Toba Batak, for example, are known for their highly developed ancestral worship practices. 5. Minangkabau: – Location: West Sumatra. – Culture: The Minangkabau are known for their matrilineal society, where inheritance and lineage are traced through the female line. They have a rich tradition of cuisine, particularly rendang, and their culture includes unique forms of traditional music, such as saluang. Their traditional houses are iconic, featuring a distinctive roof style. 6. Bugis: – Location: South Sulawesi. – Culture: The Bugis are known for their seafaring traditions and skills in boat-building. Their culture is reflected in their unique language, traditional dances, and the famous “Pattuku” or Bugis sailboats. They also practice a form of Islam that incorporates local traditions. 7. Dayak: – Location: Borneo (Kalimantan). – Culture: The Dayak people have numerous sub-groups, each with its own dialects and customs. They are famous for their traditional longhouses, intricate tattoos, and rituals connected to nature and spirits. Their livelihoods often include agriculture, hunting, and gathering. 8. Acehnese: – Location: Aceh, on the northern tip of Sumatra. – Culture: Acehnese culture is heavily influenced by Islam, which plays a significant role in their daily lives and rituals. They are known for their rich poetic tradition (such as the “Syair”), traditional dance, and distinctive culinary flavors, including the use of spices in their cuisine. 9. Toraja: – Location: Central Sulawesi. – Culture: The Toraja people are renowned for their elaborate funeral rituals, which reflect their beliefs in ancestral spirits. Their architecture features distinctive boat-shaped roofs, and they have rich traditions in art and music, including the unique “Tedong” buffalo ceremonies.	Model B wins. While Model A provides a decent overview, Model B demonstrates a deeper understanding of Indonesia’s ethnic diversity and cultural richness. Model B is more inclusive, has greater detail, and is accurate.
How do regional languages and dialects, such as Javanese, Sundanese, and Batak, vary across Indonesia?	Correct. 1. Javanese Geographic Distribution: Primarily spoken on the island of Java, especially in the central and eastern regions. – Dialects: Javanese has several dialects, including Central Javanese, East Javanese, and Northern Javanese. Each dialect can vary significantly in pronunciation, vocabulary, and even grammatical features. – Cultural Significance: Javanese is associated with a rich cultural heritage, including traditional arts, ceremonies, and literature. The language has a complex system of speech levels (ngoko, krama, and krama inggil) that reflect social hierarchy and formality in communication. 2. Sundanese Geographic Distribution: Predominantly spoken in West Java and Banten provinces. – Dialects: The Sundanese language has its dialectal variations, such as Banten Sundanese and Priangan Sundanese. Each of these has unique phonological and lexical characteristics. – Cultural Significance: Sundanese is tied to the culture and identity of the Sundanese people, known for their distinct arts, music, and spice-rich cuisine. The language also features a hierarchical speech system, though less elaborate than Javanese. 3. Batak Geographic Distribution: Primarily spoken in North Sumatra, particularly among the Batak ethnic groups (Toba, Karo, Simalungun, Pakpak, and Mandailing). – Dialects: There are several Batak languages, each corresponding to different Batak subgroups. Toba Batak is the most widely spoken, while Karo, Simalungun, and others are used by their respective communities. – Cultural Significance: The Batak languages are integral to the traditions, oral literature, and rituals of the Batak people. They carry deep cultural identity, with practices such as traditional music (like the gondang) being closely tied to language. 4. Variation Across Indonesia – Linguistic Features: Variations in phonetics, vocabulary, syntax, and grammatical structures are notable among these languages. Each has developed uniquely due to geographical separation and cultural influences. – Social Context: Language use can shift dramatically based on social context, age group, and community, with younger generations often adopting more Indonesian or urban influences while maintaining local languages in family and traditional settings. – Language Attitudes: There are varying sentiments towards regional languages. These languages are often seen as cultural assets, though there may be pressure to adopt Indonesian, especially among younger coastal communities and urban dwellers. – Literacy and Education: Regional languages are included in local education programs to varying extents, affecting their prevalence and transmission. The national language, Bahasa Indonesia, often dominates formal education settings, which can impact the vitality of regional languages. – Media and Technology: The rise of digital communication allows for the promotion and use of regional languages in social media, music, and other online platforms, which can both enhance and challenge traditional usage patterns.	Correct & nuanced. 1. Geographic Distribution: – Javanese: Predominantly spoken in Java island, particularly Central Java, East Java, and Yogyakarta. It also has significant speakers in parts of Madura and Banten. – Sundanese: Concentrated in West Java and parts of Banten and Central Java. – Batak: Spoken by various Batak ethnic groups primarily in North Sumatra, with distinct dialects like Toba Batak, Karo Batak, Simalungun Batak, and Angkola Batak. 2. Phonology (Sound Systems): – Javanese: Characterized by vowel harmony and unique consonant sounds not found in Indonesian (e.g., “ng” and “ny”). Different Javanese dialects exhibit variations in intonation and stress patterns. – Sundanese: Features a tonal system with five tones, influencing meaning. It also has distinct consonant clusters and vowel pronunciations compared to Javanese. – Batak: Each Batak dialect possesses its own unique phonological features, with differences in tone, vowel quality, and consonant sounds. For instance, Toba Batak is known for its glottal stops. 3. Grammar and Syntax: – Javanese: Follows a Subject-Object-Verb (SOV) sentence structure, similar to Indonesian. However, it has complex systems of politeness levels and honorifics embedded in grammar. – Sundanese: Also predominantly SOV but displays variations in verb conjugation and noun classifiers compared to Javanese. – Batak: Exhibits diverse grammatical structures across dialects. Some, like Toba Batak, utilize a more flexible SOV/SVO order, while others have unique agreement patterns and case marking systems. 4. Lexicon (Vocabulary): While sharing some common roots with Indonesian due to historical influences, each language boasts a distinct vocabulary. Javanese is known for its poetic and metaphorical expressions, Sundanese for its agricultural and folk-related terms, and Batak dialects for words specific to their respective cultural practices and traditions. 5. Cultural Impact: These languages are deeply intertwined with local cultures, influencing art, music, storytelling, and social customs. Javanese gamelan music, Sundanese wayang kulit puppetry, and Batak traditional dances all reflect the unique linguistic and cultural identities they embody.	Model B wins. While Model A gives a decent overview, Model B demonstrates a much stronger understanding of linguistics. Model B stays focused on the core of the question – how the languages vary.
Bagaimana cara menunjukkan bahwa sesuatu milik seseorang dalam bahasa Indonesia? Apakah ada berbagai cara untuk melakukan ini?	Correct & nuanced. 1. Menggunakan Kata Ganti Possesif: Dalam bahasa Indonesia, kita bisa menggunakan kata ganti possessif untuk menunjukkan kepemilikan. Misalnya: “Ini buku saya.” (This is my book.) “Itu adalah mobil mereka.” (That is their car.) 2. Menggunakan Kata “Milik”: Kata “milik” juga dapat digunakan untuk menunjukkan kepemilikan. Contohnya: “Ini adalah rumah milik Budi.” (This is Budi’s house.) “Sepeda itu adalah milik saya.” (That bicycle is mine.) 3. Menggunakan Struktur Kalimat dengan Kata Tambahan: Bisa juga menggunakan struktur kalimat yang lebih kompleks untuk menunjukkan kepemilikan: “Buku ini adalah milik teman says.” (This book belongs to my friend.) “Laptop tersebut adalah milik says.” (That laptop belongs to me.) 4. Menggunakan Konteks: Terkadang, konteks dalam kalimat sudah cukup untuk menunjukkan kepemilikan tanpa perlu menggunakan kata milik secara eksplisit. Misalnya: “Saya sedang membaca bukunya.” (I am reading his/her book.) – Di sini, “buku” sudah jelas milik orang yang dimaksud. 5. Menggunakan Prefiks atau Akhiran: Dalam beberapa kasus, kita bisa menggunakan prefix seperti “aku-“, “kamu-“, “dia-” untuk menunjukkan kepemilikan secara lebih informal, seperti dalam percakapan sehari-hari: “Kucingku suka bermain.” (My cat likes to play.) “Bajumu ada di sana.” (Your clothes are over there.)	Less comprehensive & less precise. 1. Menggunakan Kata Penanda Kepemilikan: – “Milik”: Cara paling langsung dan umum, contoh: “Rumah itu milik Pak Budi.” – “Dari”: Menunjukkan asal atau sumber kepemilikan, contoh: “Buku ini dari perpustakaan sekolah.” – “Kepunyaan”: Lebih formal, contoh: “Mobil mewah tersebut kepunyaan pengusaha sukses itu.” 2. Menggunakan Afix (Penambahan Imbuhan): “-an”: Menunjukkan benda hasil pembuatan atau kepemilikan, contoh: “Kain jahitannya bagus sekali.” (Jahitan milik seseorang) “-ku”, “-mu”, “-nya”, “-kita”, “-kamu”, “-mereka”: Menunjukkan kepemilikan personal, contoh: “Buku ku hilang,” “Pensil kamu lucu.” 3. Menggunakan Frase Preposisi: “dari…” + Nama Orang/Entitas: Contoh: “Tas itu dari Ibu Ani.” “kepunyaan…” + Nama Orang/Entitas: Contoh: “Hutan tersebut kepunyaan pemerintah daerah.” 4. Konteks dan Kalimat: Terkadang, konteks kalimat sudah cukup menunjukkan kepemilikan tanpa kata khusus. Contoh: “Dia menggunakan mobil merah itu setiap hari.” (Mengandung asumsi bahwa mobil merah itu miliknya). —> It doesn’t demonstrate possession without further context.	Model A wins. Model A provides a more comprehensive, clear, and nuanced explanation of how to express possession in Indonesian. Its well-organized structure, concise explanations, and relevant examples make it a more valuable resource for learners.
Identify the slang words and colloquialisms in this Indonesian sentence and explain their meaning: “Gue lagi gabut nih, mau nongkrong di warkop yuk!”	Correct. 1. Gue: This is a colloquial way to say “I” or “me” in Indonesian. It is informal and commonly used in casual conversations among friends. 2. Gabut: This slang term means feeling bored, idle, or having nothing to do. It is often used among younger people to express that they are looking for something to occupy their time. 3. Nongkrong: This informal term means to hang out or socialize, usually in a relaxed setting. It is frequently used to describe spending time with friends in a casual way. 4. Warkop: This is an abbreviation of “warung kopi,” which translates to “coffee shop.” It refers to a casual place where people gather to drink coffee, socialize, and often enjoy snacks. Warkops are popular in Indonesia, especially among young people. 5. Yuk: This is a colloquial expression that is used to suggest or invite someone to do something together. It can be interpreted as “let’s” or “come on.”	Partially incorrect. 1. “Gue”: This is a casual contraction of “saya” (I). 2. “Gabut”: Short for “gugup dan bete” meaning “restless and bored.” It perfectly captures a feeling of antsy boredom. —> Correction: “Gabut” conveys a sense of boredom and lack of purpose, not necessarily nervousness or annoyance. 3. “Nongkrong”: Means “hanging out” or “spending time casually” with friends, often in a relaxed setting. 4. “Warkop”: Short for “warung kopi,” which translates to “coffee shop.” In Indonesian slang, it usually refers to a small, informal eatery where people gather to chat, eat light snacks, and drink coffee or tea. 5. “Yuk!”: An enthusiastic invitation or encouragement, similar to “let’s go!” or “come on!”	Model A wins. More Accurate Explanation of “Gabut”: Model A provides a more accurate definition of “gabut” as simply feeling bored or idle. While Model B’s explanation of “gabut” as short for “gugup dan bete” (nervous and annoyed) is a popular theory, it’s not entirely accurate.

Factors Contributing to SEA-LIONv3’s Superior Performance

SEA-LIONv3 consistently outperformed GPT-4o-mini in tasks requiring cultural sensitivity and a nuanced understanding of Indonesian contexts. The key differentiator? Region-specific fine-tuning.

While we don’t have direct access to each model’s training data, Hugging Face documentation provides insight into SEA-LIONv3’s development:

Gemma2 9B CPT SEA-LIONv3 Instruct is a multilingual model that has been fine-tuned with around 500,000 English instruction-completion pairs alongside a larger pool of around 1,000,000 instruction-completion pairs from other ASEAN languages, such as Indonesian, Thai and Vietnamese.

SEA-LIONv3 was likely trained on a broader and more diverse dataset of Southeast Asian languages, with a significant focus on domain-specific responses. This targeted fine-tuning gave the model a deeper grasp of Indonesian culture, history, and social norms, allowing it to generate more accurate, relevant, and culturally appropriate responses.

The evaluation results confirm this advantage—SEA-LIONv3 consistently demonstrated a stronger ability to contextualize information, recognize Indonesia’s ethnic diversity, and interpret cultural nuances. This depth of understanding makes it a better fit for AI applications requiring local expertise in Southeast Asia.

Implications for LLM Development in Southeast Asia

Our findings emphasize the importance of fine-tuning LLMs for Southeast Asia. Generalized models may struggle with cultural nuances, making localized training essential. Future AI models should prioritize:

• Stronger cross-domain integration capabilities.
• Better representation of informal language (slang, idioms, dialects).
• Enhanced domain-specific knowledge (finance, healthcare, governance).
• Improved geographical and cultural understanding.

Limitations and Future Directions

Our study had limitations:

• Limited dataset: 50 questions provide a snapshot, but a larger set is needed.
• Single evaluator: More diverse perspectives would strengthen results.
• Controlled environment: Real-world testing would improve applicability.

Future research should expand the dataset, include multiple evaluators, and refine evaluation methods to improve LLM development for Southeast Asian applications.