AI-Powered Preservation of Endangered Languages

Othon Viannis

Author

•

min read

December 3, 2024

Share this article on:

Languages represent far more than mere communication tools; they are intricate vessels of cultural memory, embodying unique perspectives, cultural traditions, and collective wisdom. The loss of a language is not merely a loss of words but a profound erosion of human heritage, disconnecting communities from their ancestral roots and their unique worldview.

The current global linguistic landscape is increasingly fragile. With approximately 7,000 languages worldwide, linguists sound an urgent alarm: the majority are on the brink of extinction, threatening to erase centuries of cultural knowledge and nuanced human understanding.

In this technological era, Artificial Intelligence emerges as a transformative force in language preservation. AI technologies offer innovative pathways to document, analyze, and potentially revive endangered languages, igniting a renewed vigour in safeguarding these invaluable linguistic treasures.

The Current State of Endangered Languages

Language loss occurs when the final native speakers vanish, transforming vibrant linguistic traditions into historical artifacts. The United Nations reports a devastating statistic: an indigenous language disappears every two weeks, extinguishing not just words, but also any chance of revitalizing a community of speakers.

While language extinction is not a new phenomenon, the current rate of language death is unprecedented. Globalization, technological transformation, mass migration, and cultural homogenization have accelerated this linguistic erosion. The digital age, paradoxically, emerges as a critical threat, where dominant online platforms and the ubiquity of English create insurmountable barriers for marginalized languages.

According to Forbes, languages are vanishing at the fastest rate in recorded history, with one language lost every three to four months. A particularly alarming study suggests that less than 5% of global languages can successfully transition into the digital landscape, warning of an impending "massive die-off" caused by the digital divide.

AI as a Tool for Language Preservation

Artificial intelligence has introduced innovative methods for preserving and revitalizing endangered languages, offering tools that were unimaginable in traditional linguistic research.

One groundbreaking application is Automated Transcription Tools. These tools can convert spoken language into written text, an invaluable resource for languages that lack a standardized script.

Another transformative approach involves Machine Translation and Language Models. Large Language Models (LLMs) are trained on extensive datasets to perform translations across a wide range of languages. Linguists and technologists are collaborating to collect data, build linguistic corpora, and design tools capable of processing and generating text in these at-risk languages.‍

Successful AI Projects in Preserving Endangered Languages

Numerous initiatives are dedicated to digitally preserving endangered languages, aiming to safeguard them for posterity. Among the most notable AI-driven projects are those that successfully combine cutting-edge technology with a profound understanding of cultural heritage:

- One of the earliest and most successful examples, launched in 2002 by the Long Now Foundation, the Rosetta Project, represents a pioneering effort to create a comprehensive digital library of all documented languages. By digitizing thousands of languages, it preserves linguistic diversity and ensures that even the most endangered tongues can be studied and appreciated long after their native speakers are gone.

‍

- In late 2022, Google introduced an ambitious program to build AI models capable of supporting the 1,000 most spoken languages worldwide. The initiative tackles the monumental challenge of data scarcity by combining technical innovation with active community engagement. Google researchers collaborated with speaker communities to collect language data and developed new methods for training AI systems on limited datasets. It includes audio recordings, texts, and research to help document and share linguistic information.

- In early 2024, Stanford University launched the Stanford Initiative on Language Inclusion and Conservation in Old and New Media (SILICON). This initiative aims to encode endangered languages into standard formats, facilitating their preservation and integration into AI applications. The goal, said SILICON co-founder Dr Kathryn Starkey is to "help level the playing field for languages beyond English.".

AI in Revitalizing and Teaching Endangered Languages

AI has emerged as a powerful tool for empowering linguistic communities to document, preserve, and share their endangered languages. By providing accessible technological solutions, AI facilitates inclusive documentation and engagement, enabling local speakers to actively participate in preserving their linguistic heritage.‍

Community-Driven Documentation Efforts‍

Innovative AI-powered platforms are transforming language preservation through community-driven initiatives. The Living Dictionaries project, managed by the Living Tongues Institute, exemplifies this approach by creating online repositories where individuals can collaboratively document their endangered languages. Similarly, the "No Voice Left Behind" campaign, conducted in partnership with audio company Shure, focuses on recording and archiving linguistic data from remote regions.

Applications designed for smartphones enable users to create and contribute to digital repositories, ensuring that their language is preserved for future generations. This engagement not only ensures the accuracy of recorded data but also instils a sense of ownership and pride in preserving their linguistic heritage. For example, Google Arts & Culture's Woolaroo, launched in 2021, serves as an open-source smartphone app designed to help younger generations engage with Indigenous languages. By enabling users to explore linguistic heritage interactively, Woolaroo fosters language appreciation and learning.

*James Welcher (2010). James explains Rosetta. Flickr.*

Another example is the company DCKAP, which specializes in designing keyboards for endangered languages. By enabling people to type directly in their native languages instead of relying on transliteration from dominant scripts like English, these technological innovations promote digital inclusivity and help preserve linguistic identity.

AI in Language Pedagogy‍

The rising prominence of AI in education has generated a diverse array of innovative tools, including interactive digital platforms, engaging learning games, and sophisticated translation mechanisms.

AI's potential to generate visually compelling content within virtual reality programs can ignite children's curiosity and motivate them to explore their native language. The ultimate objective is to nurture a profound sense of pride and connection to the native language among young learners. Modern technology can provide rich contextual explanations that help learners appreciate the intricate nuances and inherent beauty of their linguistic heritage.

Challenges and Ethical Considerations

While artificial intelligence offers promising solutions for preserving endangered languages, it faces significant challenges that hinder its full potential. These obstacles stem from the inherent complexities of linguistics, technical limitations, and ethical considerations.

Sparse Data for Endangered Languages

One of the most significant challenges AI faces is the scarcity of linguistic data for endangered languages. David Adelani, an assistant professor of computational linguistics at McGill University, emphasizes this issue, noting that the vast majority of these languages are underrepresented digitally. “If your language doesn’t have a lot of text online, it will be less represented in those technologies,” Adelani explains.

This digital divide is further exacerbated by the dominance of a few languages on the internet. Consequently, endangered languages are often excluded from AI technologies, leaving their speakers marginalized in the digital space. As András Kornai, a professor of mathematical linguistics, points out, “Language preservation is a great thing, but it does not lead to a viable language community.” For many of these languages, the best-case scenario may be digital preservation rather than revitalization.

Dialectal Variations and Cultural Sensitivity

Current AI systems tend to favor standardized forms of languages, potentially neglecting the rich diversity of dialects and variants. This approach risks erasing the nuanced differences that make each dialect unique, threatening the cultural tapestry these languages represent. Moreover, ethical considerations regarding ownership of linguistic data, intellectual property rights, and cultural representation are paramount.

Technical Accessibility

Many communities lack the infrastructure or internet connectivity needed to engage with AI-powered tools. Without the means to use these technologies, even the most sophisticated AI solutions remain out of reach for the people they are designed to help.

Future Prospects

The future of language preservation and revitalization is promising for the world’s endangered languages. Advanced machine learning algorithms, natural language processing, and deep learning techniques are paving the way for more effective tools that can accurately document and revitalize endangered languages. Innovations such as real-time translation, speech recognition, and interactive language learning platforms are making these languages more accessible and engaging for younger generations. Enhanced AI models that account for dialectal variations, sophisticated language-learning platforms, and more context-aware translation systems are on the horizon.

A crucial factor in the successful integration of AI for language preservation is collaboration. Tech companies, linguists, and local communities must work together to ensure that AI tools are culturally relevant and technically effective. Partnerships can lead to the development of tailored solutions that meet the unique needs of each language community. By involving native speakers in the design and implementation of AI technologies, create resources that reflect the true essence of the language and foster a sense of ownership among community members. This collaborative approach is essential for building trust and ensuring the long-term sustainability of language preservation efforts.

References

Haokip, T. (2022). Artificial Intelligence and Endangered Languages. Journal of North EastIndia Studies, 12(1), 1-7.Kavitha, R., et al. (2023).

AI: A Catalyst for Language Preservation in the Digital Era.Shanlax International Journal of English, 12(S1), 102-106.

Othon Viannis

Othon Viannis is a holder of two Master’s degrees in Digital Humanities and Museum Studies, with a focus on the study and preservation of cultural heritage. Combining his interests in history, culture, and technology, Othon has been involved in projects centered on digital archiving and heritage preservation. His work also includes interactive media design, reflecting his dedication to finding creative ways to share and celebrate cultural narratives

Meet on:

Don't miss out on the latest news!

Oops! Something went wrong while submitting the form.

Contribute to Historica's blog!

Learn guidelines, requirements, and join our history-loving community.

Become an author

FAQs

How can I contribute to or collaborate with the Historica project?

If you're interested in contributing to or collaborating with Historica, you can use the contact form on the Historica website to express your interest and detail how you would like to be involved. The Historica team will then be able to guide you through the process.

What role does Historica play in the promotion of culture?

Historica acts as a platform for promoting cultural objects and events by local communities. It presents these in great detail, from previously inaccessible perspectives, and in fresh contexts.

How does Historica support educational endeavors?

Historica serves as a powerful tool for research and education. It can be used in school curricula, scientific projects, educational software development, and the organization of educational events.

What benefits does Historica offer to local cultural entities and events?

Historica provides a global platform for local communities and cultural events to display their cultural artifacts and historical events. It offers detailed presentations from unique perspectives and in fresh contexts.

Can you give a brief overview of Historica?

Historica is an initiative that uses artificial intelligence to build a digital map of human history. It combines different data types to portray the progression of civilization from its inception to the present day.

What is the meaning of Historica's principles?

The principles of Historica represent its methodological, organizational, and technological foundations: Methodological principle of interdisciplinarity: This principle involves integrating knowledge from various fields to provide a comprehensive and scientifically grounded view of history. Organizational principle of decentralization: This principle encourages open collaboration from a global community, allowing everyone to contribute to the digital depiction of human history. Technological principle of reliance on AI: This principle focuses on extensively using AI to handle large data sets, reconcile different scientific domains, and continuously enrich the historical model.

Who are the intended users of Historica?

Historica is beneficial to a diverse range of users. In academia, it's valuable for educators, students, and policymakers. Culturally, it aids workers in museums, heritage conservation, tourism, and cultural event organization. For recreational purposes, it serves gamers, history enthusiasts, authors, and participants in historical reenactments.

How does Historica use artificial intelligence?

Historica uses AI to process and manage vast amounts of data from various scientific fields. This technology allows for the constant addition of new facts to the historical model and aids in resolving disagreements and contradictions in interpretation across different scientific fields.

Can anyone participate in the Historica project?

Yes, Historica encourages wide-ranging collaboration. Scholars, researchers, AI specialists, bloggers and all history enthusiasts are all welcome to contribute to the project.