Switzerland’s New Language Model Shows How AI Can Truly Serve the Public Good

As artificial intelligence (AI) rapidly transforms scientific research, industry, and public services, growing concerns are emerging about its transparency, societal value, and accountability. Swiss researchers are responding to these concerns with a bold initiative: they have developed a fully open-source, publicly funded large language model (LLM), which they plan to release to the public this summer. The project is led by ETH Zurich, EPFL, and the Swiss National Supercomputing Centre (CSCS), with computing power provided by Alps—a supercomputer purpose-built for AI tasks.

The goal of the model is not merely to demonstrate technological prowess. The initiative’s core ambition is to foster the safe, ethical, and socially beneficial development of AI applications. The openness at the heart of the project extends beyond publishing the models and weights—it includes full documentation of the training data sources, the algorithms used, and the entire development process. This approach stands in stark contrast to prevailing commercial trends, where models are typically developed behind closed doors with minimal public scrutiny.

More than 15 trillion tokens were used to train the model, which will be available in two sizes: one with 8 billion parameters and another with 70 billion. The latter is poised to become one of the most powerful fully open language models in the world. The researchers placed particular emphasis on multilingual capabilities: the model can understand and generate text in over a thousand languages. Around 40 percent of the training data is in non-English languages, making the model especially relevant for communities that have been historically underrepresented in LLM development.

The technical backbone of the project is the Alps supercomputer, operated by CSCS in Lugano, Switzerland. It uses over 10,000 NVIDIA Grace-Hopper Superchips and ranks among the world’s most powerful AI-dedicated systems. The system’s exceptional performance is enabled by low-precision number formats such as FP8 and BF16, which allow for efficient training of large AI models. All computation was powered by electricity from renewable energy sources—an important factor in reducing the environmental footprint of energy-intensive machine learning workloads.

According to the researchers, the data collection process respected website privacy policies and honored opt-out settings. While this approach has been criticized in other projects, the Swiss model did not suffer any performance loss, demonstrating that legal compliance and data quality do not have to be at odds.

The motivation behind the project is not only technological but also social and political. Led by EPFL and ETH Zurich, the Swiss AI Initiative aims to make Europe a more active and independent force in the global development of artificial intelligence. The project brings together over ten Swiss universities and provides researchers with access to more than 20 million GPU hours of computing capacity annually.

The new model will be released under the open Apache 2.0 license, allowing free use, modification, and further development. Through this approach, the researchers aim to support a wide range of scientific, industrial, and governmental applications, and to contribute to the development of trustworthy AI systems at a societal scale.

The model’s upcoming release is not only a technological milestone but also a clear statement: open scientific research and socially driven development can indeed offer a meaningful alternative to closed, commercial systems. That this initiative originates in Switzerland aligns with the country’s longstanding traditions of neutrality and science-based policymaking—and may serve as a model for other European nations as they shape their own AI infrastructures for the future. 

Share this post
Is the Smart Glasses Market Really on the Verge of Taking Off?
According to several industry analysts, 2025 could mark the year when smart glasses finally step out of the realm of experimental devices and begin to gain traction among a wider consumer base. While the concept itself is not new, recent technological advances, the arrival of new players, and the growing role of artificial intelligence all suggest that a turning point may be near. But does this really mean the smart glasses market is about to take off?
China Wants to Buy 100,000 Nvidia Chips – But Where Will the Restricted Technology Come From?
As political and economic tensions between the United States and China continue to rise, global technological competition shows no signs of slowing. Nvidia, one of the world’s most prominent chip manufacturers, is working on new strategies to maintain its presence in China, despite increasing geopolitical constraints. The company is seeking room to maneuver not only in business, but also through diplomacy.
Phase Transition Observed in Language Model Learning
What happens inside the "mind" of artificial intelligence when it learns to understand language? How does it move from simply following the order of words to grasping their meaning? A recently published study offers a theoretical perspective on these internal processes and identifies a transformation that resembles a physical phase transition.
How AI is Helping to Reduce Carbon Emissions in the Cement Industry
One industry alone is responsible for around eight percent of global carbon emissions: cement production. That’s more than the entire aviation sector emits worldwide. As the world increasingly relies on concrete for housing, infrastructure, and industrial facilities, cement manufacturing remains highly energy-intensive and a major source of pollution. A research team at the Paul Scherrer Institute (PSI) in Switzerland is aiming to change this—by using artificial intelligence to develop new, more environmentally friendly cement formulas.
Where is Artificial Intelligence Really Today?
The development of artificial intelligence has produced spectacular and often impressive results in recent years. Systems like ChatGPT can generate natural-sounding language, solve problems, and in many tasks, even surpass human performance. However, a growing number of prominent researchers and technology leaders — including John Carmack and François Chollet — caution that these achievements don’t necessarily indicate that artificial general intelligence (AGI) is just around the corner. Behind the impressive performances, new types of challenges and limitations are emerging that go far beyond raw capability.
Rhino Linux Releases New Version: 2025.3
In the world of Linux distributions, two main approaches dominate: on one side, stable systems that are updated infrequently but offer predictability and security; on the other, rolling-release distributions that provide the latest software at the cost of occasional instability. Rhino Linux aims to bridge this divide by combining the up-to-dateness of rolling releases with the stability offered by Ubuntu as its base.