AI learns to write by reading the web. After English, the web's biggest languages are Russian, German and Japanese. Hindi, spoken by 611 million people, is a fifth of one percent of it.
Orange: each language's share of 2.2 billion pages in Common Crawl, the free copy of the web most AI training starts from, September 2026. Grey: share of the world's 8.3 billion people who speak it.
- The rich world got online first. America, Europe, Russia and Japan have been writing web pages for 30 years. Most Hindi, Bengali and Swahili speakers came online in the last ten, mostly on phones.
- Much of India's web is in English. Newspapers, government and business publish in it, so Indians who write online often do it in English, not Hindi.
- Some text is hard to count. Lots of Hindi is typed in English letters, and Arabic speakers often write their local dialect, so the real figures are somewhat higher. The gap is still huge.
German has a fifth as many speakers as Hindi but 27 times as many web pages: almost one page per German speaker, one per 131 Hindi speakers. AI models are weaker in languages they have read less of, and their makers' own tests show it. Hundreds of millions of the newest internet users will get a worse AI in their own language than in English, unless someone pays to close the gap.