How Wikipedia helps you get your language supported by major technology companies

41

Transcript of How Wikipedia helps you get your language supported by major technology companies

Page 1: How Wikipedia helps you get your language supported by major technology companies
Page 2: How Wikipedia helps you get your language supported by major technology companies
Page 3: How Wikipedia helps you get your language supported by major technology companies
Page 4: How Wikipedia helps you get your language supported by major technology companies

World languages / Ieithoedd y Byd

• > 7,000 language / iaith

• 90% <100,000 speakers / siaradwr

• 832 Papua New Guinea

• 260 Ewrop

• 46 with one speaker / 46 gydag un siaradwr

(UNESCO, Infolang, BBC Languages)

Page 5: How Wikipedia helps you get your language supported by major technology companies

League position

Ble mae’r Gymraeg?

Where does Welsh come in the

league table of the 7,000 world

languages, listed by ‘number of

speakers’?Wrth resti’r 7,000 o ieithoedd y byd yn nhrefn nifer siaradwyr, ble mae’r Gymraeg?

Page 6: How Wikipedia helps you get your language supported by major technology companies

172

Page 7: How Wikipedia helps you get your language supported by major technology companies
Page 8: How Wikipedia helps you get your language supported by major technology companies

The challenge for

all Celtic and other languages

The technology can dictate which language

your family can speak at home.

So you’ve got to try to make the technology

understand and speak your language.

Page 9: How Wikipedia helps you get your language supported by major technology companies
Page 10: How Wikipedia helps you get your language supported by major technology companies

To make a Siri, Dot or Google Home, you

need:

1. Speech to text in your language (matched audio/text, pronunciation dictionary, Kaldi or similar)

2. Machine translation which is good in both directions (neural networks helping)

3. Some kind of artificial intelligence to make sense of the semantics (I’m simplifying)

4. Synthetic voice or text to speech

5. Buy-in from Google, Nuance, Apple, Amazon..

Page 11: How Wikipedia helps you get your language supported by major technology companies
Page 12: How Wikipedia helps you get your language supported by major technology companies

So, how many

languages do the big

guns support?Sawl iaith mae’r cwmnïau mawrion yn cefnogi go iawn?

Page 13: How Wikipedia helps you get your language supported by major technology companies
Page 14: How Wikipedia helps you get your language supported by major technology companies

iaith

rhyngwyneb

Twitterinterface

languages

Page 15: How Wikipedia helps you get your language supported by major technology companies

iaith

rhyngwyneb

Twitter

48

Page 16: How Wikipedia helps you get your language supported by major technology companies
Page 17: How Wikipedia helps you get your language supported by major technology companies

iaith chwilio

Googlesearch

languages

Page 18: How Wikipedia helps you get your language supported by major technology companies

iaith chwilio

Google

46

Page 19: How Wikipedia helps you get your language supported by major technology companies
Page 20: How Wikipedia helps you get your language supported by major technology companies

ieithoedd

Apple Sirilanguages

Page 21: How Wikipedia helps you get your language supported by major technology companies

ieithoedd

Apple Siri20

Page 22: How Wikipedia helps you get your language supported by major technology companies
Page 23: How Wikipedia helps you get your language supported by major technology companies

ieithoedd

Amazon Alexa

– Echo, Dotlanguages

Page 24: How Wikipedia helps you get your language supported by major technology companies

ieithoedd

Amazon Alexa

– Echo, Dotlanguages2

Page 25: How Wikipedia helps you get your language supported by major technology companies

Another challenge for

your language

Plan to edge your language up into the

world’s Top 50, so the big companies

introduce support for it

But, hang on, Welsh is down at #172 in the

league table!

Page 26: How Wikipedia helps you get your language supported by major technology companies

Key: yellow rows have support of 2+ companies

Sort by number of speakers first (Col B),

Then by number of Wikipedia articles in that language (Col D)

Page 27: How Wikipedia helps you get your language supported by major technology companies

(http://wikistats.wmflabs.org/ 16 Chwefror 2017)

Page 28: How Wikipedia helps you get your language supported by major technology companies
Page 29: How Wikipedia helps you get your language supported by major technology companies
Page 30: How Wikipedia helps you get your language supported by major technology companies
Page 31: How Wikipedia helps you get your language supported by major technology companies
Page 32: How Wikipedia helps you get your language supported by major technology companies
Page 33: How Wikipedia helps you get your language supported by major technology companies
Page 34: How Wikipedia helps you get your language supported by major technology companies

Ordered by number of speakers

• Catalan 91

• Galician 143

• Scots Gaelic 168 (!)

• Welsh 172

• Basque 174 (!)

• Irish 159

• Breton 206(Wikimedia)

Page 35: How Wikipedia helps you get your language supported by major technology companies

Number/(position in table)

of Wikipedia articles

• Catalan 541k (17)

• Basque 280k (31)

• Galician 139k (47)

• Welsh 91k (60)

• Breton 62k (74)

• Irish 40k (89)

• Scots Gaelic 14k (118)

• Manx 5k (165)(http://wikistats.wmflabs.org/ 16 Chwefror 2017)

Page 36: How Wikipedia helps you get your language supported by major technology companies

How we’ve started to help tackling

this for Welsh

• Open licencing of public sector data and content

• Robin Owain Wikimedia UK had already been

automating using AutoWikiBrowser

• Advice from Basque country: Gorka Julio, Josu

Waliño, Galder Gonzalez

• Galder Gonzalez: “The best way is determining what you want to create, and having a bit with bot

permissions. Also pywikibot installed and running.”

• Grants for #wicipop #wicimon and #wikiiechyd

(pop, science and health, all with editathons as

well as automation)

Page 37: How Wikipedia helps you get your language supported by major technology companies

Apart from appealing to

multinationalsAr wahân i geisio swyno’r cwmnïau mawr...

• Wikipedia gets people speaking & writing in their

own language

• Creating a valuable and important resource for

everyone

• Schools – Digital Competence Framework,

literacy, photography, Welsh Baccalaureate..

• Golygathonau (editathons) are fun. (Like the

Papur Bro folding sessions)

Page 38: How Wikipedia helps you get your language supported by major technology companies
Page 39: How Wikipedia helps you get your language supported by major technology companies

But beware Gofal...

• Quality of content and production experience is

more important than quantity of articles

• Machine translation yields scale but needs to be

used with awareness of cultural sensitivities

• Risk: Celtic languages have low number of

‘views per hour’. How can we boost these?

Welsh 1,076 (67)Breton 765 (75)Irish 621 (80) Scots Gaelic 352 (111) Manx 231 (144) Cornish 172 (172)

Page 40: How Wikipedia helps you get your language supported by major technology companies

The challenge for

Celtic and other languages

Technology is dictating which languages

our families can speak at home.

So we’ve got to make the technology

understand and speak our languages

To do this, we need to raise our languages’

profiles in the eyes of the big companies.

Wikipedia in our own language is an

important part of this.

Page 41: How Wikipedia helps you get your language supported by major technology companies

Corporate slide masterWith guidelines for corporate presentationsWelsh PPT template

The title slide of your Welsh language PowerPoint presentation should contain the Welsh Government logo and Welsh URL address as positioned here on the red template areas.

Do not alter the size or position of these areas.

You are NOT REQUIRED to put th branding on subsequent slides in your presentation

Welsh Government

Diolch ThanksGareth Morlais

@digitalst