Wikisource technical infrastructure - Wikimedia · Rewrite editing interfaces in PHP Try to have...

Wikisource technical infrastructureWhat we have done and what we could do

Thomas Pellissier TanonUser:Tpt@Tpt93

Wikisource Conference 2015

Thomas Pellissier Tanon Wikisource technical infrastructure 2 Wikisource Conference 2015 1 / 20

Wikisource ?

Current state:

4 millions of pages2.1 millions of proofread pages600 active editors (> 5 edits)

Strong issues:

books not easily accessibleno real bibliographic databasecontributing is quite difficult

Wikisource ?

Current state:

4 millions of pages2.1 millions of proofread pages600 active editors (> 5 edits)

Strong issues:

books not easily accessibleno real bibliographic databasecontributing is quite difficult

Wikisource technical infrastructure

MediaWiki

but with custom extensions like ProofreadPage

developed and maintained by volunteer contributors and a few GSoCprojects

MediaWiki

Outline

1 What we have done

2 What we could do

What we have done

Wsexport

Is a ”magic” export tool

adapted to Wikisource needs

ePub is the base format

Wsexport

Migrated on Wikimedia Toolslabs at https://tools.wmflabs.org/wsexport

Integrated in the UI of most ofWikisources

48, 000 exports in October 2015

Supports PDF, mobi...

ePub 3 is the default format

Wsexport

Refactoring of ProofreadPage

Goals:

More maintainable code

Use new MediaWiki features (ContentHandler...)

Better performances

Less breakages

Content validation

Goals:

Better performances

Less breakages

Content validation

Goals:

Better performances

Less breakages

Content validation

Rewrite editing interfaces in PHP

Try to have not too badly architectured codeAutomated testsJSON encoding of Page: pages in API

Rewrite editing interfaces in PHPTry to have not too badly architectured code

Automated testsJSON encoding of Page: pages in API

Rewrite editing interfaces in PHPTry to have not too badly architectured codeAutomated tests

JSON encoding of Page: pages in API

Rewrite editing interfaces in PHPTry to have not too badly architectured codeAutomated testsJSON encoding of Page: pages in API

Interproject sidebar

IA-Upload

An Internet Archive to Commons import tool(http://tools.wmflabs.org/ia-upload)

An import tool for Internet Archive from Google Books and other sources(https://tools.wmflabs.org/bub/)

What we could do

Some ideas...

A Wikisource contributors survey done in Fall 2013 with 251 answers

Figure: What do you think are the core priorities for the Wikisource community?

Integrated ePub exporter15 %

Localized OCR

Better and easier workflow

11 %Wikidata integration 9 %

Visual Editor (Page: namespace)

Visual Editor (main namespace)

Metadata management system

Import-export systems

VisualEditor support

Improve Parsoid rendering of Wikisource content

Support tags used on Wikisource (pages, poem, section...)

Custom interface for Page: pages

Mobile support

Custom edit interface for Page:and Index: pages

We should have a nice UI forboth browsing and editing

Future: gamification?

Mobile support

Exportation of content

Improve Wsexport performances

Use Parsoid

Nice book browsing interface + OPDS?

Integrated inside of Wikimedia infrastructure?

Use Parsoid

Some other ideas

Use Wikidata as much as possible

Gamification (capcha...)

Some other ideas

Conclusion

What we need now:

Stronger interwiki collaboration

People to build the Wikisource of tomorrow

Stronger support from the Wikimedia movement

Conclusion

What we need now:

Conclusion

What we need now:

Thanks a lot for your attention!

Wikisource technical infrastructure - Wikimedia · Rewrite editing interfaces in PHP Try to have...

Documents

Transcript of Wikisource technical infrastructure - Wikimedia · Rewrite editing interfaces in PHP Try to have...

An Original Architectured NiTi Silicone Rubber Structure

Girls Behaving Badly Workbook - Creative Education

Landlords and Tenants Behaving Badly? The Application of ... · LANDLORDS AND TENANTS BEHAVING BADLY? 207 Landlords and Tenants Behaving Badly? The Application of Unconscionable and

REVIEW Micro-architectured materials: past, present …rspa.royalsocietypublishing.org/content/royprsa/466/2121/2495.full.pdf · Micro-architectured materials: past, present and future

God Behaving Badly

'Physics in Trouble': Matter Behaving Badly

Bone regeneration into 3D architectured and osteoinductive ...

Badly Placed Labels

Researchers(behaving(badly:( Misconduct(in…pharmedout.org/pdf/R3DSlides/Seife.pdf · Researchers(behaving(badly:(Misconduct(in(clinical ... and$inapposite$inacon….$ Researchers(behaving(badly:(Misconduct(in(clinical(trials!

Extracting Data from Historical Documents: Crowdsourcing Annotations on Wikisource

ON BADLY APPROXIMABLE NUMBERS AND CERTAIN GAMES · ON BADLY APPROXIMABLE NUMBERS AND CERTAIN GAMES BY WOLFGANG M. SCHMIDT 1. Introduction. A number a is called badly approximable

Badly Drafted Wills

When Bollywood Dresses Badly..

Multi-scale architectured thermoelectric materials in the ...

Wikisource year in review 2017 · 2018. 1. 17. · Wikisource presentations •User:Tpt - Wikisource technical infrastructure, what we have done and what we could do? 2014 •User:Jean-Frédéric

Reviewers (And Editors) Behaving Badly

Design Tools for Architectured Bio-inspired Actuators/Sensors

Bringing it back alive using Wikisource · 2018. 1. 11. · BCN finally decided to use Wikisource for the pilot project May to December, 2009. CONs • No control over the released

Revolutionary War Drill Manual - Wikisource · 2012-04-03 · Revolutionary War Drill Manual From Wikisource Regulations for the Order and Discipline of the Troops of the United States

Wikisource and schools malayalam community experience