ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer...

17
ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000

Transcript of ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer...

Page 1: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

ISLE: International Standards for Language

Engineering

A European/US joint project

Martha PalmerUniversity of Pennsylvania

Tides KickoffMarch 22, 2000

ISLE: International Standards for Language

Engineering

A European/US joint project

Martha PalmerUniversity of Pennsylvania

Tides KickoffMarch 22, 2000

Page 2: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

OutlineOutline

Background on EAGLES Recent discussions on EU/US

cooperation ISLE project under NSF funding Current ISLE structure Next meeting

Page 3: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

History of EUROPEAN EAGLESHistory of EUROPEAN EAGLES

Began 1992 with agreement among

–NREC, ET7, ACQUILEX, MULTILEX, GENELEX, SAM,TEI

EAGLES launched in 1993

–European Advisory Group on Language Engineering Standards

Page 4: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

UnderpinningsUnderpinnings

Recognition of the strategic role of Linguistic Resources in HLT

Also the need for a shared platform of large-coverage LR as a common infrastructure

Must serve the community

– all EU languages

Page 5: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

Standards are needed forStandards are needed for

Interoperability of systems Reuse and re-integration of components Training based on Gold Standards Evaluation based on accepted criteria Transition from prototypes to LE

products

Page 6: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

Gave rise to coordinated development of Linguistic Resources

Gave rise to coordinated development of Linguistic Resources

Definition of technical standards

– LE EAGLES Creation of LRs for all EU languages

– LE PAROLE, LE SIMPLE

– EuroWordNet, SPEECHDAT 1&2 Distribution of LRs

– LE ELRA

Page 7: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

EAGLES Structure: 1st Phase (1993-1996)

EAGLES Structure: 1st Phase (1993-1996)

L e x icon W GE L R I

C h a ir:A . Z a en en

C o rp u s W GC e rva n tes

C h a ir: A .Z o m p o li

F o rm a lism W GD F K I

C h a ir: H .U szko re it

S p oke n L . W GV o ca lls

C h a ir:R . M o o re

E va lua tion W GC S T

C h a ir: M . K ing

A n to n io Z am p o lliC o o rd in a to r

C e n tra l E d ito rs:N . C a lzo la ri, J . M cN a u g h t

Page 8: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

EAGLES Structure: 2nd Phase(1996-1999)

EAGLES Structure: 2nd Phase(1996-1999)

C o m p L ex icon W GC P R (C a lzo la ri )

C h a ir: A .S a n fillip po

S p oken La n gu ag e W GB ie le fe ld (G ib b o n)

R .M o o re

E va lua tion W GC S T (B . M a eg a a rd )

C h a ir: M . K ing

A n to n io Z am p o lliC o o rd in a to r

C e n tra l E d ito rs:N . C a lzo la ri, J . M cna u g h t

Page 9: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

Methodology for each WGMethodology for each WG

State-of-the-art survey and investigation Elaboration of Proposals

– Discuss, draft, feedback, redraft– Early involvement of industry

Validation of Proposals– Prototype implementations– Possible redrafting

Dissemination, Promotion, Maintenance

Page 10: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

EAGLES GuidelinesEAGLES Guidelines

http://www.ilc.pi.cnr.it/

Lexicons

– Morpho-syntactic phenomena

– Subcategorization

– Semantic encoding

Page 11: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

Discussion of EU/US cooperationDiscussion of EU/US cooperation

LREC Conference in Granada (May, 98) Workshop on Multilingual Information

Management (post LREC, Granada) National Academy of Science Workshop on US/EU Cooperation (Washington, June, 98) Post-Coling/ACL Workshop (Montreal, August, 98) SPARKLE/EAGLES Workshops (Pisa,Jan, 99)

Page 12: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

NSF funding for EU/US joint projectsNSF funding for EU/US joint projects

Discussed at NSF HCI meeting, (Florida, Feb, 1999)

http://www.interact.nsf.gov/cise/html.nsf/html/jointannounce?OpenDocument

ISLE proposal submitted by Pisa/Penn

– EU side: with SDU (DK), ISSCO (CH)

– US side: with NYU and ISI

Page 13: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

ISLE Structure: Phase I(2000 – 2002)ISLE Structure: Phase I(2000 – 2002)

L e x icon W GC h a irs : R .G rish m a n , N .C a lzo la ri, M .P a lm er

S p ee ch W GC h a irs: S te ve n B ird , D a vid R oy

G e s tu re W GC h a irs : D . M e taxa s ,C a ro l N e id le

D isco u rseC h a irs : L yn W a lke r

N a tu ra l In te ra ctio n an d M u lt im o d a lity W GC h a irs: M . L ib e rm a n , R .M o o re

E va lu a ton W GC h a irs : E . H o vy, B . M a e g aa rd , M .K ing

C o o rd in a to rs:A .Z a m po lli, M . P a lm er

C e n tra l E d ito rs:N .C a lzo la ri, J .M cN a u g ht

Page 14: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

Computational Multilingual Lexicons WGComputational Multilingual Lexicons WG

US feedback on EAGLES Extend to linking Multilingual Lexicons Lexical Entry Tool Implementation of Samples Evaluation

Page 15: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

Natural Interaction and Multimodality WGNatural Interaction and Multimodality WG

Data Resources Annotation Schemata and Systems Meta-data description

Page 16: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

Evaluation WGEvaluation WG

Quality Models for MT systems Quality Models for Spoken Dialogue

Systems

Page 17: ISLE: International Standards for Language Engineering A European/US joint project Martha Palmer University of Pennsylvania Tides Kickoff March 22, 2000.

Planned WorkshopsPlanned Workshops

2 Meetings each year for WGs

First meetings –

– NAACL-00, (Seattle, May 4)Planning meeting

– LREC 2000, (Athens, June 3)WGs will meet