Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard...
-
Upload
marvin-dawson -
Category
Documents
-
view
213 -
download
0
Transcript of Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard...
![Page 1: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/1.jpg)
Tourism and ICT Accessibility
Mobile Solution for Sign Language Accessibility
for the Deaf and Hard of Hearing
EPP Hearing - 9/02/2012 László Nemes PhD
![Page 2: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/2.jpg)
MSL Accessibility
• Mobile Sign Language Accessibility R&D project
• Co-funded by the EU (ERDF) and the Hungarian State• Main objectives:
– Create technologies and infrastructure to provide ICT accessibility solutions to the deaf and hard of hearing
– Create a sustainable accessibility service by defining content creation and content ingestion workflows
– Target areas: tourism, culture, administration
![Page 3: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/3.jpg)
Stakeholders Prelingual deaf are people who lost their hearing before they learnt to speak (or born that
way). Because of their inability to connect written words to spoken ones, most of them will have a hard time
reading text. Sign language is not only their primary way of communication, but also their
native language and determining factor of cultural identity.
Hearing loss (adult onset) by country (per 100,000 inhabitants, 2002). Source: wikipedia.org
![Page 4: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/4.jpg)
JEL-M Web Site
JEL-M Mobile App
TEXT2SL engine JELM Content Management
Service
Infrastructure
MSL Project Results
POI database OOI database
Sign languagevideo database
Stationary Resources
![Page 5: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/5.jpg)
JEL-M Accessibility FrameworkJEL-M website for
community touristic contentPublic domain touristic
contentInstitutions
Sign language content productionAutomatic/semi automatic translation of text
content into sign language content
POI database OOI database
Sign languagevideo database
Stationary Resources
Content management
system for JEL-M mobile clients
![Page 6: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/6.jpg)
JEL-M Mobile Application
Parliament
Budapest
![Page 7: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/7.jpg)
Outdoors
![Page 8: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/8.jpg)
Indoors
Musée
d’Orsay
![Page 9: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/9.jpg)
Forms
![Page 10: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/10.jpg)
Content Lifecycle Management
![Page 11: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/11.jpg)
JEL-M Portal
![Page 12: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/12.jpg)
Automatic text2SL translation
1. Summarization
Verified Summarized Text
2. Verification of
SummarizationSummarized Text
3. Summarization Metrics and Model
5. TranslationSummarized text
toISLBSLASL
4. SL Sentence Structure Rules
Sign Language Sentences
6. Video Database Synonym Queries
Sign Language Video Segments
7. Video Matching
SL video
Sign Language Video DatabaseFocus Group
Gen
eric
Co
rpu
s
Tar
get
Co
rpu
s fo
r S
um
mar
izat
ion
![Page 13: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/13.jpg)
Main Innovations• The program realizes accessibility
solution as a cloud service. This means that basically no physical infrastructure needs to be built in the locations where the service is used.
• It provides unlimited scalability, since the service is provided on a device already used by the
end user. The central infrastructure is designed to be highly scalable and easy to maintain. Scalability is unlimited both in terms of end user number and geographical coverage.
• Involvement of collective intelligence. Content is developed by the active participation of stakeholders. This also ensures that the content is relevant to stakeholders.
![Page 14: Tourism and ICT Accessibility Mobile Solution for Sign Language Accessibility for the Deaf and Hard of Hearing EPP Hearing - 9/02/2012 László Nemes PhD.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649ee75503460f94bf8a7d/html5/thumbnails/14.jpg)
Future goals and objectives• Reach critical mass of primary and secondary stakeholders (about 20% of potential
stakeholders)
• Increase geographical coverage of the service.
• Integration of further technologies to enhance user experience• Develop a service for persons with visual impairment• Develop the following service areas:
– Accessibility in tourism– Public transport– Museums, exhibitions, culture– Public institutions, customer service– Education, e-learning, m-learning– Entertainment, fun– Healthcare