ETSI HF STF 286 Access symbols for use with video content and ICT devices
description
Transcript of ETSI HF STF 286 Access symbols for use with video content and ICT devices
ETSI STF 286 - Design & Testing 1
ETSI HF STF 286 Access symbols for use with
video content and ICT devices
Symbol design & testingRichard Hodgkinson, TecAccess.net
http://portal.etsi.org/stfs/hf/STF286.asp
ETSI STF 286 - Design & Testing 2
What is ETSI?
European Telecommunications Standards Institute One of three recognised European standards
development organisations CEN/ISSS – European Committee for
Standardisation/Information Society Standardisation System CENELEC – European Committee for Electrotechnical
standardisation
Funded by member organisations (e.g. BT, Siemens, IBM, HP, etc) and the EU.
Produces Standards, Technical Reports, etc that address Information & Communication Technologies
ETSI standards are free and available electronically from www.etsi.org
ETSI STF 286 - Design & Testing 3
ETSI STF 286 - Design & Testing 4
Why ETSI HF STF 286?
Supports the “eEurope 2005 Action Plan” to achieve an “Information Society for All”, and provide everyone the opportunity to participate in the global information society.
Access services: Overcome cultural and social differences, Renders content in alternative formats, Provides access to all.
Team members: Wally Mellors – Team leader (ANEC), Richard Hodgkinson (TecAccess), Clive Miller (ANEC).
ETSI STF 286 - Design & Testing 5
ETSI STF 286 - Design & Testing 6
What is ETSI HF STF 286?
ETSI Standard (ES) 202 432, addresses five access symbols/icons for use with video content and ICT devices: Subtitling: Superimposed text transcript of spoken dialogue. Audio description: Additional audio dialogue describing
significant visual content. Signing: Sign language used for conveying significant
audible content. Speech output: Communication from the device using
spoken language. Spoken command: Ability of the device to accept spoken
commands for the user.
ETSI Technical Report (TR) HF 00094 describes the development and evaluation of the symbols.
ETSI STF 286 - Design & Testing 7
What is ETSI HF STF 286?
Access symbols can be used for: Identifying buttons on hardware controls, Way-finding signs in cinemas and theatres, Packaging of DVDs and Videotapes (printed and tactile), Printed media, e.g. TV magazines, newspapers, Interactive media, e.g. TV and computer displays
(icons).
Investigating tactile and auditory versions of a subset of symbols.
Submission of final symbols for ISO adoption and registration.
Final Standard and Report will be published electronically in early 2007, and will provide symbols in .pdf, .gif and .ico formats.
ETSI STF 286 - Design & Testing 8
First, collect your symbols…
Search for existing symbols…
ETSI STF 286 - Design & Testing 9
Then, collect some more symbols…
Search for existing
symbols…
ETSI STF 286 - Design & Testing 10
Then more symbols…
Brainstorm new symbols…
ETSI STF 286 - Design & Testing 11
Then even more symbols…
Commission new symbols…
ETSI STF 286 - Design & Testing 12
Collected symbols
ETSI STF 286 - Design & Testing 13
ETSI STF 286 - Design & Testing 14
ETSI STF 286 - Design & Testing 15
Symbol testing - ISO 9186
ISO 9186:2001 – Test methods for judged comprehensibility and for comprehension.
Judged Comprehensibility “What percentage of the population expected to understand
the meaning of the symbol?” Where results are inconclusive, perform the comprehension
test: “What do you think this symbol means?” and judge the results.
Comprehension responses:1. Correct understanding is certain,
2. Correct understanding is very probable,
3. Correct understanding is probable,
4. Understanding is opposite of what is intended,
5. Any other response,
6. Response is “I don’t know”,
7. No response given.
ETSI STF 286 - Design & Testing 16
Judged comprehensibility
ETSI STF 286 - Design & Testing 17
Comprehension test
You may see this symbol in association with a telephone.
What do you think this symbol means? Make louder
If you cannot guess the meaning, please answer "Don't know".
Do not worry if you give the same answer to more than one symbol.
ETSI STF 286 - Design & Testing 18
Symbol testing – ETSI TR 0070
ETSI TR 0070 – The Multiple Index Approach (MIA) for the evaluation of pictograms1. The hit rate: Number of correct associations between the
referent and pictogram,
2. The false alarm rate: Number of associations with the wrong referent.
3. Missing values: No answer.
4. Subjective certainty: Certainty of association between pictogram and referent.
5. Subjective suitability: Impression of how well a pictogram represents its referent.
6. Pictogram preference: Which of the pictograms for a referent represents best the referent in question.
7. Pictogram set preference: Which set is preferred on aesthetic grounds.
ETSI STF 286 - Design & Testing 19
Symbol testing
Web Site 1 created for initial filtering by ETSI Human Factors Committee members to reduce candidate symbols to 6 for each function.
Web Site 2 created for testing: Test to ISO 9186 - both Comprehension and
Comprehensibility...respondents see only one test, Symbol order changed with each test, Available in French, German, Italian, Spanish, Italian
and Greek. ETSI 0070 MIA data extracted from ISO 9186
Comprehension test results; 1, 2 & 3 (Correct understanding) provided hit rate, 4 & 5 (Opposite or Other) provided false alarm rate, 6 & 7 (No response) provided missing values, 1, 2 & 3 provided subjective certainty, Pictogram set preference not addressed.
ETSI STF 286 - Design & Testing 20
Test results to date
Test circulated to “Stakeholder” list of over 80 individuals, disability and user organisations.
1999 accesses to the Web site. 964 tests completed from 30 countries. Cultural groups (completed tests):
UK & Ireland (183), Scandinavia (282), Southern Europe (148), Central Europe (115), Mediterranean (51), Eastern Europe (5), Plus USA, Japan, Australia, UAE, Canada, Argentina,
Azerbaijan, Greenland, Philippines, etc. Data also collected on respondents ages, education,
occupations, disabilities and time taken.
ETSI STF 286 - Design & Testing 21
Candidate symbols - 1
ETSI STF 286 - Design & Testing 22
Candidate symbols - 2
ETSI STF 286 - Design & Testing 23
Comprehensibility results - Judging
ETSI STF 286 - Design & Testing 24
Comprehensibility results - Judging
ETSI STF 286 - Design & Testing 25
Comprehensibility results – “Balancing”
ETSI STF 286 - Design & Testing 26
Successful symbols
ETSI STF 286 - Design & Testing 27
Test analysis - 1
ETSI STF 286 - Design & Testing 28
Test analysis - 2
ETSI STF 286 - Design & Testing 29
Symbol testing problems
Inability to control the display resolution. Inability to select and control respondents. Respondents biased by age and education.
More results sought from: Central Europe (Austria, Belgium, Germany,
Luxembourg, Netherlands & Switzerland). Eastern Europe (so far only Bulgaria, Czech Republic,
Estonia & Poland) Mediterranean countries (so far France, Greece, Italy,
Cyprus)
ETSI STF 286 - Design & Testing 30
ISO Registration
Symbols tested in accordance with ISO 9186:2001 -Graphical symbols – Test methods for judged comprehensibility and for comprehension.
Symbols drafted in accordance with IEC 80416-1:2001 – Basic principles for graphical symbols for use on equipment – Creation of symbol originals Provides layout grid and design rules, Provides process for assessment by ISO TC 145 –
Graphical Symbols and IEC SC3C – Graphical symbols for use on equipment,
Final symbols included on ISO 7000/IEC 60417 database.
NOTE: ISO 80416-4:2005 provides “Guidelines for the adaptation of graphical symbols for use on screens and displays”.
ETSI STF 286 - Design & Testing 31
Other modalities being investigated
Tactile symbols: Designed by the RNIB National Centre for Tactile
Diagrams (NCTD). Symbols for:
• Audio description,
• Speech output,
• Spoken command.
Testing at “Sight Village” in July Audio symbols:
Symbols for;
• Audio description,
• Speech output,
• Spoken command.
ETSI STF 286 - Design & Testing 32