Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t...

48
ROSE Robustness Specification for Environmental tests. Faster testing & more information on only one page?

Transcript of Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t...

Page 1: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

ROSE

Robustness Specification for Environmental tests.

Faster testing & more information on only one page?

Page 2: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

More information on less paper?

Page 3: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

DEVELOPERSCONSERVATIVES

INNOVATORS PIONEERS

sing

leSI

M

SIM

.pr

ogr.

com

b.te

stin

g

sing

le.

RO

SE

RO

SE.

prog

r.

HA

LT.

prog

r.

HA

SS.

prog

r.

PoF

&

RC

A.

VIRTUAL

FMECA

MTBF

LCA

physics

theo

retic

s

… .

Reliability Maturity Model

© www.reliability-test.nl

Page 4: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

ROSE

• Position in Reliability Roadmap• Pass/fail vs. quality levels and reliability growth• One page overview, graphical lay out• Different stressors (levels)• Examples

– BT headset– watch

• Conclusions, lessons learned and continuation

Page 5: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

ROSE CONCEPT

TESTS

REQ: BASE (QUALITY LEVEL)

LEV

ELS

PASS

FAIL

MO

NIT

OR

ING

RELIABILITY GROWTH

Page 6: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Step-Stress

Page 7: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Tendency• p/fà

Levels• single test à

system thinking• simulation à

robustness• test à

customer• standards à

tailoredEND USER

Page 8: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

time

Technique

SingleSimulation

SimulationPrograms

CombinedTesting

SingleRobustness

Robustness Programs

HALTHASS

production testing

Simulation Robustness Acceleration

?

Virtual??

ROSE

ESS

Q $tR

p

PoF

Page 9: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Environmental Stress

UseUse

Envi

ronm

enta

l Stre

ss

Timedy mth yrswk

low

med.

high

veryhigh

Simulation testingSimulation testing

Robustness testingRobustness testing

Reliable simulationHigh temperatureLow temperatureDamp heat steady stateDamp heat cyclicThermal shocksSine vibrationRandom vibrationBump & shockLife tests (bending,

switching etc.)Click ratioDust testPerspiration testDrop test etc.

Testtime reductionStress crackingReliability stress screenDamage boundary85/85 testHT drop/LT dropStep stress free fallHigh temp. vibration

Margins testing6 axes omnidirectional vibr.Humidity RSSDamage boundaryCombined testing

?????

SIM

ROSE

HALT

Page 10: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Comparison test philosophies

– fast testing, – levels, – “new”– no standards– destructive (TTF)– RCA always necessary– new test– combined stress

– fast testing, – levels, – “new”– based on standards– destructive (TTF)– RCA always necessary– existing tests– single stress

– longer testing,– pass/fail,– proven, – standards,– non-destructive– RCA when necessary– existing tests– Sinle stress– good simulation– field experiences,

HALT testingROSE testingSimulation testing

Page 11: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Goals of ROSE

• more insight in product quality and robustness• quantification of product quality & comparisons

(progress/competitors)• time reduction: faster testing and “better” results• cost reduction: prevent overkill• mmt summary: one page overview

Page 12: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

What is ROSE

• Method to determine product robustness

– Presentation - One page overview– Destruction – Upper operating/destruct limits– Based on standard tests and equipment

• No HALT/HASS– ROSE is in between– HALT/HASS is 6 axis omnidirectional vibration– HALT/HASS is forced temperature changes

Page 13: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

What is ROSE

Page 14: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Effectiveness of environmental stress at SEMCFr

ee F

all/d

rop

Ele

ctro

Sta

tic D

isch

arge

s

PR

V/R

LLD

T

Dam

age

boun

dary

Cor

rosi

on

Dam

p he

at c

yclicFI

OT

Life

test

s (s

witc

hing

+SC

T)

Ther

mal

sho

ck

Dam

p he

at s

tead

y

Col

d

Oth

er

85/8

5

Dry

hea

t

Com

bine

d te

st

Page 15: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

What is ROSE

Page 16: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

UDL/UOL

• Upper Destructive/Operating Limit– 1. time (continued testing)– 2. stress (increase level)– 3. stressor (different test parameters)

Page 17: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Stressors – Bump test

¨ 3 msþ 6 ms¨ 11 ms

¨ Pulse duration

¨ 15 g þ 25 gþ 30 g? necessary?¨ 40 g

¨ Impact level

1/3 or 1/6 bumps in each direction

þ 3000 bumps¨ 4500 bumps¨ 6000 bumps¨ 9000 bumps

þ Number of bumpsBump test

RemarksValuesVariablesTest

Page 18: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Pulse effects

à Time

Level Most energy?

3 ms 6 ms 12 ms

Page 19: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Stressors – Free fall test

þ room ¨ -20°C¨ +70°C

¨ Temperature

¨ rubber ¨ woodþ steel/concrete

¨ Surface

¨ 1.00 meterþ 1.50 meter¨ 1.80 meter

¨ Impact level

¨ 10 fallsþ 20 falls¨ 40 falls

þ Number of dropsDrop test

RemarksValuesVariablesTest

Page 20: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Step stress (other format)

1,5 meter 1,65 meter 1,80 meter

50 dropsç robust

30 dropsbase / robust

20 dropså base

Page 21: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Stressors – High temp/hum.

þ not specified¨ 5°C/min

¨ Slope

¨ noneþ 85% RH¨ 95% RH

¨ Humidity

¨ 0, -10, -20°Cþ +55, 70, 85°C

þ TemperatureTemphumtest

RemarksValuesVariablesTest

Page 22: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Step-stress approach

+20ºC

-20ºC

-10ºC

+55ºC

+70ºC

+85ºC

+95%RH

+85%RH

+85%RH

0ºC

Page 23: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Stressors – Random vibration

* Use max. product temp.

þ 55°C*¨ 70°C

¨ Temperature

¨ singleþ combined with temp

¨ Type

þ fixed¨ pseudo

¨ Fixation

¨ 0,96 g rmsþ 3,13 g rms¨ tbd

¨ Impact level

¨ 3x 0,5 hoursþ 3x 2,0 hours¨ tbd

þ DurationRandom vibration test

RemarksValuesVariablesTest

Page 24: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

ROSE

• Between simulation tests and HALT• Understanding of failure mechanisms

• 1 page overview • Insight in quality levels• Insight in failure mechanisms

Page 25: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Example• HBH-DS970 • BT voice streaming headset (with display and cord/cables)

Page 26: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Observations

EXAMPLEValues are edited for reference and education

Page 27: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Hippix ES series W604

EXAMPLEValues are edited for reference and education

Page 28: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Hippix TP series W609

EXAMPLEValues are edited for reference and education

Page 29: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Hippix RTL series W628

EXAMPLEValues are edited for reference and education

Page 30: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Robustness Growth

130%

88%

114%

136%

0%

20%

40%

60%

80%

100%

120%

140%

160%

180%

200%

Target ES W604 TP W609 PP W628 TTC Wxx

HIPPIX ROBUSTNESS PROGRESS

Page 31: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Vanguard

• Bluetooth watch• Duration:

Simulation: 3 weeksRobustness: 1 week

Page 32: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Original – Pass/Fail

Page 33: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

ROSE - Robustness

Page 34: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

For Study

Page 35: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

And in new designs?

Page 36: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

ROSE - Robustness

Page 37: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

First time right ….?

Page 38: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Competitor

Page 39: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Development and application

Page 40: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Practice• Duration:

– Simulation: > 3 weeks (BSM)– Robustness: 3 days

• >80 % of fail modes simulation discovered– Clippix > 90%

• Levels and focus areas clear/assigned• 3/5 main field problems anticipated (ev. group)• Typical failure mechanisms determined

– design inputs

Page 41: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Development/continuation

• First projects: technical focus– feasibility ROSE testing

• Latter projects: time focus– from min. 3 weeks to max. 1 week

• Current projects: cost focus– ongoing (10 k to 3 k?)

Page 42: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Costs and pay-back

• Juran• Schneiderman

Page 43: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Quality level

Cost level

Inspection and Prevention Costs

100%

Fail costs

Total QualityCosts

Traditional

AB

Quality Costs by Juran

Page 44: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Quality level

Cost level

Inspection and Prevention Costs

100%

Fail costs

Total QualityCosts

Zero defectsLearning organisation

A B

Quality Costs by Scheiderman

Page 45: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Conclusions/summary

• Clear: one page overview product quality– gives insight in strong and weak parts, as well as relationships– enables comparisons (previous revisions and competitors)

• Levels: quantification (KPI) for reliability level – reliability progress measurable– quantifyable control over all product revisions

• Insight: no pass/fail, but margin to fail– knowing how far from base quality level gives insight in work to be done– no need to do all tests again, concentrate on low robust/improvement areas (focus)– shows and prevents overkill in design

• Effective: selected/limited tests• more frequent tests gives more insight in progress and focus areas • more effective testing, insight in failure mechanisms• overall shorter leadtime

• cultural fit• concrete vs discrete: no p/f, but levels (digital vs analog)

- Insight- Focus- Time/Costs

Page 46: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Lessons learned• Root cause analysis very important and will be more detailed• Monitoring very important• One page overview works very fine• Due time significantly reduced• Difficult to address right failure mechanisms• Additional to simulation testing (share between partners)• Other way of thinking, paying back in costs (Schneiderman)• Test labs need to be prepared (equipment/competence!!)• Predecessor of HALT• Management commitment/ filosophy to find failures (e.g. China)

Page 47: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Todays request

when testing, in your daily work:

• think once about what will happen with extended test• think about what will happen at changed conditions• keep an eye on ROSE and HALT, but do not forget your

current position and capabilities

• Be aware that you are using it already….

Page 48: Presentatie Sony Ericsson - CEEES ROSE Harry Roossien · ho ck D a m p h e a t s t ea dy C o ld O t her 85 / 85 D r y heat C o m b i n e d t e st. ... (KPI) for reliability level

Thanks