7T Evaluating Your Design F2010.ppt - University of Minnesota10/19/2010 2 UNIVERSITYOF MINNESOTA...
24
10/19/2010 1 UNIVERSITY OF MINNESOTA Housekeeping notice #1 Lecture on Thursday (10/21) will be given by Professor Durfee in ME 18 UNIVERSITY OF MINNESOTA Housekeeping notice #2 Written Midterm Exam 1 week from today October 26 Closed book
Transcript of 7T Evaluating Your Design F2010.ppt - University of Minnesota10/19/2010 2 UNIVERSITYOF MINNESOTA...
10/19/2010
1
UNIVERSITY OFMINNESOTA
Housekeeping notice #1
Lecture on Thursday
(10/21)
will be given by
Professor Durfee in
ME 18
UNIVERSITY OFMINNESOTA
Housekeeping notice #2
Written Midterm Exam
1 week from today
October 26
Closed book
10/19/2010
2
UNIVERSITY OFMINNESOTA
Housekeeping notice #3
Mid-Project Reviews begin
two weeks from today
November 2
Presentation Schedule
will be available next week
UNIVERSITY OFMINNESOTA
Evaluating Your Design
ME 4054W
Fall 2010
Prof. Kuehn
7T
10/19/2010
3
UNIVERSITY OFMINNESOTA
IDENTOPP
DEFINE PROBLEM
GEN CONCEPTS
GATHER INFO
IMPLEMENTSCREEN
CONCEPTSHANDOFF
Evaluation in the Design Process
Return to theProduct Design Specification
As part of implementation, you will be doing formative evaluation on your design.
Formative evaluation provides guidance to help improve the design.
Summative evaluation provides summary information after completion.
Formativeevaluation
UNIVERSITY OFMINNESOTA
Formative, adj.
Giving or able to give form;
helping to shape, develop,
or mold
Webster’s New World Dictionary
10/19/2010
4
UNIVERSITY OFMINNESOTA
IDENTOPP
DEFINE PROBLEM
GEN CONCEPTS
GATHER INFO
IMPLEMENTSCREEN
CONCEPTSHANDOFF
Evaluation in the Design Process
Return to theProduct Design Specification
As part of implementation, you will be doing formative evaluation on your design.
Formative evaluation provides guidance to help improve the design.
Summative evaluation provides summary information after completion.
Formativeevaluation
UNIVERSITY OFMINNESOTA
Role of the PDS
Metric
#
Need
#'s Metric Importance Units
Marginal
Value
Ideal
Value
Product Specifications Rev xxx
Review each metric and
devise an evaluation technique
Consider each metric; how will youdetermine that it has been satisfied?
10/19/2010
5
UNIVERSITY OFMINNESOTA
Adding Evaluation
Metric
#
Need
#'s Metric Importance Units
Marginal
Value
Ideal
Value Evaluation
Product Specifications Rev xxx
If you satisfy the PDS,you will fulfill the customer needs
UNIVERSITY OFMINNESOTA
Evaluation Methods
Evaluation methods could include:
10/19/2010
6
UNIVERSITY OFMINNESOTA
Evaluation Methods
Evaluation methods could include:
• Review of drawings (dimensions, materials, tolerances) and/or evaluation of computer simulations (motion, forces, temperatures).
UNIVERSITY OFMINNESOTA
Evaluation Methods
Evaluation methods could include:
• Review of drawings (dimensions, materials, tolerances) and/or evaluation of computer simulations (motion, forces, temperatures).
• Tests of physical prototype to determine function compared to design specifications
10/19/2010
7
UNIVERSITY OFMINNESOTA
Evaluation Methods (1)
If you have a functioning prototype, evaluation methods could include:
UNIVERSITY OFMINNESOTA
Evaluation Methods (1)
If you have a functioning prototype, evaluation methods could include:
Physical Inspection (weight, size, texture, etc.)
10/19/2010
8
UNIVERSITY OFMINNESOTA
Evaluation Methods (1)
If you have a functioning prototype, evaluation methods could include:
Physical Inspection (weight, size, texture, etc.)Operational Tests (compare measured output to expectations)
UNIVERSITY OFMINNESOTA
Evaluation Methods (1)
If you have a functioning prototype, evaluation methods could include:
Physical Inspection (weight, size, texture, etc.)Operational Tests (compare measured output to expectations) • Describe how you tested your design or prototype to verify how well it worked.• Compare the specifications of your final prototype against your design goals. • Include reactions from your client, if you had sufficient time to do a pilot test with its intended client.
10/19/2010
9
UNIVERSITY OFMINNESOTA
Example:
UNIVERSITY OFMINNESOTA
Sample PDS
10/19/2010
10
UNIVERSITY OFMINNESOTA
Test using a scaled prototype
1. Designed and fabricated a scaled insert
2. Shot 30 rounds3. Evaluated insert surface,
compared with conventional profile
Evaluation through scaled prototype testingMaterial and profile must be selected for function and durability (high temp and pressure)
Verified profile dimensions
UNIVERSITY OFMINNESOTA
Measured Metrics on PDS
10/19/2010
11
UNIVERSITY OFMINNESOTA
Compare measured metrics with
desired values on PDS
Final value
1/20
2700
320
PassPass
Pass
720
UNIVERSITY OFMINNESOTA
Evaluation Methods (2)
• Final drawings that have required dimensions, tolerances, materials, part numbers, fasteners, etc.
If you have a detailed design, but not a functioning prototype, evaluation methods could include:
10/19/2010
12
UNIVERSITY OFMINNESOTA
Evaluation Methods (2)
• Final drawings that have required dimensions, tolerances, materials, part numbers, fasteners, etc.
• Results of computer simulations and/or analysis
If you have a detailed design, but not a functioning prototype, evaluation methods could include:
UNIVERSITY OFMINNESOTA
When Physical Prototypes are not
Possible
10/19/2010
13
UNIVERSITY OFMINNESOTA
When Physical Prototypes are not
Possible
• Too large (dam on river, sports stadium)
UNIVERSITY OFMINNESOTA
When Physical Prototypes are not
Possible
• Too large (dam on river, sports stadium)
• Too expensive (commercial airliner, nuclear reactor).
10/19/2010
14
UNIVERSITY OFMINNESOTA
When Physical Prototypes are not
Possible
• Too large (dam on river, sports stadium)
• Too expensive (commercial airliner, nuclear reactor).
• Too complex (semiconductor manufacturing line)
UNIVERSITY OFMINNESOTA
When Physical Prototypes are not
Possible
• Too large (dam on river, sports stadium)
• Too expensive (commercial airliner, nuclear reactor).
• Too complex (semiconductor manufacturing line).
• Timeline is too long (corrosion protection, nuclear waste disposal).
10/19/2010
15
UNIVERSITY OFMINNESOTA
When Physical Prototypes are not
Possible
• Too large (dam on river, sports stadium)
• Too expensive (commercial airliner, nuclear reactor).
• Too complex (semiconductor manufacturing line)
• Timeline is too long (corrosion protection, nuclear waste disposal).
• Inaccessible (Mars surface thermal behavior).
UNIVERSITY OFMINNESOTA
The Important Role of Simulation
"The problem we have with the nuclear stockpile is similar to one you might have at home with a car you've kept in the garage for 20 to 30 years," said Mark Seager, assistant department head for advanced technology at Lawrence Livermore National Laboratory. "How do you carefully maintain the car as it ages so that when you go to start the car, you can be very confident it will start? That the probability that it won't start is less than one in a million? That's a pretty high level of certitude."
10/19/2010
16
UNIVERSITY OFMINNESOTA
The Important Role of Simulation
A massive computer will be used in the U.S. Department of Energy's Lawrence Livermore National Laboratory in California to assist America's military arsenal (nuclear simulation tests) although other civilian uses have been envisaged. IBM says that Sequoia delivers the processing power of 2 million laptops and offers more processing power (20 petaflops) than all of the Top 500 supercomputers running today combined. Scheduled to be completed in 2011.
UNIVERSITY OFMINNESOTA
Example: Simulation of a manufacturing
line
10/19/2010
17
UNIVERSITY OFMINNESOTA
Abbreviated PDS
UNIVERSITY OFMINNESOTA
The entire system:
A very complex device…
10/19/2010
18
UNIVERSITY OFMINNESOTA
subdivided into smaller parts
… divided intomanageable pieces.
UNIVERSITY OFMINNESOTA
Simulation of one station
10/19/2010
19
UNIVERSITY OFMINNESOTA
Evaluation Methods (3)
• PDS includes requirements for test apparatus and test procedure
• Repeatability and Reproducibility (R&R) is a concern
• Develop/identify test method outcomes (benchmark could be an existing standard)
• Build apparatus and test samples
• Success = test results repeatable (statistics required!)
If you are developing a test apparatus and test method.
UNIVERSITY OFMINNESOTA
Definitions:
• Repeatability
A quantitative expression of the random error associated in the long run with a single operator in a given laboratory obtaining successive results with the same apparatus on identical test samples
10/19/2010
20
UNIVERSITY OFMINNESOTA
Definitions:
• Repeatability
A quantitative expression of the random error associated in the long run with a single operator in a given laboratory obtaining successive results with the same apparatus on identical test samples
• Reproducibility (Replication)
The variability of successive measurements obtained by the same operator on the same sample over a short period of time.
UNIVERSITY OFMINNESOTA
Developing a Test Standard
“Our goal is to develop a processfor testing paint adhesion whichcan be related to the current ASTMStandard D3359-02. In this test,the sample size and method is notwell define, but it is an industrywhich must be correlated back to.The process we develop must be arepeatable, reliable test that willbring this outdated test into a formthat has Gage R&R of 30%. Thedeliverable will be a testing methodand device which allow thecompletion of this goal under ourbudget of $1000.”
10/19/2010
21
UNIVERSITY OFMINNESOTA
Build Test Apparatus and Evaluate
UNIVERSITY OFMINNESOTA
Build Test Apparatus and Evaluate
10/19/2010
22
UNIVERSITY OFMINNESOTA
Return to the PDS
UNIVERSITY OFMINNESOTA
Developing a Test Standard
10/19/2010
23
UNIVERSITY OFMINNESOTA
PDS for a Test Apparatus and Procedure
R&R=
UNIVERSITY OFMINNESOTA
Additional methods for Evaluating Designs
• Sensitivity Analysis: How sensitive is your design if a key
parameter is not closely specified?
• Design of Experiments: Finding an optimum set of
processing conditions (see book by George Box, Design
and Analysis of Experiments)
• Statistical Process Control: In a manufacturing process
what is the range of variability that can be expected?
(Design & Manufacturing I (ME 3221) text has overview)
• Measurement Uncertainty (Basic Mechanical
Measurements Laboratory (ME 4031W))
10/19/2010
24
UNIVERSITY OFMINNESOTA
IDENTOPP
DEFINE PROBLEM
GEN CONCEPTS
GATHER INFO
IMPLEMENTSCREEN
CONCEPTSHANDOFF
Evaluation in the Design Process
Return to theProduct Design Specification.
If you satisfy the PDS,you will meet the customer’s needs.
Formativeevaluation
