Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between...

46
Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok & Dr. G. E. Smid Department of Electrical & Systems Engineering

Transcript of Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between...

Page 1: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

Education & Research With SH2at Oakland University

Academic Overview of the Collaboration Between Oakland University – Hitachi America

Prof Ka C. Cheok & Dr. G. E. SmidDepartment of Electrical & Systems Engineering

Page 2: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 2

Detroit – USA

Hitachi-AmericaSales, Marketing and Technical Center

Oakland UniversityDept. of Electrical & Systems Engineering

Page 3: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 3

Oakland University

• 16000 students• 1600 Engineering• 800 M.Sc.• 60 Ph.D. students• Locations 30 mins to Big Three car companies and

various automotive suppliers• Majority of OU graduates works in auto industry

Page 4: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 4

• Dynamic & Control• Industrial & Mobile Robots• Computer-based Systems Control• Computer Simulations• Mechatronics• Communication Electronics• VLSI• Manufacturng Systems

Electrical & SystemsEngineering Department

Page 5: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 5

SH2 in Education

• Systems Behavior/Control Principles• Microcomputers/Microcontrollers• Computer Interface• Signal Conditioning Electronics• Sensors & Actuators• Mechanical Mechanism

Mechatronics & Computer Control Systems Courses

Page 6: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 6

Mechatronics Lab

CAE Tools• Simulation

• Data acquisition

• Analysis

• Design

• Computer methods

Projects

Page 7: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 7

Hitachi Embedded Microcontroller Lab

Learning Experience• PC-based control

• uP-based control

State-of-the-Art• Methodology

• Technology

Integrated Systems• Multidisplinary

• Resources

• Team effort

• Scheduling

• Project management

EE4/572 Microcomputer Control Systems

Page 8: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 8

Hitachi Donation & Support

• 11 SH2 7055 EVBs• 15 H-8 EVBs• HEW, HDI• MakeApp• TargetLink (dSpace donation)• Funding

Page 9: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 9

EE/SYS4/575AUTOMOTIVE MECHATRONICS IAspects of Design, Analysis, Synthesis

EE/SYS675AUTOMOTIVE MECHATRONICS II

Aspects of Microcomputer & Microcontrollers

EE4/572MICROCOMPUTER-BASED

CONTROL SYSTEMSAspects of computer control

EE222ELECTRICAL CIRCUITS

Circuits analysis, op-amp filters

ME221

STATIC & DYNAMICSMechanical systems

ECE171PROGRAMMING LANGUAGE

C/C++, Matlab/Simulnk

EE326ELECTRONIC CIRCUITSTransistors, FET, amplifiers

EE378DESIGN OF DIGITAL SYSTEMS

Logic, TTL, CMOS

SYS325LUMPED PARAMETER SYSTEMSRepresentation of Signals & Systems

EE351

ELECtROMECHANICAL ENERGY CONVERSION

EE345ELECTRIC &

MAGNETIC FIELDS

EE470MICROPROCESSOR SYSTEMS

Programming & Application Examples

SYS431AUTOMATIC CONTROL SYSTEMS

Feedback Design & Analysis

SYS433MODERN CONTROL SYSTEMS

Feedback Design & Analysis

EE437COMMUNICATION

ELECTRONICS

Computer Control Mechatronics Course Option at Electrical & Systems Engineering Department at

Oakland University

Page 10: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 10

EXECUTION

EXECUTIVEKnowledge & Decision

Memory Rules Rules to change itself

Perception Signal processing Pattern recognition

Command Control principles Prediction

Increasing Precision

Increasing IntelligentDecision

Computer Control for Mechatronic Systems

Output Signal Conditioning Power electronics, Driver devices Modulation schemes

Input Signal Conditioning Analog electronics Digital electronics Signal processing

Computer Output Interface

Computer Input Interface

Sensory Systems Transducers

Actuators motors, engine gears

Mechanical process

Page 11: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 11

Unicycle Balancing Control System

Self-leveling Stabilized Platform

Stewart Platform Motion Base System

Vision-based Navigation Mobile Robot

Radar-based Object Detection and Collision Avoidance

Sonar-based Object Detection and Collision Avoidance

Laser-Camera-based Object Detection and Collision Avoidance

Virtual Reality Modeling with Vision-based Navigation Virtual Vehicle

GPS-based Navigation & Guidance for Mobile Robot

Engine Control Simulation & Experiment

Vision-based Target Locking Tracking System

Cruise Speed Control with Head-up Display (HUD)

Speech Recognition

Examples of student projects

Challenge

ThinkQuestion

Discover Learn

EntertainCreative

Page 12: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 12

ProductShipmentProduct

TestingProductTooling

6 12 18 24 mos

ProductPrototype

ConceptPrototype

A “typical ideal” plan

Quality improves …

Cost increases …

Time increases

$50k to $500k

$500k to $5 mil

ConceptStudies

University Involvement

Industry Involvement

From Concept to Mechatronic Product

Page 13: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 13

Concept Studies• Review of Methodology & Technology• Computer Simulation• Demonstrate Proof of Principles

Concept Prototype• PC-based Implementation• Embedded P Implementation• Proof of Technologies

Page 14: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 14

• Study of Behavioral Performance– transient, frequency, stability, nonlinearity, uncertainty

• PC-based Rapid Prototyping of Controller– evaluation of control scheme using high level language enhances

successful implementation of sophisticated principles & algorithm

– Ease of programming, parameter tuning, graphical visualization, etc.

Real-Time Windows Target

PC I/O Interface

Electronics &

Mechanical

Systems

PC-based Proof of Principles

Page 15: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 15

Real-Time Windows Target

• Focus less on programming/coding• Focus more on experiment, calibration & tuning • Proof of Concept/Principles

Real-Time Windows Target

PC I/O Interface NI-DAQ MI-50-AT

Stabilized Platform

Matlab/Simulink schematic diagram implements functions

Graphical visualization of results Test Equipment

Page 16: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 16

• Demonstration of Technologies – capabilities, speed, cost, size, weight, integration

• Rapid Prototyping of Embedded P Controller– Hardware & software development

– Debugging of program, parameter tuning, etc..

– Stand alone system

Embedded P

Electronics &

Mechanical

Systems

Embedded P Proof of Technologies

Page 17: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 17

MakeApp autocodes I/O Functions

TargetLink autocodes Application Functions

Embedded SH2 7055 EVB

ProjectHitachi Embedded Workshop

Downloadable CodeHitachi Development Interface

Embedded P Stabilized

Platform

SH7055 EVB

Matlab/Simulink for Visualization & Tuning

Graphical visualization of results

• Effort focus on autocoding• Scaling factors, saturation,

fixed/floating point• Fine tuning of parameters• Stand alone

Page 18: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 19

SH2 in Class Projects

Mobile RobotEngine Throttle Control

•Battery monitor/charger Engine Idle Speed Control

Page 19: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 20

SH2 in Class Projects

Mobile RobotEngine Throttle Control

•Battery monitor/charger

Engine Idle Speed Control

Page 20: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 21

• Throttle is closed => Engine is Idling

• Calculate desired Idle speed depending upon operating conditions (temperature, load etc)

• Regulate the mass air flow (and apply feedback)

Engine Idle Speed Control

Page 21: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 22

SimCar is a Matlab/Simulink model of a gasoline engine

Overview – SimCar

Page 22: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 23

• Implemented PID idle speed control on SimCar (tuned via Ziegler-Nichols & Classical Control Technique)

Open-Loop Control PID Control

Simulation

Page 23: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 24

• Implemented PID idle speed control on actual V8 engine at Hitachi-America lab (tuned via Ziegler-Nichols & manually)

Experiment

Page 24: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 25

Engine Control at Hitachi-America Lab… A Rapid-Prototyping Approach

APPLICATION SOFTWARE

Ignition Injection Idle SpeedMatlab / Simulink Model

Target Link Model

KERNEL SOFTWARE

BIOSMakeApp

Operating SystemOsek Configurator

ProjectHitachi Embedded Workshop

Downloadable CodeHitachi Development Interface

SH7055 EVB

Page 25: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 26

SH7055 EVBDownloadable CodeHitachi Development Interface

Interface Board

RackFord – V8, 4.6lt Engine

Engine Real-Time ControlHardware Setup at Hitachi America Lab

Page 26: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 27

• Accomplishments– Learn basics of engine control

– Learn modeling and simulation of engine control via SimCar

– Learn software development & experimental setup for rapid prototyping of real-time engine using SH2 micro (hardware in the loop)

• Problems Encountered– Steep learning curve (especially in the beginning)!

– SimCar doesn’t represent precisely true behavior of the engine under investigation

• Credits

– Industry experience at Hitachi America Lab

– Thanks to Dr. T. Oho, Dr. G. Sarkalis, Stephen and colleagues.

Students Experiences

Page 27: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 28

SH2 in Research

• HMMWV Collision Warning

• Ground Robotics

• Automatic Lawn Mower &

Stabilized platform

• Vehicle Dynamics Simulation

Page 28: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 29

ResearchHMMWV Collision Warning

• Objective– Design and Evaluate a Collision Warning and

Avoidance System with multiple sensors

• Approach– Develop Sensor Fusion and Kalman Filter Algorithms

in Simulink with Threat Assessment

• Implementation– Laser radar, Millimeter-wave radar, Sonar, Vision– Implement Controller in SH-7055 with Simulink– Brake actuator and Throttle relaxer

Page 29: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 30

ResearchHMMWV Collision Warning

Page 30: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 31

ResearchHMMWV Collision Warning

iXk+1 = A iXk + iWk

ixk = C iXk + iVk

iX0|-1 = [ 0 0 0 ]T, i P0|-1 = I

iKk = iPk|k-1iCT [ iC iPk|k-1

iCT + iR ]-1

iPk|k = [ I - iKkiC ] iPk|k-1

iPk+1|k = A iPk|k AT + Q

iXk|k = iXk|k-1 + iKk [ i r k - C iXk|k-1 ]

iXk+1|k = A iXk|k

iKk = iPk|k-1iCT [ iC iPk|k-1

iCT + iR ]-1

iPk|k = [ I - iKkiC ] iPk|k-1

iPk+1|k = A iPk|k AT + Q

iXk|k = iXk|k-1 + iKk [ ik - C iXk|k-1 ]

iXk+1|k = A iXk|k

i r k

ik

1xk~Nxk , 1R~NR

iWk ~ N( 0, Q )i Vk ~ N( 0, iR )

1 0A = 0 1 0 0 1

C = [ 1 0 0 ]

0iWk = 0 iWk

Driver’s intention

iXk~ iXk

iXk+1~ iXk+1

If iR=Inf then 0

If iR=Inf then 0

Page 31: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 32

dr , Vr

Come from kalman filter

v2

v1

v2v1

Tr T bTc

Vr

Dmin = Vr / T b

Dmax = V r / T bmin

Time

T bmin

CWI0 1

Safe Alert Danger

Minimum needed deceleration

Time to collision

Human reaciton time Computed remaining time to brake

Tc = dr / Vr

Tb = Tc - Tr

Dmin = Vr / T b

Dmax = V r / T bmin

CWI = Dmin / Dmax

= T bmin / T b

ResearchHMMWV Collision Warning

Page 32: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 33

ResearchHMMWV Collision Warning

Page 33: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 34

ResearchGround Robotics

• Objective– Student teams build an autonomous robotic vehicle

that can negotiate an obstacle course

• Approach– Develop a mobile robot, equipped with vision and

sonar in a real-time control environment

• Implementation– Sonar, Vision

– Implement Controller in SH8 through Simulink

– DC Motors, typically skid-steer

Page 34: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 35

ResearchGround Robotics

Intelligent Ground Vehicle Competition Winners include Hosei University, Japan

Page 35: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 36

ResearchStabilizing Platform

• Objective– Automatically Level a platform on a floating base

• Approach– Design a Closed-Loop Controller with Kalman

Filter independent for X and Y

• Implementation– Accelerometer and Rate Gyro Sensors

– Implement Controller in SH-7055 1ms cycle

Page 36: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 37

ResearchStabilizing Platform

Page 37: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 38

ResearchStabilizing Platform

Page 38: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 39

ResearchStabilizing Platform

Page 39: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 40

ResearchAutomatic Lawn Mower

Page 40: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 41

ResearchAutomatic Lawn Mower

Page 41: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 42

ResearchVehicle Dynamics Simulation

• Objective:– Develop Full Vehicle State Observer

• Approach:– Embed Full Vehicle Dynamics Model in Real-Time

Micro-Processor Environment

• Implementation:– Driver Inputs and IO through CAN

– Hitachi SH-7055

Page 42: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 43

ResearchVehicle Dynamics Simulation

Page 43: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 44

ResearchVehicle Dynamics Simulation

Page 44: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 45

Other Research Collaborations

• Ford Motor Company – Pre-Crash Sensing• DaimlerChrysler – Hybrid-Electric Vehicle • US Army TACOM – Collision Warning• ITT Automotive – Anti-Lock Brake System• Saturn Electronics – Traction Control• Chrysler – Virtual Prototyping• Ford Motor Company – Data Validation• Dana Corporation – Virtual Test Rig

Page 45: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 46

Closing• Hitachi SH-2 provides excellent solution for rapid

prototyping of controllers for mechatronics systems

• Software development tools are easy to use (Matlab/Simulink/TargetLink/MakeApp Code-Generation)

• Latest Technologies & Methodologies employed in Education and Research

• Conducive environment for academic-industry project collaboration

Page 46: Education & Research With SH2 at Oakland University Academic Overview of the Collaboration Between Oakland University – Hitachi America Prof Ka C. Cheok.

April 20, 2001 Oakland University - Hitachi America 47

Oakland University appeciates Hitachi America support and intends to

continue the fruitful collaboration