Autonomous Systems Program

Austrade - Autonomous SystemsElliot Duff – Research Director

CSIRO - Snapshot

62% of our people hold university

degrees

2000 doctorates

500 masters

CSIRO undertakes $~500Mof externally funded R&D each year

Top 1% of global research institutions in 14 of 22

research fields

Top 0.1% in 4 research fields

Highest number of citations per scientist in

Australia

Darwin

Alice Springs

Bakers Hill

Atherton

Townsville

2 sites

Rockhampton

Toowoomba

Gatton

Myall

ValeNarrabri

Mopra

Parkes

Griffith

Belmont

Geelong

HobartSandy Bay

WerribeeWodonga

Newcastle

Armidale

2 sites

Perth3 sites

Adelaide2 sites

Brisbane6 sites

Sydney 5 sites

Canberra 7 sites

People = 5000+

Locations = 57

Budget = $1B+Murchison

Cairns

Melbourne 6 sites

Infra = $3.5bn

Patents = 3000+

Partners = 1300+

Our track record: top inventions

4. EXTENDED WEAR CONTACTS

2. POLYMER BANKNOTES

3. RELENZA FLU TREATMENT

1. FAST WLANWireless Local Area Network

5. AEROGARD 6. TOTAL WELLBEING DIET

7. RAFT POLYMERISATION

8. BARLEYMAX 9. SELF TWISTING YARN

10. SOFTLY WASHING LIQUID

China Australia Alliance for

New Energy Vehicle

Innovation

Global connections: impact partnerships

80+countries

http://www.idemitsu.com/index.html

http://www.idemitsu.com/index.html

http://www.fraunhofer.de/en.html

http://www.fraunhofer.de/en.html

http://usda.gov/

http://usda.gov/

Future

Foresights

Mega-Trends

Challenges

Opportunities

Agility

Disruptive

technology

We are in the world’s Top 10 institutions for 2 research fields.

We are the only Aussie R&D organisation in the world’s Top 10.

We have 14 research fields in the top 1% of global research organisations.

CSIRO global positioning

0

5

10

15

20

25

30

35

40

45

1 2 3 4 5 6 7 8 9 10 11 12 13

NO

. OF

INST

ITU

TIO

NS

NO. OF FIELDS IN TOP 10 GLOBALLY

CSIRO

CNRS

Cornell

Georgia Inst

Tech

INRA

NASA

Nat U

Singapore

NCI

NIAID

Princeton

U Toronto

USEPA

USGS

U Illinois

U Tokyo

USDA

Wageningen

U

Columbia

UC San

Diego

U Michigan

U Wisconsin

Yale U Penns

UCSF

Johns Hopkins

UCLA

MIT

U

Washington

Chinese Acad

Sci

UC

Berkeley

Harvar

d

Max

Planck

Standford

CSIC

U Carolina

UC Davis

Oxford

Based on total citations. Source: Thomson-Reuters/ISI Essential Science

Indicators

World-class science and technology

CSIRO - the roles we play

Trusted advisor to government

Leveraging Australia’s Innovation System

Innovation supporting the creation of new businesses

Helping existing companies transition to the future

1 2 3 4 5

What we do

8 |

Our MissionWe deliver innovative solutions for industry, society and the environment through great science.

Our VisionOur science is used to make a profound and positive impact for the future of Australia and humanity.

Image industry

Image environment

How we do it

9 |

What differentiates CSIRO?

10 |

We provide scientific

responses to major national

and global challenges

We take a collaborative approach to

scientific research and

delivery

Our research Flagships

promote radical innovation to

reshape industries

Large scale Mission directedMultidisciplinary

The Boeing example

22 year partnership

Grown from research supplier through research collaborator to strategic research partner. Longevity of partnership means senior management from both partners have previously been involved in Alliance projects.

Tiered Governance

I. Relationship Management by a joint high level Steering Committee.

II. Account Management by CSIRO Senior Technical Advisor within Boeing.

III. Project Management reps from each organisation on each project.

Award winning partnership

10 May 2011 – CSIRO awarded Boeing Supplier of the Year & Leader’s Choice Award for Academia, 2010. One of 16 awards selected from 17500 global suppliers.

12 October 2011 – Topcoat Reactivation team consisting of CSIRO and Boeing team members received a CSIRO Research Achievement Medal (innovative, commercially viable technology for aircraft coatings now on ~1000 aircraft).

Digital Productivity Flagship

Motivation

Productivity isn’t everything, but in the long run it is almost everythingPaul Krugman, 1991

Professor Princeton University,

Nobel Prize in Economics 2008

The digital economy is the global network of economic and social

activities that are enabled by platforms such as the internet, mobile

and sensor networks.

Australia's Digital Economy: Future Directions.

Threat posed by Australia’s declining productivity

Productivity is the prime determinant in the long run of a nation’s

standard of living, for it is the root cause of per capita national incomeMichael Porter, 1991, The Competitive Advantage of Nations

According to the Grattan Institute report Australia’s Productivity Challenge, Australia’s economic

prospects beyond the end of the current ‘resources boom’ will deteriorate significantly (as they did in the

1970s and 1980s) if the decline in our productivity growth performance is not reversed.

Designing for Data

Generation & Capture

Data Generation,

Communications

& Capture

Integration of

Data & ModellingImplementation

Monitoring & evaluation

Storage, Discovery,

Communications, Access

Decision Making

Under Uncertainty

Gaining Insights & Understanding

Information &

Decision Making

Value Chain

Creating Impact through Partnerships

DIGITAL PRODUCTIVITY FLAGSHIP

Autonomous Systems Program

Vision: A world in which humans and autonomous systems are able to seamlessly, reliably and safely collaborate.


45

40

15

Robot navigationDynamic, difficult environments

Remote CollaborationRobots, vision and broadband

Pervasive ComputingPlatform technology

ZebedeeMobile and handheld 3D mapping

Revolutionizes the way 3D mapping can be achieved by cutting acquisition time from hours and days to minutes

Uses a technique from robotics known as Simultaneous Localisation and Mapping (SLAM) and a simple spring mechanism

Fort Lytton

(Brisbane)

CSIRO Collaboration PlatformReal-time interaction and collaboration between people, information and instruments

Commercialised in Aug 2013 with an Australian SME – Corporate Initiatives

Installed and in use around 9 sites around Australia, including CSIRO sites, Queensland DAFF and Federal Dept of Agriculture

Sense-T ArchitectureSensor Networks and Spatial Data Management for Sense-T R&D

Provide Sensor Network Data Management infrastructure for Sense-T R&D Program

Strategic Sensor Network Architecture Development. Mobile Sensing Middleware

Metadata and InteroperabilityCognitive Computing

Facilitate discovery and reuse of sensor data through metadata management and community-based data curation

Uses Semantic Web technologies and workflow systems to annotate data and automate spatial-temporal modeling

Team ‘hero image’ here

Metadata and InteroperabilityCognitive Computing

Semantic analytics of graph data to better understand complex processes and systems

Used to analyze workflow provenance traces to discover patterns and compare similarities among various process interactions

Pervasive Computing TeamSensor Systems

Realizing pervasive computing through small, inexpensive, networked sensing devices embedded in our environments

Our capabilities span development and deployment of distributed systems, information processing, and machine learning

Real-time Sensing

Control

Comfort Sense PC Application

Advanced(HVAC((Control(

Savings,(Efficiency(

Thermal(Comfort(

HVAC(Zone(Occupancy(

Temperature, PIR, Light,

Appliances

User Behavior

Personal Climate Dome

CS Surveys

Processing

Engineering TeamRobotics Group

Designs and delivers the underpinning electrical, electronic, mechanical and computer systems

Multi-skilled engineers who can design and create almost anything!

AUTONOMOUS SYSTEMS PROGRAM

Robotics Group

From Perception to Action, From Near to Far, From Large to Small

Robots going to places and doing tasks that are dangerous, challenging, exhausting or boring for humans

Robots augmenting the capabilities and productivity of humans

Humans and robots working collaboratively and safely

Ground, Aerial and Aquatic Robots

Planning and control algorithms for mobile robots, including ground, aerial, surface and underwater.

Experience spans from low-level control to high-level planning and decision making for increased robot autonomy.

Robotics Domains

Real-tim

e Perceptio

n

Hu

man

In

teraction

Industrial

•Welding Arms

•Conveyors

Military

•Drones

•Inspection

Resources

•Mining / Agriculture / Oil & Gas

•Haulage

Infrastructure

•Transport

•Logistics / Warehousing

Service

•Medical

•Household

Outdoor (Field Robotics)

Real-time Perception of Dynamic

Unstructured Environments

Indoor (Agile Robotics)

Real-time Perception of Dynamic

Unstructured Environments

Co

nve

rgin

g tr

en

ds

lead

ing

to

Ub

iqu

ito

us

Ro

bo

tics

Field Robotics

DependabilityRobustness

Mili

tary

/min

ing

Sensing in dynamic

unstructuredenvironments

Collective intelligence

Cloud ServicesBig data

Intern

et of th

ings

Cheap sensor, processors

and actuation

Consumer Devices

Immersiveinterfaces

Gam

ing

Ad

dit

ive

Man

ufa

ctu

rin

g

Mobile Devices

Ubiquitous connectivity

Locatio

n b

ased service

Intuitive interfaces

Mobile Tele-presence

LightweightRobotics

MirrorWorlding

SocialNetworking

HMI(Human-machine

interfaces)

ICT(Information and communication technologies)

Perception

Robotics Ubiquitous Robots

Significant Developments - Software

1. ROS – open source Robot Operating Systems

2. OpenCV – Open Source Computer Vision Libary

3. PLC – Open Source Point Cloud Library

Significant Developments - Hardware

1. Range Sensors (LIDAR & Structured Light)

2. Embedded Processing and Communications

Significant Developments - Challenges

1. DARPA – Grand Challenge

2. DARPA – Robotics Challenge

Unmanned Autonomous

Robotic Definitions

Autonomy is a Spectrum

Mixed-RealityTele-Robotic

Robot

Tele-Operation

Machine

Autonomy

Shared

Autonomy

Autonomy

Manual

User

Interface

Intelligent

Behavior

Extent of

Knowledge

Communications

Latency

Global

LocalReactive

Proactive

Augmented

Reality

Augmented

Virtuality

Supervisory

Assistive

Real

Virtual

Automation Does Not Mean Autonomy

Digging

Swing

Dump

Walk

Maintenance

Integration

Autonomous

Manual

DigAssist

DigToPlan

System of Systems (SoS) A person can be part of

an Autonomous System of Systems

Potential Solutions to Autonomous Systems

Autonomous Aquatic Vehicles


Starbug - AUV

Stereo cameras

Batteries

Payload section

Main thrusters

Flat thrusters

SpecificationsMass: 26 kg+Length: 1.2 m+Endurance:

3 – 5 hours19 – 36 hours

Range4 – 7 km35 – 55 km

Max depth: 100 m

Starbug: Autonomous Underwater Surveys

Dunbabin, M., Usher K. and Corke, P. (2005). Visual motion estimation for an autonomous underwater reef monitoring robot. InThe 5th International Conference on Field & Service Robotics (FSR) 2005, Port Douglas Australia. pp.57-68.

Automated marine pest population monitoring

Smith, D., and Dunbabin, M. (2007). Automated counting of the Northern Pacific Sea Star in the Derwent using shape

recognition. In Proc. Digital Image Computing Techniques & Applications (DICTA07), pp. 500-507, Adelaide

Clement, R., Dunbabin, M., and Wyeth, G. (2005). Toward robost image detection of Crown-of- Thorns Starfish for

autonomous population monitoring. In Proc. Australiasian Conference on Robotics & Automation (ACRA), Sydney.

• Algorithms for automated classification of • Northern Pacific Sea Star (Asterias amurenis)

• Crown-of-thorns Starfish (Acanthaster planci)

Autonomous Aerial VehicleAUTONOMOUS SYSTEMS PROGRAM

Autonomous Systems Program | Not for Distribution: for Internal CSIRO/Chevron discussions only

Autonomous Flight – No human intervention

(Resilient Queensland)

2 year, AUD 7M joint project with QUT, BR&TA, Insitu Pacific and the QLD state government

CSIRO led the Biosecurity Stream– Autonomous rotorcraft surveys for Miconia weed eradication

– Replace manned helicopter flights to identify miconia growing in rainforest environments.

– Develop a TRL 6 solution

Low-Altitude Autonomous Survey Unmanned Aerial System (UAS)

Autonomous (pilotless) unmanned helicopter

Enables high spatial resolution mapping and safe low-altitude surveys in difficult terrain beyond visual range

Miconia causing

landslides in Tahiti

(Photo: Peter Thomas)

Autonomous Ground VehicleAUTONOMOUS SYSTEMS PROGRAM

Seeker Field Survey RoverScience payload includes: • Downwelling and upwelling

hyperspectral point imagers• Hyperspectral line imager• Scanning lidar• RGB imager• Environmental sensors

Autonomous Survey: Lidar 3D with RGB Overlay

Mining Automation

Dragline Swing Automation Shovel Automation Excavator Traffic Management

LHD Automation (Caterpillar) Longwall Automation (CESRE)Explosive Loading (ORICA)

Mobile MappingAUTONOMOUS SYSTEMS PROGRAM

LIDAR - Primary Sensor for Field Robotics

Dragline Terrain Mapping Haul Truck Scanning Explosive Loading

Excavator Bucket Tracking Truck and Shovel Mapping Airborne Mapping

Large Scale Mobile Mapping

Motion correction withaccurate & precise sensors

ManualSurvey

LIDARDTM

MobileMapping

Real-time SLAM with CPU-GPU Speeds

Real-timeDTM

RoboticPerception

Conventional Approach Our Approach

Mapping of Roads

Mapping of Industrial Compound

2D/3D Simultaneous Localisation and Mapping (SLAM)

Spinning LiDAR on moving vehicle

After Scan Matching

After Place Recognition

Together:Globally Consistent Trajectory and Map

Localization Mapping

Moving Object Tracking

ChangeDetection

Data AssociationRobust Optimization

LIDAR: Primary Sensor for Robotics

High-end hardware

Heavy, expensive

Non-intuitive

Days/week of processing time

Mobile, handheld

Affordable hardware

Intuitive

Realtime software processing

Reducing Barrier to Entry: Mobile Mapping

Traditional solutions: CSIRO solution:

Zebedee Lidar SLAM Mapping

World Forum - Hague

Jenolan CavesZebedee created map

World’s oldest recorded cave system (340 million years old)

Jenolan CavesOrient Cave

Structure Mapping: Questacon - Canberra

Opéra Théâtre de Clermont-Ferrand, France

Pisa - Piazza del Duomo Bottom to top and around the bell tower in 20 mins

Leaning Tower of Pisa & Virtual Reality

Colourized range

Photogrammetry

10mm

10m

Infrared

Semantic Annotation

Extending 3D Maps

3D + RGB Peel Island

Flying Zebedee: bentwing

Historical Site: Peel Island Lazaret

From 3D Data to Photos and VideoAll data is cross-linked during capture

You click on a 3D point in the point cloud and you are presented with a list

of video frames that show that point.

From Photos and Video to 3D DataAll data is cross-linked during capture

You click on point in a photo and you are presented with that location in 3D in

the point cloud.

Semantic Annotation

Comparing Data Collected at Different TimesAutomatic change detection

The system automatically highlights areas in the

point cloud where changes are detected.

HeatwaveAUTONOMOUS SYSTEMS PROGRAM

HeatWave: Hand-held 3D Thermography Device

Multimodal Representation: 3D+RGB+thermal

3D Thermal Model3D Colour Model

3D Change Detection After and Before operations

Thermal Discrepancy 3D model (before/after)

Thermal discrepancy 3D model (before/after)


Tele-Maintenance

How – Capabilities in Field Robotics

Dragline Shovel LHD HMC

Rock Breaker Explosive Loading Cleanup Agriculture

Helicopter Submarine Ground Boat

Haulage

Manipulation

Navigation

How – Capabilities in Remote Collaboration

Gesture Tracking Vehicle Tracking People Tracking Face Tracking

Security and Trust High Bandwidth Comms Quality of Service Haptics

Augmented Reality Augmented Virtuality Panoramic Display Collaborative Environments

Situational Awareness

Communications

Human Machine Interface

Assembly and Remote Assistance

Assisted Human Worker

Autonomous Navigation

Lightweight Robot Assistant

Remote Instruction + Augmented Reality

Remote Expert

Remote Maintenance

Remote Expert

Virtual Collaboration Space

Local Resource

ReMoTe is hands-free, wearable, and is operational in various environmental conditions and designed so operators can operate it without any training or prior skill.

Guardian Mentor Remote

http://www.youtube.com/watch?v=iv4-AGp_Okw

http://www.csiro.au/Organisation-Structure/Divisions/Computational-Informatics/ReMoTe.aspx

Robust, Secure, Dependable SystemsR.G. Dromey 30

R1BUTTON[Pushed]

R1 POWER-TUBE[Energized]

R1 USER??Button-Push??

1 OVEN[Cooking]

1OVEN[Idle]

R2BUTTON[Pushed]

R2

+USER

??Button-Push??

R1OVEN

[Cooking]

R2

+OVEN ^

[Cooking]

R2OVEN

[Extra-Minute]

R5

+USER

??Door-Opened??

R5

@DOOR[Open]

R5OVEN

[Cooking-Stopped]

R5

+POWER-TUBE

[Off]

R6

+USER

??Door-Closed??

R6 DOOR[Closed]

R6 LIGHT[Off]

R6

+OVEN[Idle]

R7LIGHT

[Off] R7POWER-TUBE

[Off]

R7BEEPER[Sounded]

R7 OVEN?? Timed-Out ??

R7OVEN

[Cooking-Finished

R8

-USER

??Door-Opened??

R8

-DOOR[Open]

R8

-BUTTON[Disabled]

R8

-OVEN ^[Open]

R3

C+BUTTON[Enabled ]

R3

CBUTTON

[Disabled ]

R4

CLIGHT[ On ]

R8

-LIGHT[ On ]

R6

+

OVEN

[ Open ]

Fig. 14. Microwave Oven DBT with oven component behaviour highlighted

Specification, analysis, simulation and testing for assuring system dependability

BATMONAUTONOMOUS SYSTEMS PROGRAM

Distributed Sensing Systems Building Sustainable Systems of Distributed Sensors

Pervasive sensing for effective management of natural and built environments

A decade of leading sensor network research

Continental-Scale Tracking: Flying Foxes

Autonomous Systems Program | Not for Distribution: for Internal CSIRO/Chevron discussions only

Roos ngCamp

ForagingArea1km

• Flying Foxes are vectors for the Hendra virus

• We developed collars (< 30g) to track flying

foxes



Guardian

Problem 1: The Mixed Traffic Problem

• 20 years ago automation was driven by safety

• Lead to the automation of specialized vehicles

• Equal performance of a human driver

• Forced to isolate the machines

• This impacted the existing workflow (Maintenance, exploration)

Increase Safety Change in Workflow Loss in Productivity

Solution 1: Global Situational Awareness

1. Technology that allows humans and robots to interact safety and productively

2. To do this we need to provide fail-safe people detection

3. No such technology exists

4. Put intelligence into the environment rather than the machine

5. Detect absence rather than presence

6. Autonomous safety.

Problem 2: Interoperability

• 10 years ago, investment was driven by labor force availability and productivity

• We were able to automate a rock-breaker, but it does not exceed the performance of the human operator

• Productivity gains can only be realized if we integrate the upstream and downstream processes

Fleet Management Rock Breaker Processing

Unified User Interface

3DCMM

Communications Infrastructure

Digital Model

Exp

lora

tio

n

Min

e P

lan

nin

g

Dri

llin

g

Exca

vati

on

Bla

stin

g

Hau

lage

Ro

ck B

reak

ing

Pro

cess

ing

Trai

n

Ship

Lo

adin

g

Process

Surveying Analysis Infrastructure Maintenance LogisticsSupport

Framework of Standards

Remote

Operations

Solution 2: Digital Model

Vendors

Guardian

Guardian

Situational Awareness

Global

Interoperability

People being part of solution

Industry 4.0Industrial

Internet

IoT

Guardian Video

Guardian Angel

• Monitors environment

• Tracks people and assets

• Make work safer for humans

Guardian Mentor

• Worker augmentation

• Provides skills and training

• Make work easier for human

Guardian Helper

• Provides physical assistance

• Robotic co-workers

• Works with humans

Guardian Worker

• Provides remote assistance

• Tele-operated robotics

• Work for humans

Guardian Implementation

Augmentation

• Collaboration

• Interface

• Observatory

Assistive

• Navigation

• Manipulation

• Cooperation

Awareness

• Monitoring

• Modeling

• Management

Social Science

Human Factors

Informatics

Communications

Sensors

Robotics

Engineering

Investment Innovation Impact

Worker Centric:

Increase productivity, safety and adaptability

of future workforce through virtual and

assistive automation technologies

High Performance Workplace

• Low-cost, from purchasing price and installation costs, to

reprogramming and maintenance costs

• Easy to use, without the need of technical expertise to deploy,

operate and reconfigure the systems

• Support mass customisation, ideal for small runs of multiple

types of products

A system that provide increased safety to the human workers without intervention.

The system automatically monitors, where people are and what they are doing.

From this it is able to estimate risk and alert people and machines.

Layers of safety to provide increased reliability

LAMS: Guardian AngelGuardian Angel

•Monitors environment

•Tracks people and assets

•Make work safer for humans

Monitoring

• Localization (WASP,SLAM)

• Tracking (People Tracking HMC)

• Mapping (SLAM)

Modeling

• Body/Facial Gestures

• Scenario Simulation

• Risk Assessment (Nexus)

Management

• Data Standards (OGC)

• Communications

• Fail-safety

• Increase product quality, by facilitating design tasks and increasing ability to identify errors at early stages of manufacturing processe

• Increase labour productivity, by augmenting human worker’s capabilities, regardless of their age or physical conditions

• Maintaining a high-skilled workforce, by improving training capacity and maximising the amount of data on their hands

LAMS: Guardian Mentor

Lightweight Assistive Manufacturing Solutions | NMW 2013

Guardian Mentor

•Worker augmentation

•Provides skills and training

•Make work easier for human

Collaboration

• High speed communications

• Tracking (People Tracking HMC)

• Mapping (SLAM)

Interface

• Augmented Reality (Remote)

• Augmented Virtuality

• Projected Reality

Observatory

• Repository (OGC)

• Increase productivity, by combining human’s flexibility and reasoning with machine’s strength and precision

• Increase flexibility and responsiveness, making manufacturers more responsive against changes in demand

• Provide smart and safe automation, enjoying the benefits of automation without making any changes in processes or infrastructure

LAMS: Guardian Helper


Guardian Helper

•Provides physical assistance

•Robotic co-workers

•Works with humans

Navigation

• Global (Museum)

Manipulation

Cooperation

• Increase worker’s safety, by placing them under safe conditions while performing on dangerous and challenging environments

• Expand workforce’s field of action, enabling humans to execute tasks in remote places without the need of physical presence

• Facilitate micro-fabrication, by extending human capacity to work in small-scale environments

LAMS: Guardian Worker


Guardian Worker

•Provides remote assistance

•Tele-operated robotics

•Work for humans

Navigation

• Reactive (MineGem)

• Absolute (HMC)

Manipulation

• Hydraulic Arm (rock-breaker/ORICA)

Autonomy

• Helicopter

• Submarine

Autonomous Safety Zones

1. Create 3D Model

2. Monitor environment

3. Track people and robots

4. Measure risk

5. Detects hazards

6. Alerts participant

7. Creates Safety Zone

8. Alerts bystanders

9. Monitors task

10. Alerts help if required.

Person starts to change tyre! Vehicle wants to move

Bystander walks into factory

Guardian Angel

•Monitors environment

•Tracks people and assets

•Make work safer for humans

MANUFACTURING

Changing Robotic Paradigms

Automation

In Manufacturing

Rigid

Bulky

Expensive

Unsafe

Lightweight

Assistive Systems

Flexible

Lightweight

Affordable

Human-centered

Easy-to-use

Lightweight Assistive Systems

Multi-Sensorial Augmented Reality

Human/Robot Collaboration

Augmented Human Worker

Robot/Robot Collaboration

Worker Safety: Always Aware

Tele-supervision

• New Workflows

• New Business Models

• New Enterprises

• Cost Avoidance Strategies

• New Processes

• New Materials

• New Production

• Cost Reduction Strategies

• Mass Customization

• Maximize Flexibility

• Focus on scope/value

• Mass Production

• Minimize Waste

• Focus on scale/ efficiency

Lean Agile

Information Driven

XXXX

Value Capture and Creation

Advanced XXXX

Value Capture

What is DPAS Imperative?

Great expectations

Virtu

ally He

re

Mo

re fro

m le

ss DPAS BDC Emerging Plan

Robots and Humans, not Robots instead of Humans

Robotic co-workersWork with humans

• Increase productivity by combining

human flexibility, dexterity and

reasoning with robotic strength and

precision

• Increase flexibility and

responsiveness, making

manufacturers more responsive to

changes in demand

• Provide smart and context-relevant

automation without major changes in

processes or infrastructure

• Increase product quality by

facilitating design tasks and increasing

the ability to identify errors at early

stages of manufacturing processes

• Increase labour productivity by

augmenting the capabilities of human

workers, regardless of their age or

physical conditions

• Maintain a high-skilled workforce by

improving remote training capacity and

maximising the worker’s access to

relevant information

• Increase worker safety by keeping

humans in safe conditions while they

supervise robotic systems operating in

dangerous and challenging

environments

• Expand the worker’s field of

action, enabling humans to execute

tasks in remote places without the

need for physical presence

• Facilitate micro-fabrication by

extending the worker’s ability to work

in small-scale environments

• Low-cost solutions, from purchasing price and installation costs, to reprogramming and maintenance costs

• Easy to use, without the need of technical expertise to deploy, operate and reconfigure the systems

•Supporting mass customisation, ideal for small runs of multiple types of products

Worker augmentation systemsMake work easier for humans

Telesupervised roboticsWork for humans

Situational Awareness and Immersive Safety

Operation in mixed traffic:

humans,

autonomous vehicles, human-

operated vehicles

Situational

awareness

Lightweight Robot Co-WorkersIncreasing the Productivity, Safety and Skills of Human Workers

Augment and help human workers, instead of replacing them by robots Increased worker retention and satisfaction

Increase worker productivity, safety, retention and satisfaction

New market opportunities for Australian technology companies

Situational awarenessRemote expert helping human worker

Robot-Enabled Remote Assistance

Robotic Co-Worker

Operations in a dynamic industrial environmentSeamless Connections / Exchange between

Workshop (Tactical) & The Control Room (Executive)

CSIRO Business ModelDigital Productivity

Engagement

FMF

MIICRC

MIX

SME

LAMS

National Innovation Networks

Australia’s Innovation System

Australia’s innovation system

CSIRO's Business Model

How we operate

• Scientific experts in relevant fields• Research centres and facilities• Equipment

We look at company & industry challenges:

CSIRO contributes:

We create solutions and inventions

• Productivity• Safety• Competitiveness

We find partners to help undertake the research:

• Government• Universities• Research institutes• Industry companies

Minerals Down Under

We work with industry companies to help them apply, and realise results


CSIRO works with clients on R&D projects across three horizons

Horizon 1

Horizon 2

Horizon 3

Improving core products and services

Application of new and disruptive technologies

Developing new and disruptive technologies and applications

Time

• Deliverable focus• Existing knowledge• Consulting & technical

services• Licensing

• New knowledge to solve known problem

• Proven application ready for product / service dev effort

• Prototype / applications focus

• New knowledge / exploration

• Options focused• New to world science or

applications

Commercial readiness

Collaborative researchTechnical consulting, licensing


Our three main business models

MISSION

DIRECTED

SCIENTIFIC

RESEARCH

TRANSLATION

(SERVICES)

ACCESS TO

NATIONAL

FACILITIES


CSIRO | Craig Roy | Page 128

Engaging with the best organisations along the path from research to adoption and impact

RESEARCH FUNDERSE.g. Government, ARC

RESEARCH COLLABORATORSE.g. Universities, CRCs, major multinational corporations, companies

DELIVERY PARTNERSE.g. Major multinational corporations, Australian companies, SMEs

END USERSE.g. Industry, Govt, Consumers

BASIC RESEARCH APPLIED RESEARCHEXPERIMENTAL DEVELOPMENT

ADOPTION

Publicly funded research projects are the foundation business model in which capability and intellectual property are developed

We take a collaborative approach to research and connect with the right capability in the innovation system

Where we are not best placed to implement the outcomes of our research, we work with the best

existing players in the market to see it adopted

In some cases we also work directly with end users to ensure lasting impact is achieved in line with our objectives

CSIRO's Business Model128

|

Investment in research with partners

Nature of research project

Applied Research or Services

• Application of existing knowledge

Enabling Research

• New knowledge generated

• Defined application and impact

Basic Research

• New knowledge generated

• Multiple or unknown applications and impact

Basic Research

• Breakthrough areas of research

• Building strategic capabilities

Client funds Co-Investment (Client : CSIRO) CSIRO funds

Client funds 80 : 20 60 : 40 CSIRO funds


Exploitation Strategy

How is the technology going to get to market? Research the market

Understand the value chain for the industry

How much is it going to cost to get to market?

Who is going to provide the $? Strategic partners vs venture capital (or similar)

Iterate the strategy Regularly review the literature and the market dynamics

Developer manufacturer distributor sales consumer


Industry roadmaps and landscaping

Overall

industry

drivers

Value

chain

CSIRO

portfolio

Market

value

Aus (farm gate) dairy value (2009/10)= $3.4bn

Aus export value(2009/10)=$4bn

Global dairy products market = $337bn (CAGR 2008-2012 = 24%)

Aus. Dairy based product manufacturing=$10.1bn (approx)

Industry

drivers

influenci

ng R&D

by value

chain

CSIRO

Capabilit

ies &

Assets

•Environmental challenges (drought,

climate change, soil degradation)

• Evolving biological threats

•Food security

•Increasing input prices

•Global consolidation

• Land and resource shortages

•Sustainable production practises •Increasing regulatory and

customer requirements•Increased globalisation and

consolidation

•Yield, land scarcity, competition for

acres

• Carbon pricing impact

•Cost reduction

•Changing population demographics

•R&D comp AND acceleration China / India. Undermines value capture

•Increasing complexity

in farm businesses

CLISAF

CPI FNS

FFF

CMIS

CPSE/CMSE PHealth

Agriculture

Sustainability

Water shortages

Energy

Nutrients prices

Climate change

Biosecurity

Commodity price

volatility

Increasing farming

cost structures

Greenhouse gas

emissions

Increasing demand

Healthy/functional

food

Aging population

Slowing dairy

productivity

Animal welfare

Sustainable

production

Regulatory

Food safety

Product

dif ferentiation

Waste

Milk supplyLabour

Changing nature of

demand

Resource inputs Milk productionProcessing

capacity

Markets for dairy

products (local

and export)

Consumers

Increasing private

label /generic

branding

Retailers

dominance in

value chain

Supermarket

discounting

No R&D

investment/value

Environmental x

feed x genetics

modelling

Feed systems and

management

On-farm systems

Disease

diagnostics,

monitoring and

control

Genomics/

phenomics

Landscape

modelling – water

& land

Vaccine and

therapeutic

products

Systems modelling

Product processing

Tailored

formulations

Food safety

Testing

methodologies

Bioactives/

ingredients

Materials science

Plant design

Complex systems

modelling

Risk assessment

analysis

Nutrition

Sensory

Preclinical/clinical

substantiation

Gut health/f ibre

characterisation

Supply chain

modelling

Consumer

behaviour

Genetics/physiolog

y

DAIRY ROADMAP

CEREALS ROADMAPIndustry R&D

drivers

Value chain

Market value SEED: Global seed market ~ $38bn (2011)(source: Global industry analyst) Global grain seed

(wheat, rice, sorghum, corn) market =$14bn Global wheat seed market=$250mn, Australia wheat

seed market= $20mn

CROPS: Global cereal (wheat, coarse grain, rice) crops market ~ $417.3 billion (source:

Datamonitor) market value reflects consumption at producer prices Aus. Grain growing market ~ $12.5billion (source: IBISWorld)

Aus export value~$4bn

Global cereals & bakery market = $358bn

Aus. Grain-based product manufacturing=$12.3bn

Recent /

future

major

deals

Priority

Industry

Clients

Dow Agrosciences, Sygenta,

Limagrain ,Bayer

Consultants,

Grower co-

ops,

Grower co-ops AWB,Grain

Cor Co-op

BulkHandle

Lion Nathan

(Kirin)

Nestle, Wesfarmers /

/ Coles

Govt /

Consumer

Groups

Priority

funders

DAFF; GRDC, AusAid, GRDC, GRDC MLA (feed)

CSIRO

delivery

portfolios

Key science

Focus areas

Product manufacturer

Germplasm/Gene discovery

Breeder

Input/production

systems

Grower

Storage, transport,

Handler, marketer

MillersDistributor/

Retailer

Consumer (direct/

indirect)

CPISAF

FNS / PHF

FFF FFFSAF???

Genomics / PhenomicsOn Farm

Systems

Health

Function

BARLEYmax international

royalties

$9.3M

GWD in wheat GRDC / Bayer

$7.25M

Taste & Aroma –

Nestle $2.5M

NortnernWheat

Agronomy

GRDC $2M

Global Wheat Strategy Bayer - $58M

Healthy Grains - $13.5M

Coeliac 5 –GRDC

$2.5M

MAGIC -Bayer

$3.5M

BARLEYmax license to

Popina $11M

Overdue phos maint.

GRDC

$3.2M

Nitrogen & Phos

responses

GRDC $4.7M

Heat stress –GRDC $5.4M

Fertiliser / soil

decision

support GRDC

$3.5M

Northern grain

production

crop sequencing

yield GRDC $2M

West / Southern

Phosphorus

-efficient pasture

systems MLA $2.2M

Soil Organics

GRDC

$2.3MCrown Rot suppression

$3.4M

Starplus –piglet

effects

(Pork RI) $2.7M

Rust disease –2 Blades &

GRDC $7.65M

secured

prospect

Solution

IntegrationSolution

Integration

Environmental challenges (drought,

climate change, soil degradation)

Evolving biological threats

Food security

Increasing input prices

Demand for higher value end

uses for wheat by dev.

countries

Global consolidation & new

geographies (e.g.; Black Sea)Land and resource

shortages

Sustainable production practises

Increasing regulatory &

customer requirementsIncreased globalisation

GM cereals

Carbon pricing impact

Cost reduction pressures Wheat genome sequenced

R&D challenge / acceleration China / India.

Gradual shift from commodity to product

differentiation

• To support impact, science and engagement planning and coordination, detailed industry roadmaps and landscapes are beginning to be developed

Industry Engagement

IIC Testbed for Mobile Autonomy

Elliot Duff, PhDResearch Director


t +61 7 3327 4632

AUTONOMOUS SYSTEMS PROGRAM | DPAS | CSIRO

Thank you

Autonomous Systems Program

Technology

Transcript of Autonomous Systems Program