ONCE READ – DELETE THIS SLIDE · •Project specific workflow with additional custom tasks »...

LABELMARS

Next-Generation Science Autonomy With High Quality Dataset Collection

Nick Read, Mark Woods, Iain Wallace

Monday, 03 July 2017

• A mobile autonomous scientist for terrestrial and

extra-terrestrial research

• Uses machine learning, classification and computer

vision techniques to detect scientific phenomena

ESA MASTER (2015)

LabelMars 2 03 July 2017

• Follows on from MASTER.

• Focus on Martian Rover Navcam images.

• 3 objectives

» Web based dataset annotation tool (DAT)

» Create large Martian rover annotated image dataset

» Improve upon previous MASTER project with improved

algorithms and more flight-like implementation.

• This presentation focused on dataset annotation tool

NOAH (Novelty Or Anomaly Hunter)


• 5000 selected navcam images from MER 1 Opportunity, MER

2 Spirit and MSL Curiosity datasets

Rover Datasets


Classifications


• First software development phase of NOAH project

• Web-based citizen science data collection

• Collect data about mars rover data sets

» Image segmentation

» Segment classification

Label Mars


“Citizen science is the involvement of the public in

scientific research – whether community-driven

research or global investigations.”

- Citizen Science Association

Citizen Science


“Citizen science is the involvement of the public in

scientific research – whether community-driven

research or global investigations.”

- Citizen Science Association

Citizen Science


LabelMars.net is targeting planetary

geologists as participants to use

their specialist knowledge to obtain

a large high-quality data set.

• Images are shown sequentially

» Natural narrative “where is the rover going next”

• Map gives a sense of location and immersion

• Financial imbursement for validated images

• Project statistics (high score)

• Discussion forum

User Motivation


• Open source Panoptes software

• Developed by Zooniverse team at Oxford University

• Most popular citizen science software

• Powered Galaxy Zoo, Planet Four and other space

related projects

Customised Zooniverse Software


Software Architecture


• Project specific workflow with additional custom

tasks

» Annotation category tree selection

» Checks for previous annotations for branching workflows

» Predefined start points

• Customised user interface

» Participants

» Expert users

• Automated Validation

Custom Features For Label Mars


Administrator Interface


Content Management

Workflow Editor

Customised Annotation Interface


Validation Component

Annotation Validation


At least 3 annotations

IoU Threshold Validation

Component

Annotation

Workflow

Not Validated

or

Validated

At least 3

annotation sets

Yes

No

Do they have the

same number of

polygons?

Not Validated

Yes

No

Not Validated

Are there any self

intersecting

polygons?

No

Yes

Not Validated

Do any of matching

polygons have IoU less

than the threshold? No

Yes

Not Validated

Validated

• Reusable DAT

» Annotate HiRISE imagery to mission detect landing sites.

• Large annotated data set

» 5000 annotated images

» Largest data set of its kind

» Valuable for computer vision and machine learning

Outcomes


• DAT still in development – sign up for newsletter and

updates at labelmars.net.

» Will be notified of competition start date.

• Dataset exported and reviewed.

• Implement Prototype Flight Detector using collected

data to trial ML algorithms.

Current Progress and future work


ONCE READ – DELETE THIS SLIDE · •Project specific workflow with additional custom tasks »...

Documents

Transcript of ONCE READ – DELETE THIS SLIDE · •Project specific workflow with additional custom tasks »...