Creating a Hyperconnected Cloud for Co-Creation in a Digital Society

1 Copyright 2016 FUJITSU LABORATORIES LTD.

Fujitsu Forum 2016

#FujitsuForum


Creating a Hyperconnected Cloud for Co-Creation in a Digital Society

Shigeru Sasaki CEO

FUJITSU LABORATORIES LTD.


Fujitsu Laboratories’ Mission

Driving the Fujitsu Group growth with leading-edge technologies


Fujitsu Group is expanding the businesses globally in collaboration with customers

Fujitsu Limited and Subsidiaries

Government Projects

Universities & Research Institutes

New Technologies Investment

Fujitsu Laboratories

Business

Technologies and market trends Customer and partner needs

R&D Scheme of the Fujitsu Group


Employees: Approx. 1200 in Japan, Approx. 240 in overseas Open Innovation: 84 Projects in Japan, 58 Projects in 11 Countries Employees: Approx. 1200 in Japan, Approx. 240 in over

Sunnyvale, California

Richardson, Texas

Kawasaki

Atsugi Shanghai

Suzhou

Beijing London

Madrid

Continuously generating R&D results that will amaze the world

Quickly deploy R&D results to Proof of Concept and Proof of Business on a global scale

Generating innovations, including new business models that resonate through global markets

Fujitsu Laboratories Group: Global Activity


Solutions

Web Services

Security

Environment

Servers Big Data

PCs/ Tablet PCs

Cloud

Smartphones

Artificial Intelligence

Data Centers

Software API, OSS

Validation

Sensors

Media Processing

SDN

Optical Communication

Operating System

Networks 5G

Systems

センサー

Next-gen Devices

Advanced Materials

Technology Value Chain of R&D Themes

Fujitsu’s Business Innovation

Compiler


Treasure-Trove of Leading-Edge Technologies



Creating the Hyperconnected Cloud for Co-Creation in a Digital Society

Copyright 2016 FUJITSU LABORATORIES LTD. 9


Digital Transformation

Number of connections IPv6 : 340 undecillion ⇒ World population: Approx. 7.5 billion Approx. 45 octillion NW connections

Hyperconnected World

Human Centric Innovation

Driving Digital Transformation New Industrial Revolution


Fujitsu Technology and Service Vision Launched

Human Centric Network Society

2016

2014

2013

2008

Everything on the Internet 1999 10 Copyright 2016 FUJITSU LABORATORIES LTD.


Units for Numbers

1036 undecillion

1033 decillion

1030 nonillion

1027 octillion

1024 septillion

1021 sextillion

1018 quintillion

1015 quadrillion

1012 trillion

109 billion

106 million

103 thousand



Number of connections IPv6 : 340 undecillion (340×1036) ⇒ World population: Approx. 7.5 billion Approx. 45 octillion (45×1027) NW connections


New Industrial Revolution


Fujitsu Technology and Service Vision Launched

Human Centric Network Society

2016

2014

2013

2008

Everything on the Internet 1999 12 Copyright 2016 FUJITSU LABORATORIES LTD.


Driving Digital Transformation


Human Brain and ICT “Beyond Human Intelligence”

Source: THE SOCIAL BRAIN HYPOTHES, DUNBAR 1998


Human Brain and ICT “Beyond Human Intelligence”

Source: THE SOCIAL BRAIN HYPOTHES, DUNBAR 1998

Computing Power×Artificial Intelligence

IPv6: 45×1027 connections／person

50 billion Devices: 7~8 connections／person

Super Computer : ~Peta FLOPS Deep Learning

Quantum Computer Neuro Computer :~Tera FLOPS Next-Gen AI

Nu

mb

er o

f co

nn

ecti

on

s p

er p

erso

n

Explosive Development of Intelligence


Trends in the Improvement of Computing Performance

CPU / DRAM OS

Multi-Core/ GPGPU

3D Package Silicon Photonics

Nanocarbon Transistor Lo

w P

ower・

Hig

h P

erfo

rma

nce

2010 2020 2000 1990 Year

Limits of Moore’s Law N

ew a

pp

roa

ch

Quantum Computers

FPGA

New Types of Nonvolatile Memory

CMOS Annealing

Neuromorphic Computing

Approximate Computing

Nanowire

Social issue solution

Application of the hottest technology

Enterprise system

Dissemination of Internet


Trends in Connection Technology

100 Tbps: Input power limit with the existing optical fiber

Year

Electric multiple TDM technology

WDM technology

Optical amplification technology

Digital coherent optical

Conn

ecta

ble

data

am

ount

＆ T

rans

mis

sion

cap

acit

y

Backbone Networks

・Non-linear optical effect

2010 2020 2000 1990

・Optical amplification band width limit

・Shannon limit ・Fiber phases

Mobile

IoT, Sensor

Ethernet

Innovative Technologies

Fusion

・Increases in the number of connections ・Latency


Trends in Data Volumes and Conversion into Knowledge

2010 2020 2000 1990

RDB

Column DB

40 ZB (Z: 1021)

Year

NoSQL DWH

In-memory DB

Da

ta v

olu

me ・

Da

ta u

sed

fo

r A

I

Databases

Storage

Smart Machines Deep Learning

Machine Learning Agent Systems Optimization

Expert Systems Data Mining

Graph DB

1Tb/in2 Wall

~YB (Y: 1024)

Robotics Cloud AI

Data Circulation and Leveraging Platform (IoT, Video, Graphics)

Hard Disks

Key-Value Store

Object- Storage

Disk Array RAID

All Frash Array

Hyper-Converged Infrastructure

Unstructured Data SoE

IoT, M2M, SNS Sensor Networks, Web Applications

Structured Data SOR

Business Data, Enterprise Databases


Importance of Security Technology Accompanying the Advance of ICT

Internet E-mail

Expansion of Web

Cloud/ Virtualized

Environments Spread of

Mobile Devices

Nu

mb

er o

f Co

nn

ecti

on

s／Cy

ber

att

ack

s

2010 2020 2000 1990 Year

Computer Virus

Spread of network virus

Targeted Cyber attack

Cyber- terrorism

IoT, AI, Big Data

Blockchain

Virus epidemic due to generalization

Malware detection

Security hole counter-measures Anti-

virus

•Personal authentication •Data confidentiality

New ICT security issues


Varied security

solutions

Borderless IoT Security

19 Copyright 2016 FUJITSU LABORATORIES LTD. Copyright 2016 FUJITSU LABORATORIES LTD.


19


Human Centric

Innovation

Mobile

Cloud

Integrated Computing

Security

Analytics

Manufacturing

SDCI

IoT

AI

FT&SV: Digital Transformation and Business


The Key Point of Digital Business Transformation

Company A Company B

Applications

Fujitsu

Co-creation Cross-industrial sector / Different field cooperation

Data

Data

Applications

Services Public Data Open Data

Applications

Public Domain Technologies

Knowledge

“Digital Business Platform” New Services, New Businesses, New Ecosystems


The Key Point of Digital Business Transformation

Company A Company B

Applications

Fujitsu

Co-creation Cross-industrial sector / Different field cooperation

Data

Data

Applications

Services Public Data Open Data

Applications

Public Domain Technologies

Knowledge

“Digital Business Platform” New Services, New Businesses, New Ecosystems “Hyperconnected Cloud”


R&D Vision and Strategy: Hyperconnected Cloud


R&D Vision and Strategy: Hyperconnected Cloud

Service-Oriented Connection

Web-Scale ICT

Infrastructure

AI

Security


Web-Scale ICT

Infrastructure

AI Core/Front

Network Fusion Core/Front

Network Fusion Security

25 Copyright 2016 FUJITSU LABORATORIES LTD. Copyright 2016 FUJITSU LABORATORIES LTD.

R&D for Realizing Hyperconnected Cloud ・5 R&D Domains ・Applied Innovation Research ・Leading-Edge Basic Research

25


Integrate the real world Front-end “IoT” and Clouds, to develop a platform of services for co-creation that easily and quickly connects all of these networks

Digitization of real world Services for Co-creation

Existing systems

Cloud native development

IoT Integration Knowledge Integration

Parts

Parts

Third Party

OSS

People

Mobile Devices

Vehicles

API

Big Data

Service control

Objectization API

API

API

Application / Data

Virtually-Integrated Database


API API API API API

Public Hybrid On-premises Private IoT


ICT infrastructure that is continuously evolving while dynamically allocating the required functionalities and resources

Web Scale ICT Infrastructure

Cloud Management

On-premises

New-Generation Cloud Platform

Public Cloud

Multi Cloud

Next-gen Computing

Public cloud Domain-Specific Cloud

Software Defined Platform

Hyper-Scale Cloud

DC: Datacenter, DB: Data Base RDB: Relational Data Base Management System

RDBMS

SoR

SoE

Hyper-converged Infrastructure

Data systems in IoT era Next-gen IaaS/PaaS

Wide-area distributed allocation planning

Infra/Virtual PF packet diagnosis

・Integrated monitoring/ Automatic operation ・Expansion of support service applications/devices

API linkage/Operation linkage, DevOps

DC Networks

SDN / SDS / SDC

AI specific ASIC

FPGA

Neuro/Quantum Engine


Create One Network that will optimally control physical networks and will treat complex structures as simple ones

Core/Front Network Fusion

Physical Networks Networks Virtualization

“Closed” Virtual Networks

Datacenter Networks 4G

Optical 30T

Abstraction

Optical 100T

5G Edge

Computing

Services Services

Slice

Virtual Networks “Quickly Connecting from End to End”

Cloud VPN

LTE- Advanced

Optical 70T

Slice

IoT

Network to connect and integrate service parts


Develop a technology that creates new knowledge obtained from learning experience and deploy this technology to various fields in the society AI Service Customized services

Knowledge Processing Media Processing

AI Learning

Affective media processing

Inference technology/ AI agent Interactive UI

Virtual world AI

LOD platform Expert/Advisor

Machine learning automation

Deep Learning Brain Science Sequential

learning Multimodal

Judgment/ Support

Perception/ Cognition

Security

Healthcare

Fintech

Manufacture

Maintenance

ICT automation

Food/

Agriculture

Autonomous/Automatic system implementation

Anomaly Analysis

Emotion/Sensitivity and Natural language

understanding

Media data

Knowledge Database

Mobility

Social infra

Topological data

Mathematical modeling technology

Graph data

AI

Accumulate as knowledge

Food/ Agriculture

Real-time analysis Automatic analysis/decision making


Implement and deploy an intelligent and borderless security system utilizing AI connecting all of its functionalities

Cyber Security

Authentication/Approval Data and Privacy Protection

Personal Data leveraging

Blockchain

Collaborative authentication of people/things

Anonymity/ Concealed zsearch

IoT Security

Mitigate the damage and continue the business.

Address the cyber attack internally.

Analyze/solve the problem automatically.

Trust Frame Work

Cloud/Authentication PF linkage

Personal authentication PF

?

IoT device authentication

Security


Co-creation and practice of new ICT businesses and services by connecting various “Technologies and Business models” through Hyperconnected Cloud

Hyperconnected Cloud

Academic technology

Cross-industrial technology

Enterprise technology

Big data Business

model Application

Co-Creation/Ecosystem

New fields concerning the people’s daily lives/activities

Next-generation growing fields

GLOBAL MARKETING INTEGRATED SOLUTIONS MARKETING UNIT ADVANCED TECHNOLOGIES PROJECT OFFICE

New application field

New technological field

New product

New business model

Applied Innovation Research

Life innovation

Robotics

Sports

Vehicle

Next-gen healthcare

Social

innovation



Challenging the limitations of ICT

Computer Architecture Intelligent computing supporting people with autonomous learning (Domain-Specific, Quantum, Neuro, Brain-Type )

Network Architecture Challenging the limitations of optical/radio communications and enhancement of software-defined communication technology

7-Sense Computing Autonomous actions based on understanding of human affections, emotion, five senses, sixth sense (intuition), and illusion

Social Science Analysis/evaluation/verification of social phenomenon and economic change through empirical approach

Physical and Chemical New device/3D packaging/Energy creation technologies, by materials informatics and biomimetics

Leading-Edge Basic Research



Further Necessity of Computing Performance

Solving combinatorial optimization problems

Should go beyond Exa-scale supercomputers Power-grid system Disaster recovery planning Economic policy and investment

Disaster Mitigation High-speed processing

of AI and big data Healthcare and

drug development

Joint research with the University of Tokyo

Joint research with Tohoku University - International Research Institute for Disaster


Fujitsu Laboratories’ Vision for Future Computing

Creating a new computer architecture toward the intelligent computing era

General-purpose computing

Neuro computing (Inference)

Neuro computing (Learning)

Accelerator

Brain computing

Supercomputer

Quantum computer

Spec

iali

zati

on

Processing amount

Domain-specific computing

Numeric

Media

Knowledge

Intelligence

Current CMOS Limitation


Rivalling Quantum Computing Developed a new computing architecture able to quickly solve

combinatorial optimization problems using conventional semiconductors,

Demonstration F14

Conventional processor FPG A

Parallel Score

Calculation

+ Transition

Facilitation

0.1

1

10

100

1,000

10,000

2x

Tim

e to

sol

uti

on (

sec)

1000x

6x

T h i s W o r k s

12,000x

Multiple engines for larger problems

Further speed up Achieved by parallelism

Speed up by parallel score calculation and transition facilitation

The new architecture


High-Speed Retrieval from Massive Image Data

Domain-Specific Server for Image Retrieval

Using FGPA effectively, over 50 times faster than general-purpose server

Demonstration F23

Image DB 12000 images

Query image

Retrieval result Conventional

Server Media domain specific server

200 Images/sec

12,000 Images/sec

Thro

ug

hp

ut

50 times or more

Where’s that one???


Human Brain and Artificial Intelligence

5-sense (Eyesight, Hearing, Smell, Taste, Touch) Memory, Recognition, Knowledge, Experience, Illusion,

Forgetfulness, Consciousness, Unconsciousness, Common Sense,

Learning

Sensor fusion Storage, Computing,

Cause and effect understanding/explanation, Frame problem,

Machine learning Human: Number of neurons

Cerebrum 14 billion Cerebellum Approx. : 100 bil.

Sense organs: Eye, Ear, Nose, Tongue, Skin

ICT・AI

Computer up to PFLOPS

Storage up to 10 Tbit/in2

Connectable count: 340×1036


Fujitsu Laboratories’ Vision of AI

AI that is highly acceptable to society

Fintech

Manufacture

Maintenance

Food/

Agriculture Customer

center Healthcare

Workplace/

Daily life

Social infra Mobility

Logistics

Digital market

Vast knowledge scattered around the world which is

produced by human beings

Massive amounts of media data and five sense information that are collected by sensing devices in a real word

Perception/・ Recognition

Judgment/ Support

Knowledge DB creation

Learn- ing

Knowledge creation

Knowledge acquisition

Knowledge structurization

Structurization of existing knowledge: Utilize the vast knowledge produced by human beings around the world.

Acquisition of unknown knowledge: Utilize the vast knowledge accumulated by sensing devices in a real world.

Creation of Knowledge: R&D for learning and discovery science


Graph Data Used in Various Fields

Healthcare/Drug discovery Biology

Graph data

Social network Security

Communication/Mobile Supply chain Finance

Internet

Expressing the connection among people, things,

events, etc.


Integrated Healthcare with IoT Data

Technology to utilize graph data in neural network

Demonstration N6

Structure Mapping Technology

Optimize uniform expression Tensor Expression

Conventional Backpropagation Extended Backpropagation Core Tensor

Learning Technology


Integrated Healthcare with IoT Data

Knowledge fusion to assist clinical decisions

HIKARI

Within seconds

Several tens min. per patient

5 specialist clinicians (with 18 to 25 year experience)

36,000 patients’ non-clinical data

Comparison result: Accuracy of health risk check:

80 - 97％

Healthcare data processing AI analysis engine

Patient’s privacy protection Anonymization of

data/analysis result

Patient’s medical history

Non-clinical data

::

30 patients’ medical histories

Spain: San Carlos Hospital

Demonstration N6


Video-Based Intelligent Transport

Accelerating moving object detection in combination with contour motion detection from image sequence

Image sequence with object labels …

Object proposal method guided by contour motion

…

Contour motion detection

CNN*

Classifier

Image sequence

*CNN: Convolutional Neural Network

Video processing and machine learning of a traffic monitoring system using AI

Demonstration P4


Eye Tracking Technology

Inferring Human Will and Intent

Corneal reflection Pupil

Detects gaze from pupil position and corneal reflection

Gaze Tracking sensors

Gaze detection

Records what, where, and how long the person observes objects

Gaze Data/History

? Analysis of

will and intent

?


Odor Sensor

Computer can smell many kinds of gas molecules

NH3 Sensor and Prototype Device Graphene Molecule Sensor

High sensitivity detection of gas molecules (gas, odor)

Captures gas molecules using carbon atom net

Graphene

Gas molecule Cu+

Cuprous bromide film（CuBr) Cu+

Ammonia adsorbs.

Neither Acetone nor ethanol adsorb.

e-

A

How sensor works

Gas flow

CuBr Sensors

MOS Gas Sensor Mixing chamber

Inlet


Haptic sensing and Touch feeling expression technology Adding a tactile sensation to two-dimensional image and photo

Interaction with people in remote place

Feel of untouchable things

Smooth metal surface

Clicking Dial lock

Rough, bumpy

crocodile’s back

Haptic layout app Terminal to present touch feeling

Computing

Haptic filter・Processing

Auto generation

Take a picture

Presentation of Touch feeling Touch feeling

process Haptic

DB

Touch generation


Sensing and expressing the feeling

Detecting human feeling totally and visualize what a human is thinking Bank-transfer fraud

detection/preventive measure

Scammer Victim (Elderly person)

Phone scam

Keyword Detection Stability Analysis

Combined Decision Result: Detection of stress situation

-120

-100

-80

-60

-40

-20

0

0

156

313

469

625

781

938

1094

1250

1406

1563

1719

1875

2031

2188

2344

2500

2656

2813

2969

3125

3281

3438

3594

3750

3906

周波数[Hz]

レベル[dB]

Normal

Ton

e o

f vo

ice

-120

-100

-80

-60

-40

-20

0

0

156

313

469

625

781

938

1094

1250

1406

1563

1719

1875

2031

2188

2344

2500

2656

2813

2969

3125

3281

3438

3594

3750

3906

周波数[Hz]

レベル[dB]

Unstable

Ton

e o

f vo

ice

・Impressive support at call center ・Automatic sending alerting message at emergency ・Quality control of a feeling

“Come here to explain about the compensation.”

“Well, even if you say that…”

Action

Brain Wave

Pressure

Support for development of products that are easy to use






Social Science Analysis／evaluation／verification of social phenomenon and economic change through empirical approach

Physical and Chemical New device／3D packaging/Energy creation technologies, by materials informatics and biomimetics







Social Science Analysis／evaluation／verification of social phenomenon and economic change through empirical approach

Physical and Chemical New device／3D packaging/Energy creation technologies, by materials informatics and biomimetics


Social Science

Psychological analysis of human preference／desire

Big Data’s mathematical analysis platform Biodiversity evaluation Presenting a new management plan of

natural forest after forest fire

Matching of the people who want to relocate and the places for relocation, using AI that grows by itself through learning of human preferences

Optimal scheduling of disaster recovery works of a lifeline and transportation network

Example of recovery work routes (in case of 37 places, 6 teams)

Evaluation of cities／local municipalities

Finding regional characteristics by open data


Demonstrations

ID# Demonstrations Headlines Zone

F14 Rivalling Quantum Computing

Infrastructure for the digital world With Novel High-Speed CMOS Optimizer

F23 High-Speed Retrieval from Massive Image Data

Infrastructure for the digital world Domain-Specific Server for Media Processing

S4 Secure Blockchain Information Sharing

Vertical area - Financial Services Innovative Solution for Global Securities Trading

A1 Connecting People and ICT with “RoboPin” New Level of Customer Service with Friendly Robot

F24 Accelerating Deep Learning Processing

Infrastructure for the digital world World’s fastest speeds with advanced technologies

P4 Video-Based Intelligent Transport

Vertical area - Transportation Advanced video analysis with machine learning

S5 Advanced Open Data Knowledge Processing

Vertical area - Financial Services Unlocking Financial Relations with Data Mining

N6 Integrated Healthcare with IoT Data

Vertical area - Healthcare Knowledge Fusion to Assist Clinical Decisions

Creating a Hyperconnected Cloud for Co-Creation in a Digital Society

Technology

Transcript of Creating a Hyperconnected Cloud for Co-Creation in a Digital Society