AI-based Citywide Surveillance Solution GREENAGES Citywide Surveillance V2 FUJITSU Technical Computing Solution

A citywide surveillance solution with image analysis technology that uses artificial

intelligence (AI) to detect a wide range of information in surveillance camera data.

An advanced system that provides smart protection across our cities.

What is the AI-based Citywide Surveillance Solution? ‘Making the invisible, visible’ with the new AI-based surveillance system

Surveillance cameras are increasingly being installed in our cities. The principal aim of this surveillance is to protect people from accidents and crime.

But even as the need to effectively use video data grows, there are limits to our ability to visually check such large volumes of video data.

The AI-based Citywide Surveillance solution provides advanced image analysis that incorporates AI and HPC*1 technology. It uses surveillance cameras

to detect people and vehicles and collects congestion and attribute information on those people and vehicles. It then provides a clear picture of

various activities in our increasingly crowded cities.

This offers more than just enhanced security, as it is also useful in areas such as marketing enhancement and business strategy formulation.

Visualization AI (deep learning)

Detecting, sorting and identifying various types of information in

camera data

Business applications Connected services

Business applications tied to other services/ data and information

transmission

Knowledge creation Data Analytics

Awareness through real data and big data analysis (locations/ times)

Software functions Advanced AI image analysis technology that extracts various types of information from urban data

AI image analysis technology is used to extract people data and vehicle data from huge volumes of real-time and archived video data.

For example, people and/or vehicles are detected in live video feeds from CCTV (fixed) cameras installed on streets and buildings and from

dashboard cameras. Not only are items detected and counted, but attribute classes and specific individuals or vehicles can be identified,

making it suitable for all kinds of urban scenarios.

Detection/ counting Area total ( A video flame can be divided into separate areas for detection)

Line total (entry/ exit count)

Attribute sorting Clothing types (types of upper- and lower-body clothing)

Clothing color

Identification Face recognition

Detection/ counting

Area total (A video flame can be divided into separate areas for detection)

Line total (entry/ exit count)

Parking lot vacancy detection

Attribute sorting

Type (vehicle/van, bus, truck, motorbike)

Make/ Model

Vehicle color

Identification License plate recognition

Citywide Surveillance

People

Vehicles

Area-specific congestion detection

Barrier entry/ exit detection

Person classification Clothing type/ Color

Face recognition Automatic seat

position estimation

Area-specific congestion detection

Barrier entry/ exit detection

Vehicle classification Type/Make/Model/Color

License plate recognition

Detection/ counting Attribute sorting Individual/ vehicle identification

Automatic location estimation

List of AI image analysis functions

People

Vehicles

*1 High Performance Computing

Patent Pending

New

New

Upgraded

Upgraded

New

New

Upgraded

Upgraded

Customer benefits Advanced AI image analysis technology allows customers to use their valuable image assets more effectively for a range of purposes.

Why Fujitsu?

Monitoring

• Search condition settings Real-time data or archived data

• Display of search results list

• Display of images in search results

• Display of detected numbers for each area/ line Real-time data or archived data

• Graphical display of time-series trends

• CSV file downloads

Condition settings

Search results

Integrated monitoring view Data analysis view

Data trends over time

2 Highly accurate analysis that uses AI (deep

learning) and a user-friendly GUI to reduce

the surveillance workload and improve the

efficiency of surveillance operations.

3 Data can be re-purposed as useful information for developing sales strategies or business innovation

By analyzing facility usage, such as the

congestion levels, or customer attribute trends,

customers can use the system to formulate and

propose business strategies, including planning

of personalized customer services or sales

promotion activities.

1 “Making the invisible, visible”

Uses AI (deep learning) to accurately detect

previously unrecognizable information (vehicle

models, types, manufacturers and clothing

types, etc.). Existing video assets can be used

for a range of purposes, including enhanced

marketing and improved security that uses

detailed attribute information.

Reduces the surveillance workload and improves operational efficiency

Modeling at the algorithm level and high-speed parallel processing ensure high-speed AI learning and production of highly accurate analysis models. Simulation can also be used to generate large volumes of high-quality learning data. The computing workload is reduced by accelerating the applications (tuning), and this, together with high-speed parallel processing, means that the system can process the huge amounts of video data stockpiled throughout an entire city.

HPC AI technology maximizes

power

2. HPC

Many years of research into AI has resulted in the development of the human-centric AI Zinrai framework , and machine learning

and deep learning have been incorporated into Fujitsu’s solutions and services. These solutions are underpinned by the continuous

AI technology development and the outcomes of its application in a wide range of fields over 30 years, which in turn supports the

maximized use of data in the field of image analysis.

World-leading HPC technology built up by Fujitsu over many years helps the system use AI to quickly analyze huge amounts of

video data and to capture the movements of vehicles and people anywhere in an entire city in real time. We also provide HPC

cloud services that can be used in areas such as large-scale social systems.

Another strength is that we also offer numerical models for simulation and optimization as well as image analysis. For instance, we

can predict congestion by modeling the movements of people and then reproducing them on a computer. Combing this sort of

data analysis technology, we can assist in gaining new insights from various types of data collected from cities. 3. Data analysis

1. AI

Monitoring view: Graphical User Interface (GUI)

A simple and straightforward GUI is provided that is suited to the customer’s goals.

Proposed Application: Shopping center

System installation overview From data collection through to visualization, the most effective combination is used to provide a solution that is matched to customer

requirements, the network conditions and the operational circumstances of the surveillance cameras and video data management system.

Types of systems offered:

Software: Provided as licensed software (person/vehicle analysis) running on an AI analysis server

System configuration: On-premise, cloud platform or hybrid (a combination of both)

Provision method for analysis results and services: Supplied via standard software views or via a customized user-specified GUI that uses an API

Delivery area

Entry alerts for restricted areas

Illegal parking alerts (prohibited parking, overstaying)

Service provision area Identifying trends in visitor numbers to analyze sales rates and the effects of

campaigns to attract customers

Optimization of products and services based on customer attributes/

One-to-one service proposals

Improved layout by analyzing overcrowding/ congestion

Entry alerts for restricted areas

Car park area Real-time communication of car park vacancy information

Product/ service advertising based on vehicle attributes/ visitation frequency

Illegal parking alerts (prohibited parking, overstaying)

Road area Research into opening new outlets based on local information

(traffic congestion/ vehicle type attributes)

Security improvement : Detection, searching and tracking of specific people or vehicles, detection of illegal or long-term parking, detection of entry into restricted areas, etc.

Marketing enhancement : Real-time congestion analysis, real-time customer attribute analysis, analysis of congestion and customer attribute trends according to location or time, etc.

Copyright 2018 FUJITSU LIMITED 2018.2 Version: 2.0

AI learning services

*2: Can be installed to suit the network environment and video transmission rates.

GUI/ API

Analysis data

Standard software views/ Web-API

(User-specified GUI/ Integration with other systems)

Citywide Surveillance

AI analysis

Visualization Image analysis

Video data

Live/recorded

Video data management

Video management

system

Management

Makes effective use of existing assets Cloud platform *2

On-premise

Standard system overview

Video data Live

Surveillance cameras

Fixed/ PTZ cameras

Collection

AI model deployment

＋

Upgrading AI Model

Analysis model enhancement

AI model deployment in the analysis environment

AI model learning - Addition of classification class - AI model accuracy upgrading - New AI model learning

Contact

Fujitsu Limited (Japan)

Technical Computing Solutions Unit, Fujitsu Limited

E-mail: fj-tcsu-ga-contact@dl.jp.fujitsu.com

Website: www.fujitsu.com/global/solutions/business-technology/tc