MoviMED - Vision for Networked Security and Surveillance Systems - Working Copy_r2
-
Upload
rajesh2234 -
Category
Documents
-
view
13 -
download
0
description
Transcript of MoviMED - Vision for Networked Security and Surveillance Systems - Working Copy_r2
Vision for Networked Security and
Surveillance Systems
Presented by:
Markus Tarin, President & CEO
Webcast – April 9, 2013 15540 Rockfield Boulevard., Suite C-110
Irvine, CA 92618, USA
949.699.6600 x111 Phone
www.movimed.com
High-Level Topics
• Surveillance Market Overview
• Machine Vision & Surveillance.
What’s the difference?
• Categories of Surveillance/Security Systems
• Application Areas
• Choosing the right Technology for the Job
• Example Applications
• Interactive Q&A
Surveillance Market –
How big is it? “Putting things into perspective”
Watchful Eyes
• UK started installing surveillance systems in the 1960s.
• Over 1.85 million cameras today.
• London alone has an estimated 420,000 cameras.
• Operation Virtual Shield (OVS) in
Chicago has installed over 17,000
cameras and 600 miles of fiber optic
cables.
• Former Mayor Daley has been quoted
as saying this is the “next best thing to
a police officer on every corner”.
Image Source: topleftpixel.com
Image Source: wsj.com
Watchful Eyes
• Theft and fraud at American stores alone results
in losses of approximately $45 billion per year
• In 2011, one in every 36 retail sector employees
was apprehended for theft from his or her
employer
• FAA expects that as many as 30,000
drones will be operating in U.S.
airspace by 2020.
Image Source: www.securitycameraking.com
Source: “Surveillance and Security Equipment: Technology and Global Markets”, by K. Gainer (www.finance.yahoo.com)
Image Source: strandedpassengers.blogspot.com
Watchful Eyes – Social Surveillance
• 72 hours of video are uploaded every minute
• Over 4 billion hours of video are watched each month on
YouTube
• In 2011, YouTube had more than 1 trillion views – about 140
views for each person on Earth.
Source: YouTube.com
• 300 million photos uploaded daily to Facebook Source: CNET
• 40 million photos a day uploaded to Instagram Source: Instagram.com
Market Comparison
2012 Worldwide Revenue
Security & Surveillance
Machine Vision
Estimated at approx.
$20 Billion US **
Estimated at approx.
$3.1 Billion US*
** Source: “Surveillance and Security Equipment: Technology and Global Markets”,
by K. Gainer (finance.yahoo.com)
* Source: IMS Research – John Morse (imsresearch.com)
Machine Vision vs. Surveillance “What’s the difference?”
Machine Vision & Surveillance “What’s the difference?” - Overview
Machine Vision Security & Surveillance
Controlled Environment • Unit Under Test (UUT) in fixture
• Fixed Region of Interest
• Carefully-controlled Illumination
• Fixed Focal Distance and Magnification
Uncontrolled Environment • Subject of Interest can be anywhere
(not necessarily in the normal field of view)
• Dynamic Region(s) of Interest
• Widely Varying Illumination (day/night)
• Variable Focal and Zoom Distance
Clearly-Defined Pass/Fail Criteria • UUT specifications known
• UUT faults often predictable
• Consistent with automated analysis and decision-making
Potentially Complex Situational Analysis • Risk assessment is complex, dynamic and situation-specific
• Risk patterns not always predictable
• Limited analysis and decision-making through video analytics and AI, but
human analysis is usually also required
Rigorous Calibration Requirements • Repeatable, high-quality images critical for success
• Dimensional accuracy often important (sub-pixel)
Calibration is Secondary to Other Considerations • Environmental factors and data compression limit image quality
• Dimension accuracy usually secondary to behavior patterns
Data Compression and Storage • Data compression and storage is a secondary consideration
• Images typically processed uncompressed
• Inspection results often more important than raw image data
Data Compression and Storage • Data compression and storage is a primary consideration
• Motion video rather than single-frame images
• High compression ratios and/or reduced frame rates
to reduce the storage footprint
• Video data usually archived for historical review
Machine Vision & Surveillance “What’s the difference?”
Environmental Considerations
• Most surveillance system will be ‘outdoor applications’
• Cameras must be protected from:
- large temperature swings
- Rain, Fog, Snow, Ice, Hail, Dust, Sand, Wind
- direct sun light (into lens)
• Applications in Oil & Gas may require Ex-Proof provisions
- Ex-proof by either ignition prevention or explosion containment
Categories of Surveillance Systems
Categories of Surveillance Systems
Complexity Technology Complexity, not number of cameras
Retail Store Surveillance
Typical System Topology
High-Value Asset Protection
Typical System Topology
Options: • Simple Motion Detection
• Perimeter Intrusion Alert
• Basic Video Analytics
Intelligent, Automated Surveillance
Thermal Image Sources: FLIR and zeetee.ca
• Fully automated 24/7 operation
• Software makes decisions
• Performs actions such as alarming,
turning machines and processes off, etc.
Sample Application – Critical Vessel Inspection
Tactical Surveillance
• Multi-sensor systems
• Image stabilization
• Advanced imaging sensors and optics
• Critical applications • Homeland Security
• Situational awareness
• Military
Sample Application
Image Sources: PVP (pvpaeo.com) and www.norad.mil
Application Areas Low Cost Security
• Small Retail Stores
• Small Businesses
• Residential Installations
High-Value Asset Protection
• High-End Residential/Mansions
• Large Retail Businesses
• Casinos
• Biotech/Research Facilities
• Public Safety & Law Enforcement
• Transportation Infrastructure
Conventional Applications for Security System Integrators
Application Areas (cont’d)
Intelligent, Automated Surveillance
• Critical Vessel Monitoring
• Flare Stack Monitoring for Refineries
• Electrical Substation Monitoring
• Other Industrial Applications
Tactical Surveillance
• Border Control / Homeland Security
• Port Monitoring
• Military & Defense
• Other Critical Asset Protection
Specialized Applications Reserved for Elite Integrators
Technology Considerations &
Component Selection
Technology Considerations Camera Types & Imaging Sensors
- CCD vs. CMOS
- EMCCD
- Non-Visible
Lenses
- Auto-Iris
- Motorized Zoom, Focus
Interfaces
- Analog
- HD-SDI
- Ethernet/PoE
- Fiber Optics Converters
- CoaXPress
- PTZ
Image Compression
- Compression & Image Formats
Cameras for Day/Night
Visible Imaging
Camera Types & Imaging Sensors
Today’s technology advances in CMOS fabrication almost puts the equal
sign between CCD and CMOS.
CCD CMOS
Higher Cost More affordable
Potential for blooming Simpler Electronics
High dynamic range Limited dynamic range
Better quantum efficiency,
good low light performance
Less sensitive, poorer low
light performance
Better image quality Decent image quality
“This is probably one of the most discussed topics in camera technology.”
Camera Types & Imaging Sensors
Use CMOS if:
- Camera budget is low
- Scenery is well lit
- Power Consumption is an issue
Use CCD if:
- Superior Image Quality is important
- Camera needs to cover a wider dynamic range
- Low noise images in low light conditions are desirable
Guidelines for selecting CMOS and CCD
Camera Types & Imaging Sensors
Electron multiplying CCD Cameras
• Specialty Cameras for extreme low-light conditions
• Primarily night vision without artificial illumination
• Uses residual light from moon, stars, glow of city lights, northern glow
• Multiplies Electro-photons by means of avalanche effect. 1e- x1000
• Allows color night vision!
• Very Expensive $5k+ entry price per camera
• (Also used for scientific imaging, fluoroscopy, X-ray, astronomy)
Camera Types & Imaging Sensors
NIR – Near Infrared Imaging
“Infrared Camera” is a misnomer often used in surveillance discussions
• CMOS and CCD sensors are all sensitive up to about
1um (1000 nm)
• Using (N)IR LEDs as illuminations allows night vision
• However, technically this is not “Infrared Imaging”, since it
is only near the IR region of the spectrum. (Near IR/NIR)
• Remember to remove the NIR filter from your camera!
NIR LEDs ~850nm
Lens Selection
Lens Attribute Pros Cons When to choose?
Fixed or manually-adjusted Iris Lower cost Problematic when
light intensity changes
Indoor applications where lighting
remains constant, both day and night.
(i.e. a constantly lighted hallway)
Auto-controlled Iris
Compensates for
light intensity
changes
Increased cost Outdoor applications or where lighting
can change, both day and night
(i.e. exterior perimeter security)
Fixed or manually-adjusted
Focus
Lower cost
Potentially problematic
when position of subject
can change dramatically
When the focal distance of the
protected asset is known and fixed, or
at a fixed point of interest (i.e. a
doorway)
Auto-Focus
Compensates for
moving targets
Increased cost
When detail is important and the object
interest is moving and/or can be at
different distances from the camera
(i.e. license plate reading)
Choosing the Right Lens
Many lens options associated with Security & Surveillance are not typically
associated with conventional Machine Vision Applications
Lens Attribute Pros Cons When to choose?
Fixed Magnification/
Wider Angle FOV
Lower cost
Limited detail on
distant objects of
interest
When the secured area is a fixed and
relatively small size, and the distance of
subjects in limited. (i.e. an entry way, a
small room, etc.)
Auto-Zoom
Enhanced detail
regardless of the
distance of subjects
Increased cost
When the secured area is relatively large,
with a large potential variation in the
distance between subjects and the
camera. (i.e. large warehouse, perimeter
security, traffic monitoring etc.)
Motorized Pan/Tilt Dramatically increases
camera field of view
Increased cost
When the secured area is relatively large,
with a large potential variation in the
position of subjects with respect to the
camera. (i.e. large warehouse, perimeter
security, traffic monitoring etc.)
Choosing the Right Lens (cont’d)
Many lens options associated with Security & Surveillance are not typically
associated with conventional Machine Vision Applications
Non-Visible Imaging
Camera Types & Imaging Sensors Non-Visible Sensors and Cameras for Specialty Applications
SWIR MWIR LWIR
1.7µm 2.5µm 3.0µm 5.0µm 14.0µm 8.0µm
NIR
1.0µm
UV Visible
Thermal Bands
0.4µm
CMOS/CCD µBolometer
Compound Semiconductors (Photon Detectors – Higher Performance)
InGaAs InSb QWIP
Camera Types & Imaging Sensors
SWIR – Short Wave Infrared Imaging
• InGaAs Detector - Indium Gallium Arsenide, thermo-
electric/Peltier cooled
• Wavelength: 0.9um to 1.7um typical
• Still uses reflected light, photon based (not thermal)
• Allows night vision based on residual light, monochrome
• ‘Sees’ through fog and smoke
Left: Bay Bridge,
San Francisco,
CCD Camera
Right: SWIR
camera
Camera Types & Imaging Sensors
MWIR – Mid Wave Infrared Imaging
• InSb Detector - Indium Antimonide, cryogenically cooled
• Wavelength: 3.0um to 5.0um typical
• Heat/Thermal imaging, photon based (no reflected light)
• Allows night vision based thermal signature i.e. body heat
• ‘Sees’ through fog and smoke
Left: Person at
intersection
Right: Burglar
opening car
Camera Types & Imaging Sensors
LWIR – Long Wave Infrared Imaging
• MCT Detector (HgCdTd) – Mercury Cadmium Telluride,
cryogenically cooled (Photon detector) OR Micro-
Bolometer/MEMS (Thermal Radiation)
• Wavelength: 7um to 14um typical
• Heat/Thermal imaging
• Allows night vision based thermal signature i.e. body heat
• ‘Sees’ through fog and smoke
Camera Types & Imaging Sensors
Choosing the right camera
Camera Type Applicable for
NIR/CCD/CMOS
Cost: $
Standard, short range surveillance application requiring
some ability to see at night. Use NIR LED illuminators.
EMCCD
Cost: $$
Color night vision, extreme low light, no artificial illuminators
available or practical
SWIR
Cost: $$$
Applications that need superior night vision, short and long
range, need to see through fog without losing details.
MWIR
Cost: $$$$
Applications requiring detection of heat signatures,
differentiation of hot/cold i.e. body or engine heat.
LWIR
Cost: $$ or $$$$$
Commonly used in military, homeland security to detect heat
signatures. Choice of cooled and uncooled cameras.
Note: Some applications may also use a mix of the above cameras.
Camera Interfaces
Camera Interfaces - Analog
• Legacy interface used in most
standard surveillance systems in
the past, prior to availability of IP
Cameras.
• Analog Video Signal transmission
on 75 Ohm impedance coaxial
cable (RG59)
Camera Interfaces – HD-SDI
• Serial Digital Interface
• Uses also 75 Ohm coax
• 3 Gbits/sec (“3Gig interface”)
• Makes this a drop in replacement
for existing analog/coax
infrastructure
• Up to 300m (1,000ft)
Camera Interfaces – CoaXPress (CXP)
• Asymmetric Serial Digital Interface
• Uses also 75 Ohm coax
• Up link for camera control and
triggering at 20.833 Mbits/sec
• Down link for image data at
6.25Gbits/sec (Limit: 68m (220ft))
• Makes this also drop in replacement for
existing analog/coax infrastructure
• Up to 212m (1,000ft) @ 1.25Gbits/sec
• Power over CoaXPress, 13W
Camera Interfaces - Ethernet
• Most commonly used.
Inexpensive, flexible, scalable
• CAT5, CAT5e, CAT6, CAT7
• Uses standard IT
infrastructure i.e. hubs,
switches, routers
• Twisted pair cable
construction
• IP Cameras and HD IP, GigE
Camera Interfaces – PoE Ethernet
• Allows power
transmission over
Ethernet cable
• Reduces wiring
• Limited power
• 100m (330ft)
cable runs with up
to 12W power
• Shorter runs up to
51W (PoE+),
depending on
standard
Fiber Optics
• Commonly used to help
extend cable runs from
camera to control room
• Converters are available for
Ethernet, Analog and other
‘copper’ interfaces
• Helps overcome distances to
several km
• GigE converters available
Pan/Tilt/Zoom Control
• Telemetric control is required to
remotely adjust pan, tilt, zoom and
focus.
• Most common protocol is PELCO P
or D, many others are available
• Allows joystick or software based
control
• For sensor fusion applications,
there is the TASS protocol.
“Tactical Automated Security
Systems”
Image Compression in short
• There are two types of compressions
a) Frame by Frame (MJPEG)
b) Temporal (H.264)
• MPEG4 – Low quality, low bandwidth
• MJPEG & H.264 is more suitable for surveillance as it retains more
details.
• H.264 may not be suitable for traffic type applications, due to its
inherent latencies.
• Consider required processing power for compression algorithms as
well. Especially for larger scale systems
• There is a very long list of video and audio CODECs
• Some are lossless, if required.
Video Management Software
VMS: Video Management Software
• Large installations require more capabilities and storage
capacity than DVRs (Digital Video Recorders) or NVRs
(Network Video Recorders)
• Countless VMS (Video Management Software) options
available
• Proprietary products from Pelco, Bosch, Panasonic,
Honeywell and others have historically dominated the
mainstream security market
• Specialized niche markets are served by smaller players
• Proprietary products now challenged by Open VMS –
Open platform Network VMS products that support
hardware from multiple vendors.
Source: IMS Research - Video Surveillance and VCA Group
Image Source: bluevioletnetworks.com
Key VMS Application Features
• Vendor-neutral Camera Integration
• Support for IP and legacy Analog Cameras
• Recording & Archiving
• Control-Room/Video Wall capabilities
• Content-based Analytics / Video Alerts
• Physical Access Control (i.e. RFID, Retinal Scan, etc.)
• License Plate Recognition
Source: IMS Research - Video Surveillance and VCA Group
VMS Screen Shot
Image Source: securityinfowatch.com
Top 10 Leading VMS Suppliers
Source: IMS Research - Video Surveillance and VCA Group
1. On-Net Surveillance (OnSSI)
2. Genetec, Inc.
3. Milestone Systems, Inc
4. Verint Systems, Inc.
5. DVTEL
6. Aimetis Corp.
7. Avigilon
8. Cisco Systems, Inc.
9. Exacq Technologies
10.March Networks Corp
Example Applications
Virtual Border Program - DHS
• Tactical Surveillance with long range
MWIR and Visible Cameras
• Human detection at up to 8 miles
• Gyro Stabilized Pan/Zoom/Tilt. Images
virtually with no jitter when driving through
rough terrain at 50 mph.
• Texas border control equipped with 29 on-
vehicle system with dashboard computer
• Multi-sensor system integration with
ground radar using TASS protocol.
Toll Violation Video Enforcement
Video Surveillance System Tracks Toll Booth Violations
Toll = $0.50, Violation = $25.50
System Features:
• 1 to 3 cameras per lane, depending lane configuration
(high speed, attended, unattended)
• Typical camera sensitivity ~0.7 lux
• Uses digital IP cameras and analog cameras with frame grabbers
• Camera alignment adjustments driven by data from unusable
images (off: left/right/top/bottom, too bright or dark, etc.)
• Color cameras implemented to detect multi-state license plates,
• OCR, and dedicated link to DMV vehicle owner records automates
violation processing
Images Source: Google Earth
System paid for itself very quickly. In one case, the total implementation
cost was recovered in two weeks, processing a backlog of images from the
previous 6 months.
Critical Vessel Monitoring
• Networked thermal cameras
monitor chemical process in
vessel for over-temperature
condition
• 24/7 surveillance with software
based decision making
• Process interruption/shutdown
on alarm
Thermal Image of vessel
Electrical Substation Monitoring
• Thermal monitoring of overload conditions
• 24/7 surveillance with software based decision making
• Assists in load balancing and troubleshooting on overload
conditions
• Helps to prevent catastrophic failures
Unmanned Aerial Surveillance
Boeing Scan Eagle Mini UAV Scans for Seal on the Arctic Ice
The Boeing Scan Eagle flies a grid pattern over sea ice in the arctic,
surveying the remaining seal populations. 850,000 images taken over
Bering Sea.
Camera Dome
System Features:
• Camera: FLIR A615/A315 thermal imagers
• DSLR for visible imaging
• Wi-Fi and satellite down/up links
• On-board, real-time image data analysis
• GEO TIFF Image tagging
• Unmanned Aircraft - flight times up to 18 hours
Image Source: Boeing
Image Source: CIRES Seals Detected
in scanned image
15540 Rockfield Blvd., Suite C-110
Irvine, CA 92618, USA
949.699.6600 x111 Phone
www.movimed.com
Interactive Q & A session
Feel free to email your questions as well