Person Detection Techniques for an Internet of Things(IoT...

37
Person Detection Techniques for an Internet of Things(IoT)-Based Emergency Evacuation System Prasad Annadata, PhD Student Wisam Eltarjaman, PhD Ramki Thurimella, PhD, Professor

Transcript of Person Detection Techniques for an Internet of Things(IoT...

Page 1: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

PersonDetectionTechniquesforanInternetofThings(IoT)-BasedEmergencyEvacuationSystem

Prasad Annadata, PhD StudentWisam Eltarjaman, PhDRamkiThurimella,PhD,Professor

Page 2: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Contents

● Background● ProblemStatement● Motivation● Solution● Results● Conclusion

Page 3: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Settingthe Stage● FirekillsmoreAmericansthanallnaturaldisasterscombined.Everyyearmorethan5,000peopledieinfires,over25,000areinjuredanddirectpropertylossisestimatedatover$9billion[Federal Emergency Management Agency (FEMA)]

● OSHAstandardsexplicitlyrequiretheemployertotrainemployeesinsafetyandhealthaspectsoftheirjobs[Occupational Safety and Health Administration (OSHA), USA]

● FireProtectionSystemsMarketworth98.24BillionUSDby2022[Markets and Markets]

Page 4: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

EmergencyPreparedness

● Emergencypreparednessistheanswer

● Ethicalresponsibilityofemployers

● Compliancerequirementinmanyjurisdictions

● Itcoststimeandresources

Notallemergenciescanbeavoidedorpredicted

Page 5: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

TypicalSetup

● Initialinstallationandtraining

● Periodicmaintenanceofsafetyequipment

● Trainingofvolunteeremployeestobecomeemergencyresponsecoordinators(ERCs)

● Periodicpreparednessdrills

Page 6: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

DuringanEmergency

Simulateevacuationascloselyaspossibletoarealemergency

ERCsperformcoordination• Emergencyresponders

ü Grabattention(whistles,signs)

ü Directeveryonetoassemblypoint(AP)

ü Ensureeveryonehasleftthebuilding

ü Accountforeveryoneattheassemblypoint

Page 7: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Contents

● Background● ProblemStatement● Motivation● Solution● Results● Conclusion

Page 8: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

ProblemswithFireDrills

● ERCsandemployeeshaveamplenotice

● ERCspre-preparebyprintingattendancelists

● Reconciliationprocessistimeconsuming

● Createslackoffaithintheprocess

Page 9: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

LifeisPriorityOne

● Savinglivesisthemostimportantpriorityduringanemergency

● Accountingforeverylifeiscrucial

● Attendancesystemsareusedtogetabaseline

● ManualreconciliationdoneattheAP

Page 10: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

ProblemswithManualReconciliation

● Baselineaccuracyisdirectlydependentontheaccuracyofattendancesystems

● Attendancerequires− Registration− specific“arrivalaction”− Notsuitableforpublicareassuchasmalls− Consumesvaluableresponsetime− ParticularlyinlargeevacuationswithmultipleERCsandAPs

Page 11: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Contents

● Background● ProblemStatement● Motivation● Solution● Results● Conclusion

Page 12: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Impacts of Reconciliation Errors

FalseNegatives− Wronglycountingsomeoneas“Not-trapped”

− Mostdangeroustolives

FalsePositives− Wronglycountingalreadysafepeopleas“trapped”

− Wastesvaluableresourcesinsearching

Page 13: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

AdvantagesofProposedIoT-BasedSolution

● ImproveAccuracyofAttendance− Automatic− Supplementsexistingattendancesystem

● AutomateReconciliation− AutomaticrecognitionofpersonnelatAPs− Ad-hocnetworktopreventduplicates− Quickproductionofstill-trappedreport

● Augmentreportwithlocation

Page 14: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Contents

● Background● ProblemStatement● Motivation● Solution● Results● Conclusion

Page 15: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

What’stheIdea

● PeopleCarryMultipleDetectableDevices− Smartphonewithmultiplechannels− RFID-basedidentitycard− WearableswithBluetooth

● Eachhas“uniqueenough”ID● UseIoT-baseddevicesplacedaroundthebuildingtodetecttheseandcountthem

Page 16: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

WhyIoT?

Enoughresearch

inIoT-basedad-hoc,robust

networkscrucialduringdisasters

MobileapplicationsforERCs

Low-costcommerciallyavailablehardware

Personaldevicescanbe

consideredIoT devices

Page 17: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Setup

● IoT sensors- placedacrossthebuilding(s)− Single-boardcomputer(Raspberry-Pi)

● Everysensorhasoneormorechannelsitcandetect,e.g.RFID,WiFi,Bluetooth

● Softwareisbuiltwith− Fault-tolerance− Integrationwithattendancesystems− IntegrationwithmobileappsforERCs

Page 18: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

ExampleEarl70-yearold,securitydesk,carriesasingledumbphoneandacompanyIDcard

Betty45-yearold,adminrole,carriesasmartphoneandacompanyIDcard

Page 19: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Example

Ezra28-yearold,softwaredeveloper,carriesmultipledevices

Grace8-yearold,visitingherdad.CarriesnoIDatall

Page 20: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

DetectionofMovement

● SameIDdetectedbydifferentIoT devices

● InitiallyeachmovingIDisassumedtobeadifferentperson

● Exit/Entrancenodesdospecialprocessing–subtract/addpersoncounts

Page 21: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

MotionDetection- Camera

1.Motionisdetected

2.TrytodetecttheID

● IftheIDdetectedisknown− Noaction

Page 22: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

MotionDetection- Camera

1.Movementisdetected

2.TrytodetecttheID

● NewIDdetected− Addperson

Page 23: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

MotionDetection- Camera

1.MovementisDetected

2.TrytodetecttheID

● No ID detected− Electronically silent person

Page 24: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Co-occurringIDs

● NeedtodetectandmergeIDsbelongingtothesameperson

● Pairsofco-occurringIDsareenumerated● Iftheyco-occurmorethanthresholdnumberoftimes,thenmerge

● Brute-forceiscomputationallyintensive● Reverseindexingtechniqueusedtoimproveperformance

Page 25: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Co-Occurrence(StructuralEquivalence)

LetSi anddk denotesnapshotsanddeviceIDsrespectively.Fore.g.• S1 ={d2,d3,d7 },• S2 ={d3,d7,d8 },• S3 ={d2,d3,d7,d9 },...• S7={d1,d5,d6,d4,d2 }

S7

S3

S2

S1

d1

d2

d3

d4

d5

d7

d6

d9

d8

Page 26: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

GroupingdeviceIDsthatco-occur

• n– numberofdevices,• m– numberofsnapshots• N– totalinputsize• Checkingifeverypairofdevicesco-occursisexpensive:(nC2)m• Ifsnapshotshavenoerror,i.e.alwaysdetectanID,optimalalgorithmispossible.

Page 27: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Co-OccurrenceAlgorithmAdjacencylistofleftpartition(invertedlist):d1={S7}d2 ={S1,S3,S7}d3 ={S1,S2,S3}d4={S7}andsoon

- d1 andd4 co-occur– canbedetectedefficientlyusingatrie datastructure- d2 andd3 approximately co-occur.Harderproblem.

- Jacard Index=- |N(d2)∩ N(d3)|/|N(d2)∪N(d3)|=2/6

S7

S3

S2

S1

d1

d2

d3

d4

d5

d7

d6

d9

d8

Page 28: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

OtherTechniques

● Clean-upRoutines− Exitpersonsnotseenforawhile− Detectstaticitemsandremovethemfrompersonlist

− ExpirestaleIDs● Emergencytimeroutines− Exitnodescountexitedpersons− Reconciliationroutineskickedoff

Page 29: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Contents

● Background● ProblemStatement● Motivation● Solution● Results● Conclusion

Page 30: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

ImplementationDetails

● Partoflargercomprehensivesolution● Simulationisused● Effortismadetomakeitrealistic− RealMACIDsused− Realhashingisused− Realisticdistributionsusedfor

● AssigningnumberofIDsperperson● EntranceandExitpatternsforpersons● IoT devicelocations

Page 31: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Results

● Timeintervalssimulated:36000● Numberofpeoplesimulated:1000● Numberoflocationsinthebuilding:1000

Page 32: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Results

● Parameterstunedtoeliminatefalsenegatives− Detectedcountisneverlowerthanactual

● Mostentrancesinthemorning&exitsintheevening(twobluelines– curveinthepreviousslideisnotsymmetricaroundtheverticalcenter)

Page 33: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Limitations

● Allpeoplehavesamespeedandneedofmovement

● Motion/Cameraarenotsimulated● Electronicallysilentpersondetectionisnotpossible

● AssumedperfectdetectionofIDsbysensorswheninrange(nonoiseintroduced)

● AssemblypointIDdetectionisnotdone● Reconciliationisnotsimulated

Page 34: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Contents● Background● ProblemStatement● Motivation● Solution● Results● Conclusion

Page 35: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

Conclusion

● Presentedasetofsimpletechniquesthatenhancephysicalsecuritybysensingpersonsinbuildingsincludingtheirlocations

● Throughsimulationweshowedthatitisaviablepursuit

● Clearmathematicalmodelandalgorithmspresented(inthepaper)

● Savestime,moneyandmostimportantlylives

Page 36: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

FutureDirection● ThesetechniquesbecomepartofacomprehensiveIoT-basedevacuationsolution

● Integrationandtestingwithrealattendancesystems

● Simulationofspecialsituations(e.g.movingassetssuchasprojectors)

● Extendthesystemtopublicspacesandpublicsafety

Page 37: Person Detection Techniques for an Internet of Things(IoT ...site.ieee.org/denver-com/files/2017/02/IoTSEC_Person_Detection.pdf · Saving lives is the most important priority during

{ prasad, wisam, ramki }@cs.du.edu

Daniel Felix Ritchie School of Engineering & Computer Science

UNIVERSITY OF DENVER2155 East Wesley Avenue, Denver, CO

80208 - USA

http://crisp.cs.du.edu