P ACKING A P UNCH WITH W ORD P RESS Kathleen Pequeño @kpequeno.
Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417...
Transcript of Piranha - ORNL0.412607 ord w 0.427525 o 0.930737 ord w 0.978947 o 0.446173 ord w 08058 0. o 0.592417...
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
US naturalized citizen indicted for hiding terrorist links
CLEVELAND, United States (AFP) - A man was indicted here in federal court for concealing his links to terrorist groups from US authorities when he applied for naturalization, the Federal Bureau of Investigation announced.
Cold war leaves a deadly anthrax legacy
By Judith Miller NEW YORK TIMES NEWS SERVICE
June 2, 1999
VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission.
6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter SlevinWashington Post Staff WritersFriday, January 16, 2004; Page A15 The State Department has decided to put a half-dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials.
US naturalized citizen indicted for hiding terrorist links
CLEVELAND, United States (AFP) - A man was indicted here in federal court for concealing his links to terrorist groups from US authorities when he applied for naturalization, the Federal Bureau of Investigation announced.
Cold war leaves a deadly anthrax legacy
By Judith Miller NEW YORK TIMES NEWS SERVICE
June 2, 1999
VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission.
6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter SlevinWashington Post Staff WritersFriday, January 16, 2004; Page A15 The State Department has decided to put a half-dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials.
Dr. Thomas E. Potok Applied Software Engineering Research Group
Oak Ridge National Laboratory
US naturalized citizen indicted for hiding terrorist links
CLEVELAND, United States (AFP) - A man was indicted here in federal court for concealing his links to terrorist groups from US authorities when he applied for naturalization, the Federal Bureau of Investigation announced.
Cold war leaves a deadly anthrax legacy
By Judith Miller NEW YORK TIMES NEWS SERVICE
June 2, 1999
VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission.
6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter SlevinWashington Post Staff WritersFriday, January 16, 2004; Page A15 The State Department has decided to put a half-dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials.
US naturalized citizen indicted for hiding terrorist links
CLEVELAND, United States (AFP) - A man was indicted here in federal court for concealing his links to terrorist groups from US authorities when he applied for naturalization, the Federal Bureau of Investigation announced.
Cold war leaves a deadly anthrax legacy
By Judith Miller NEW YORK TIMES NEWS SERVICE
June 2, 1999
VOZROZHDENIYA ISLAND, Uzbekistan -- In the spring of 1988, germ scientists 850 miles east of Moscow were ordered to undertake their most critical mission.
6 Indonesians Barred From U.S. Current and Former Military Officers Placed on Watch List By Dana Priest and Peter SlevinWashington Post Staff WritersFriday, January 16, 2004; Page A15 The State Department has decided to put a half-dozen current and former Indonesian military officers, including a leading presidential candidate, on a watch list of indicted war criminals, effectively barring them from entering the United States, according to U.S. government officials.
PiranhaKnowledge Discovery Engine
2
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
How could you not have seen this coming?Terrorist Bombing
3
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
We’ve traded a stack of paper for a stack of DVDs
Should we pull out of Iraq?What should we do about Iran?
Can we trust the Windows OS?
What if China destroys key satellites?
4
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
National scope of our work
• How can we run the battle from networked vehicles? US Army - US Army − We led a DARPA study on the suitability of intelligent
agent technology• Can software tell us in 3 to 5 minutes if we should
destroy an incoming missile? - Missile Defense Agency − We serve on an expert panel to assess battle
management software capabilities• What threats exist in the in 10,000 new
documents we received today? - Department of Homeland Defense − We led a DHS Text Analysis Workshop to set research
directions and goals for the department
5
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
Key Technologies and Resources• Intelligent Agents
− Software processes − Can communicate in
unstable environments− Form teams to solve
problems− Live, die, and reproduce to
solve problems• High Performance
Computing− Red/White Oak Clusters− 135 Dell Computers− Largest cluster computer at
ORNL (1.7 TFLOPS, 270 GB Memory, 11.3 TB Disk)
Black Board
IntelligentAgentsIntelligent
AgentsIntelligentAgents
IntelligentAgentsIntelligent
AgentsIntelligentAgents
IntelligentAgentsIntelligent
AgentsIntelligentAgents
6
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
Challenge – What to do with this?
• What is in there?• Are there any
threats?• What am I
missing?
7
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
Process
Minutes MinutesMonths
8
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
Process
Minutes Minutes
Months
Organize theInformation
Nuclear materials
Nuclear materials
Chemical Weapons
Chemical Weapons
ThreatsThreats
Potential Targets
Potential Targets
Money Laundering
Money Laundering
Connect theInformation
Piranha
Minutes DaysMonths
9
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
Breakthrough: Inverse Corpus Frequency
( ) ⎟⎠⎞
⎜⎝⎛
++
+=11log1log 22 c
CfW ijij
0
50000
100000
150000
200000
250000
5 55 105 155 205 255 305 355 405 455 505 555 605 655 705 755 805 855 905
Number of Documents (K)
Uni
que
Term
Cou
nt
Reed, Jiao, et al., “TF-ICF: A New Term Weighting Scheme for Clustering Dynamic Data Streams,” The Fifth International Conference on Machine Learning and Applications (2006) to appearReed et al., “Multi-Agent System for Distributed Cluster Analysis,” Third International Workshop on Software Engineering for Large-Scale Multi-Agent Systems (SELMAS'04), May 24-25, 2004, Edinburgh, Scotland
• Look at the forest, not the trees
We analyzed near 1 million documents from 6 major research corpora
We found 229,023 unique terms (A large dictionary contains around 70,000 terms)
We use this term frequency distribution as our “global” term frequency
10
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
TF-ICF Performance Evaluation
Name Term Weighting Scheme
TF-IDF
MI
ATC
Okapi
LTU
)/log()log( jijij nNfw ×=
N
f
N
f
Nf
wi M
jij
N
iij
ij
j
∑∑== ×
=
11
log
∑= ⎥
⎥⎦
⎤
⎢⎢⎣
⎡⎟⎠
⎞⎜⎝
⎛⎟⎟⎠
⎞⎜⎜⎝
⎛×+
⎟⎠
⎞⎜⎝
⎛⎟⎟⎠
⎞⎜⎜⎝
⎛×+
=N
i j
ij
j
ij
ij
nN
fmax_f
nN
fmax_f
w
1
2
log5.05.0
log5.05.0
⎟⎟⎠
⎞⎜⎜⎝
⎛++−
⎟⎟⎟⎟
⎠
⎞
⎜⎜⎜⎜
⎝
⎛
+×+=
5.05.0log
_5.15.0 ij
j
ij
ijij
fnN
fdlavg
dlfw
dlavgdl
nNf
wi jij
j
_2.08.0
log)0.1)(log(
×+
⎟⎠
⎞⎜⎝
⎛+
=
SMART 3891 3 1460 1033
20 News 4650 12 399 385
Term Weighting SchemesData Set # of
Docs# of
ClassesLargest
ClassSmallest
Class
Reuters 2349 58 1041 1
Test Data Sets
Basic K-Means
Single Link (HAC)
Complete Link (HAC)
UPGMA (HAC)
Test Algorithms
11
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
TF-ICF Performance Evaluation
Hierarchical Agglomerative Clustering Algorithm
0.0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
Euclidean Distance Cosine Similarity
Ave
rage
F-M
easu
re
TFICF TFIDF MI ATC Okapi LTU
Reed, Jiao, et al., “TF-ICF: A New Term Weighting Scheme for Clustering Dynamic Data Streams,” International Conference on Machine Learning and Applications, Orlando, FL, Dec. 14-16, 2006.
12
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
How Piranha Works
• Standard Approach11.5 Days
• Agent approach8 minutes 24 Seconds!2000 times fasterWith no loss of accuracy
2 Patents, 2 licenses
2 Invention disclosures in process
Head Node
Computer 4
Computer 5
Computer 6
Computer 7
Computer 8
Computer 9
Computer 10
Computer 11
Computer 1
Computer 2
Computer 3
IntelligentAgents
IntelligentAgents
IntelligentAgents
Black Board
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
IntelligentAgents
IntelligentAgents
IntelligentAgents
IntelligentAgents
IntelligentAgents
IntelligentAgents
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
IntelligentAgents
IntelligentAgents
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
IntelligentAgents
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
Docword0.37068
word0.492333
word0.412607
word0.427525
word0.930737
word0.978947
word0.446173
word0.08058
word0.592417
word0.335562
word0.762008
word0.89652
word0.938931
word0.457311
word0.459791
word0.822132
word0.36959
word0.955044
word0.697507
word0.424708
word0.264228
word0.194726
word0.615864
word0.614114
word0.425498
word0.03065
word0.228638
word0.667838
word0.050275
word0.965724
word0.585864
word0.978729
word0.308229
word0.324661
word0.702205
word0.564679
word0.928135
word0.428677
word0.249835
word0.840986
word0.533131
word0.089476
word0.95258
word0.49666
word0.904506
word0.364454
word0.518086
word0.337456
13
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
US PACOM“Tremendously successful project”
“Software agents … lead to substantially improved analytical products.”
“A grand slam home run!”
Software Agents “working at HQ USCINCPAC operationally.”
Piranha Text Analysis
Potok et al., “VIPAR: Advanced Information Agents discovering knowledge in an open and changing environment,” Proc. 7th World Multiconference on Systemics, Cybernetics and Informatics Special Session on Agent-Based Computing, 2003. Awarded Best Paper Elmore, et al., “Dynamic Data Fusion Using An Ontology-Based Software Agent System,” 7th World Multiconference on Systemics, Cybernetics and Informatics, 2003.
14
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
CYPHER: Current Cyber security Approach
Repels KnownAttack Signatures
Repels anomalousRequests
The attack is unknown,
and not unusual?
What if …
15
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
CYPHER: New Approach
Find who is going after the “gold”
16
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
CYPHER: Cybersecurity Example
Activity Log EntryFilter: misc-000264 IDS247 - MISC - Large UDP Packet Date: 07/20TOD: 00:05:03.171193 Source IP: 63.76.192.107User John DoeResearch Area Nuclear PhysicsSource Port: 23882Target IP: 160.91.64.211Target Name: smith.aol.comTarget Port: 6970Length: 1285
NetRegDatabase63.76.192.107
John DoeBN 123456
CME Database
Johnathon DoeBN 123456
Nuclear Physics
DNS Database63.76.192.107
John DoeBN 123456
•1,000,000 records daily•Critical Decisions
−Is someone trying to hack into the system?−Are attack from “script kiddies” or state sponsored?−What are they going after and why?
17
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
Caught! 45 “low and slow” pings from:−Czech Republic, Austria, Hungary, Latvia, France, Chile, and Canada.
2 attacks on nanotechnology scientists
Hidden
Patented
18
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
Summary
• Current technology cannot solve emerging national challenges
• Intelligent software agents are a significant breakthrough technology
• Results indicate high-potential to help solve these national challenges
• We have a progression of significantly successfully deployed agent systems and research to our credit
19
OAK RIDGE NATIONAL LABORATORYU. S. DEPARTMENT OF ENERGY
Contact Information
• Contact Information
Thomas E. Potok, [email protected]