NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET...

29
NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002 June 2002

Transcript of NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET...

Page 1: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

NetSEC: metrology-based application

for network security

Jean-François SCARIOT

Bernard MARTINET

Centre Interuniversitaire

de Calcul de Grenoble

TNC 2002June 2002

Page 2: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

2

Plan Metrology

Why, what & how? Analyze

NetSEC Goals Architecture Available tools

Conclusion

Page 3: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

3

why to measure? To know network usage

To know network availability

To detect dysfunction

To do cost sharing

Also… to improve security

Page 4: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

4

What and how to measure? Qualitative: knowing its network

I/O traffic load, CPU load, collision…

Watch the counters of the equipments

Quantitative: controlling its network Traffic type, I/O traffic load per host or

group...

extract information from frame analysis

Page 5: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

5

Measurement to supervise Daily supervision (15’ is enough )

Curves or bar graphs

Always the same "look"

““To control and manage a To control and manage a network, you must visualize its network, you must visualize its

behaviour”behaviour”

Page 6: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

6

Highlighting a problem

Monday April the 2nd 2001

Monday April the 9th 2001

A « normal » day

May be some problems

Page 7: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

7

Highlighting a problem

Unfortunately!

Problem discovery is a

posteriori

We have to go back We have to go back AndAnd

analyze the traffic of the involved period. analyze the traffic of the involved period.

Page 8: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

8

Traffic analyzing

Locate the host(s) Date, addresses, intrusion method, extend

of the damage…

HOW?

Doing crosschecking

Sorting metrology data on several

parameters Powerful sorting tools are Powerful sorting tools are

needed!needed!

Page 9: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

9

NetSEC goals

To have an evolving software

To analyze “well-known” data NetMET IPtrafic

To support open standards

To improve the security of

networking computers

Page 10: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

10

NetSEC foundations

Using a relational database

A simple network description

A modular architecture

Using an open source software

Page 11: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

11

Open software

Linux system (Redhat)

MySQL database

Apache Web server

JAVA

Page 12: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

12

About database

JDBC database access

Basic SQL queries

One loader per collector

Page 13: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

13

DB structure

One table for one day (of data) src@ & dst@ Date Port & protocol Volume

One table for the network description

Page 14: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

14

Network description A network

192.168.10.11/24

An organism University Joseph Fourier

An entity CICG

A location Campus of Grenoble

Page 15: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

15

Available tools

A data query module

A graphic generator module

A data mining module

Page 16: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

16

Architecture

Query Engine

QueryProcess

SQLRequest

s

HTMLRequest

s

NetworkDescriptio

n

Loader

GraphicGeneratio

nProcess

Graphic Generator Engine

SQLRequest

sDB

KDDProcess

Knowledge Discovery Database Engine

Collector

Collected

Data

Loader

SQLRequest

s

ALARMSREPPORTS

Page 17: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

17

The query tool

To use the SQL power Sort Query Extract

Querying data with a friendly interface

Page 18: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

18

Web interface (Question)

Page 19: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

19

How does it work?

Parameters processing

JDBC driver loading & connection

Building and executing the SQL query

Displaying the results

Page 20: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

20

Web interface (Answer)

Page 21: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

21

Graphic generation

A zoom of a network on demand.

A supervision of a determined services

Page 22: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

22

Graphic generation: HTTP

Page 23: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

23

Functioning

Database system provides data

Querying database (with SQL queries)

Returning results to MRTG for displaying

MRTG Graphics building

Page 24: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

24

Graphic generation: SSH

Page 25: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

25

Data mining

Produce unknown information non trivial Useful

Produce association rules A and B => C

Page 26: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

26

Association rules process

Database

Set ofTransactio

ns

DataSelection

Explanation Knowledge

Large Itemsets

LargeItemsetsResearch

Associationrules

Association Rules

Generation Corn flakes and sugar milk

Page 27: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

27

Association rule example

"] 14h-19h]" AND

"SCAN/REGULAR_SERV" AND

"[0-1KB]" AND

53 "TUESDAY" (14.8%, 90.4%)

Page 28: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

28

Conclusion A contribution to improve

security

A metrology based-application Built on a database Open & Modular

Who would like to participate?

E-mail : [email protected] E-mail : [email protected]

Page 29: NetSEC: metrology-based application for network security Jean-François SCARIOT Bernard MARTINET Centre Interuniversitaire de Calcul de Grenoble TNC 2002.

29

TIGRE