VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

12
VPC Flow Logs Connection Tracking AWS Berlin Meetup 2015-08-24 [email protected] @try_except_

Transcript of VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

Page 1: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

VPC Flow LogsConnection Tracking

AWS Berlin Meetup [email protected] @try_except_

Page 2: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

AWS

STUPS

DOCKERDEPLOY

SSH ACCESS

AUDIT REPORTS

FULL AWS ACCESS

STUPS: A PLATFORM ON TOP OF AMAZON WEB SERVICES

Page 3: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

Internet

*.abc.example.org *.xyz.example.org

Team ABC Team XYZ

ISOLATED AWS ACCOUNTS

EC2EC2

ELBELB

EC2

Page 4: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

● 800+ in Zalando Tech

● 90+ AWS Accounts

● 160+ Applications

SOME NUMBERS..

Page 5: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

● Enable VPC Flow Logs

● Collect connections from public IPs

● Report & monitor

IDEA

Page 6: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

VPC FLOW LOGS

Page 7: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

● Enable on VPC Dashboard● Stored in CloudWatch Logs● One LogStream per network interface● Packet based

○ Source IP & Port○ Dest IP & Port○ Protocol (TCP/UDP)○ Packets & Bytes

VPC FLOW LOGS

Page 8: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

● No connection information

● No filtering

● Cost per ingested GB (0.57 EUR/GB)

● Rate limits

DOWNSIDES

Page 9: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

● Collect inbound VPC connections

● Across multiple AWS accounts

● Read deltas from VPC Flow Logs

● Provide HTTP interface

CONNECTION TRACKER

Page 10: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

CONNECTION TRACKER

Page 11: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

ACCOUNT CONNECTIONS

Page 12: VPC Flow Logs Connection Tracking @ AWS Berlin User Group Meetup August 2015

LinksVPC Flow Logs Connection Trackergithub.com/zalando-stups/connection-tracker

STUPS Frontpagestups.io

tech.zalando.com@try_except_