First Beat Media - Tehnologije na velikim projektima #tnt3
Transcript of First Beat Media - Tehnologije na velikim projektima #tnt3
![Page 1: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/1.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
ENTERTAINMENTONLINE
www.FirstBeatMedia.com
COMPANYMEDIA
Plantation, Florida, USA
linkedin.com/company/FirstBeatMediatwitter.com/FirstBeatMedia
![Page 2: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/2.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Tehnologijena velikim projektima
![Page 3: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/3.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Veliki projekti• FBM• 3 online dating platforme (i rivalstvo)• Očekivanja i realnost
![Page 4: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/4.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Veliki projekti – DatingBackend• 500 sajtova– BikerPlanet.com– DateACowboy.com– DatingForSeniors.com
• 40M page views, 5M+ unique visitors• 35 ljudi• 4 tima– Operations, Development (25 programera), CS i Traffic
![Page 5: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/5.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Veliki projekti – DatingVIP• 18 000 sajtova– MeetLocalBikers.com– CowboyDatingService.com– DatesForSeniors.com
• 18M page views, 1.7M+ unique visitors (1/50)• 150 ljudi• 4 godine rada – from zero to hero (flagship)• Timovi, 20 programera
![Page 6: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/6.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• Potrebe, realnost, planiranje i predviđanje
![Page 7: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/7.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• Potrebe, realnost, planiranje i predviđanje• Cena, dostupnost
![Page 8: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/8.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• Potrebe, realnost, planiranje i predviđanje• 1 server
![Page 9: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/9.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• Potrebe, realnost, planiranje i predviđanje• 1 server
– LAMP– Produkcija– Staging– Testing– SVN
![Page 10: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/10.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• Potrebe, realnost, planiranje i predviđanje• 1 server
– LAMP– Produkcija– Staging– Testing– SVN– ...– Single point of failure! :(
![Page 11: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/11.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• Potrebe, realnost, planiranje i predviđanje• 18 000 domena• 15 000 000 članova• 5 000 000 fotografija (x 3 dimenzije)• 100 000 video klipova• ~1Tb podataka u bazi (uključujući indekse)
![Page 12: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/12.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• 200 fizičkih servera (15 DatingVIP)• 200+ virtuelnih mašina (20 DatingVIP)• 4 ISP (od toga 3 u USA)• 300A kod jednog ISP (DatingVIP: 100A, 300Mbit/s)• 200Tb backup
– 4 puta dnevno u tekućoj nedelji– 1 dnevno za prethodnu nedelju– Par mesečnih backupa
![Page 13: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/13.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• 4 core, 8 ili 16Gb RAM, HDD po potrebi• SSD (540Mb/s read, 450Mb/s write)• RAID / NFS
![Page 14: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/14.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• 24/32 core, 256Gb RAM, HDD po potrebi• FusionIO (1.3Gb/s read, 1.1Gb/s write)• DRBD
![Page 15: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/15.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• 24/32 core, 256Gb RAM, HDD po potrebi• FusionIO (1.3Gb/s read, 1.1Gb/s write)• DRBD
• 10 procesora sa po 8 jezgara• 6Tb memorije
![Page 16: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/16.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware• 24/32 core, 256Gb RAM, HDD po potrebi• FusionIO (1.3Gb/s read, 1.1Gb/s write)• DRBD
• 10 procesora sa po 8 jezgara• 6Tb memorije
• Rack, blade, UPS, voltage, cooling• Recycle
![Page 17: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/17.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Hardware (sysadmins)• Poznavanje tehnologija i trendova• Održavanje naloga, OS i software• Security• 24/7 coverage (poneko ipak radi i vikendom :))
![Page 18: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/18.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - PHP• PHP 5.5.10
– Počeli smo sa PHP 5.2
• Made for web• Double claw?• Have it all! (proc, OOP, simple, complex, interpreted)• Still alive and kickin’
![Page 19: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/19.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - MySQL• MySQL 5.6
– Počeli smo sa 5.0
• Jedini storage (svih 15M članova)• Long history, proven, open source• InnoDB• Replikacija
– 1-3 (R/O, backup, failover)
• NoSQL?
![Page 20: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/20.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - MySQL• MySQL 5.6
– Počeli smo sa 5.0
• Jedini storage (svih 15M članova)• Long history, proven, open source• InnoDB• Replikacija
– 1-3 (R/O, backup, failover)
• 8 meseci od restarta (upgrade)
![Page 21: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/21.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - MySQL• MySQL 5.6
– Počeli smo sa 5.0
• Jedini storage (svih 15M članova)• Long history, proven, open source• InnoDB• Replikacija
– 1-3 (R/O, backup, failover)
• 8 meseci od restarta (upgrade)• 300+ milijardi upita, 15 000qps• I/O
![Page 22: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/22.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Web• Lighttpd + php-fpm
– Apache + mod_php
• 18 000 domena• 600req/s (50M+ req/day)• 3.5Mb/s (~300Gb/day)• Spor razvoj (nginx?)
![Page 23: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/23.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Web• Lighttpd + php-fpm
– Apache + mod_php
• 18 000 domena• 600req/s (50M+ req/day)• 3.5Mb/s (~300Gb/day)• Spor razvoj (nginx?)
![Page 24: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/24.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Cache• MemcacheD (LiveJournal)• 30Gb podataka• jednostavnost• ograničenja• uh-oh...
![Page 25: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/25.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Cache• Redis• 1Gb podataka• hybrid/fusion (DB?)• Različiti tipovi podataka• MQ, Pub/Sub
![Page 26: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/26.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - NoSQL• MongoDB• MapReduce• Logovanje• Quirks!• Drugi projekti
![Page 27: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/27.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Mailing• PowerMTA (Port25)
– StrongMail
• Jednostavnost, fleksibilnost, podrska, cena• PHPMailer• Avg 2M dnevno• Max 1M na sat• Statistike
![Page 28: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/28.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Tools• GIT (SVN)
– 4 godine, 6 meseci– 60K+ commitova– 20+ ljudi
• Veličina tima• Features/Merges• Hooks
– Syntax check– Code sniffer– Minify
![Page 29: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/29.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Tools• Testiranje i Merenje• PHPUnit (TDD, refactoring)• Selenium (functional)• ab / JMeter (stress)• StatsD / Graphite• xhprof
![Page 30: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/30.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Tools• Phabricator• Code Audit / quasi pairs• Ticketing• Web Interface (repo browser)• Wiki• Log
![Page 31: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/31.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Tools• Editori (NetBeans, phped, Sublime)• 5+ repozitorijuma?• 20 000 fajlova?• Autocomplete, Refactor, Search/Replace• Syntax check• Integracija
![Page 32: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/32.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Software - Tools• Encoding, EdgeCast, jpegmini• ganeti• percona-toolkit• Cacti / Nagios• *nix (grep, find, screen, ssh, scp)• Google Analytics
![Page 33: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/33.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
Budućnost? Mobile.• API-centric development• Android & iOS• Promena udela Jan 2013 – Jan 2014:
– Desktop: -15%– Mobile: +31%– Tablet: +61%
![Page 34: First Beat Media - Tehnologije na velikim projektima #tnt3](https://reader036.fdocuments.us/reader036/viewer/2022062709/5592a5d01a28ab74798b46b6/html5/thumbnails/34.jpg)
Online Entertainment Media Company Technology & Trends, Niš 2014
?www.FirstBeatMedia.com
Hvala
PITANJA
Plantation, Florida, USA
linkedin.com/company/FirstBeatMediatwitter.com/FirstBeatMedia