One Click Deployment with Jenkins - PHP Unconference 2011

© 2011 Mayflower GmbH

Florian Anderiasch / Thorsten Rinne PHP Unconference 2011, Hamburg

One Click Deployment with Jenkins

http://webtechcon.de/2011/sessions/#session-18672

http://webtechcon.de/2011/sessions/#session-18672

Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 2

DevOp„I rant a lot“

@anderiasch

Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I

Team Lead / Scrum MasterHead of Open Source Labs

@ThorstenRinne3


Who are you?

4


Developers?

5


Administrators?

6


DevOps?

7


Continuous Integration?

8


How much time do you need for a release?

9


More than a year?

10


6 - 12 months?

11


1 - 6 months?

12


2 - 4 weeks?

13


1 - 14 days?

14


1 - 24 hours?

15


Less than 15 minutes?

16


15 Minutes!

17


Why One Click Deployment?

18


Everything is getting faster.

19


Faster feedback from your customer / user

20


Faster ROI (return on invest)

21


Faster responseif the market changes

22

Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 23Developers are lazy.


Basic requirements

24


Agile software development

25


Scrum or Kanban

26


Test Driven Development

27


Continuous Integration

29


Continuous Inspection

30


Refactoring

31


ScrumKanban


ScrumKanban

ContinuousIntegration


ScrumKanban


ContinuousInspection


Continuous Deployment

32

ScrumKanban


ContinuousInspection


Things you don‘t want.

33


Having your SVN repo in your webserver‘s docroot.

34


Using SSH and vi and your root account on the live

server. Never.

35


Who‘s still doing this? :-)

36


What do we need?

38


First: a central build server

39


Continous Testing with PHPUnit

41


Advantages

42


Test results at one central page

43


Software metrics at one central page

44


Errors can be identified fast and then fixed

45


Awareness

46


Awareness!


Continuous Integration in PHP projects

48


PHPUnitDocBlox

49


Continuous Inspection in PHP projects

50


PHPCSPHP Depend

PHPMDphpcpd

jslint

51


jslint?yes!

52


Infrastructure

53


Developer VMUbuntu 11.04

55


Testing VM + Jenkins VM:Ubuntu 11.04

56


Staging VMs:Frontend: Ubuntu 11.04

Backend: Ubuntu 10.04 LTS

57


amazon AWS live:Frontend: Ubuntu 11.04

Backend: Ubuntu 10.04 LTS

58


Front NodesVarnishnginx

PHP 5.3 with APCZend Framework 1.11

dojo toolkit 1.6Doctrine 2.1

59


Backend NodesMySQL Master/Slave

Apache SolrPHP 5.3 with APC

RabbitMQejabberd


Development workflow

61


1. git workflow

62

$ git add Foo.php$ git commit -m ″Bar″$ ant jslint$ ant phpunit ...$ git push


2. Post commit hook

63

Build triggered on Jenkins


Jenkins build checks

64


1. PHPUnit Build:Unittests

Controller Tests (Zend_Test)PHP Code Coverage

65


2. Debian Package Build

66


3. Deploy to staging4. Deploy staging to live

67


What is a build process?

68


ant syncant clean

ant db-updateparallelTasks:

ant phpunitant phpcbant deb

69


<target name="phpunit" depends="db-test" description="Run all tests"> <exec executable="phpunit" failonerror="true"> <arg line="--configuration ${basedir}/tests/phpunit-verbose.xml ${basedir}/tests/AllTests.php" /> </exec></target>

70

ant phpunit


parallelTasks:php_depend

phpmdphpunitphpcpdphpcsjslint

71


Build Debian Packageant autoloaderant phpunitant clean

ant compilejsant compilecss


<target name="deb" depends="autoloader,phpunit-coverage,clean,autoloader,compilejs,compilecss" description="Generate Debian package"> <exec executable="gpg"> <arg value="--armor" /> <arg value="--import" /> <arg value="scripts/build/deb/mapolis.mayflower.de.pgp" /> </exec> <buildnumber />

73

ant deb (I)


<exec executable="git" outputproperty="githash"> <arg value="describe" /> <arg value="--always" /> <arg value="--match" /> <arg value="" /> </exec> <touch file="debian/changelog" /> <move file="debian/changelog" tofile="debian/changelog.old" />

74

ant deb (II)


<exec executable="git" output="debian/changelog.new"> <arg value="log" /> <arg value="-n" /> <arg value="1" /> <arg value='--format=format:mapolis-web (${build.number}-${githash}) unstable; urgency=low%n%n * %s%n%n -- %an <%ae> %aD%n%n' /> </exec>

75

ant deb (III)


<concat destfile="debian/changelog"> <fileset file="debian/changelog.new" /> <fileset file="debian/changelog.old" /> </concat> <delete file="debian/changelog.new" /> <delete file="debian/changelog.old" />

76

ant deb (IV)


<exec executable="dpkg-buildpackage"> <arg value="-b" /> <arg value="-v${build.number}-${githash}" /> <arg value="-Zlzma" /> <arg value="-z9" /> <arg value="-k78532445" /> <arg value="-pgpg" /> <arg value="-sgpg" /> <arg value="-mMayflower Mapolis Team <[email protected]>" /> </exec>

77

ant deb (V)

mailto:[email protected]



<move todir="build/deb/"> <fileset dir="${basedir}/../"> <include name="mapolis*.deb" /> <include name="mapolis*.changes" /> </fileset> </move> <exec executable="dpkg-buildpackage"> <arg value="-Tclean" /> </exec> </target>

78

ant deb (VI)


Deploy Stagingant clean

ant deb-signant db-staging-upscp to all hosts

79


Deploy Staging to livescp to all hosts


Disadvantages and problems

81


Build time15 min on harddisk

massive disk i/o4 min on ramdisk :-)

82


Complexity beginning such a infrastructure

83


Jenkins:Single point of failure!

84


Cool stuff which is now possible

85


Deploy by customer. :-)


Jenkins Chuck Norris Plugin


git bisect start $BAD $GOOD

88


Minimum time from bugreport to deploy:

30 minutes

89


$ git branch hotfix-2011-08-22$ git checkout hotfix-2011-08-22$ git reset --hard "last stable sha-1"$ git cherry-pick "hotfix sha-1"$ echo build.number=23 > build.number$ ant deb$ scp build/deb/*.deb xyz.amazonaws.com:/opt/repository/$ git checkout master$ git push origin hotfix-2011-08-10

90


Questions?

91

Thank you very much for your attention!

© 2011 Mayflower GmbH

Contact Florian [email protected]+49 89 242054-1134

Mayflower GmbHMannhardtstr. 680538 MünchenGermany

Thorsten [email protected]+49 89 242054-31

Mayflower GmbHMannhardtstr. 680538 MünchenGermany





One Click Deployment with Jenkins - PHP Unconference 2011

Technology

Transcript of One Click Deployment with Jenkins - PHP Unconference 2011