Building and Customizing CoreOS

Copyright © NIFTY Corporation All Rights Reserved.

Building and Customizing CoreOS

Yuya Kusakabe - @higebu

NIFTY Corp.

Nov. 13, 2014

- Creating images for NIFTY Cloud -

Copyright © NIFTY Corporation All Rights Reserved. Confidential 2

About me

Twitter / GitHub: @higebu

Engineer at Nifty Corp.

Desining NIFTY Cloud virtual network

services

Hacking VyOS, Packer, Zabbix

and CoreOS <- New!


About NIFTY Cloud

Launched in 2010.

IaaS, PaaS and SaaS.

Based on VMware.

Original cloud controller like OpenStack.


Why customize CoreOS?

To provide CoreOS images on NIFTY Cloud.

We need to handle end-user cloud-config

files.


Why build CoreOS?

Because we can not install packages on

CoreOS without building.

Read-only rootfs

No classic package manager


Building CoreOS

( not customized )

For more detail:

https://coreos.com/docs/sdk-distributors/sdk/modifying-coreos/


Install depot_tools

% git clone

https://chromium.googlesource.com/chromium/tools/depot_tools.git

% export PATH="$PATH":`pwd`/depot_tools

For more details about depot_tools:

http://www.chromium.org/developers/how-tos/depottools


Bootstrap the SDK chroot

% mkdir coreos; cd coreos

% git config --global color.ui false # avoid interactive question

% repo init -u https://github.com/coreos/manifest.git -g minilayout --

repo-url https://chromium.googlesource.com/external/repo.git

% repo sync


Building an image

% cros_sdk

% cros_sdk --enter

% ./set_shared_user_password.sh

% echo amd64-usr > .default_board

% ./setup_board

% ./build_packages

% ./build_image prod --group alpha # production and alpha channel

% ./image_to_vm.sh --from=../build/images/amd64-usr/latest --

board=amd64-usr --prod_image --format vmware # convert to

VMware VMX and VMDK

% exit

Your image is in the following directory.

“src/build/images/amd64-usr/latest/”


Customizing CoreOS


Add support for NIFTY Cloud

Add oem-niftycloud to coreos-overlay

https://github.com/higebu/coreos-

overlay/tree/niftycloud-494

Add niftycloud format to

scripts/build_library/vm_image_util.sh

https://github.com/higebu/scripts/tree/niftycloud-494

VMware Tools

Experimental support for open-vm-tools at

471.1.0

https://github.com/higebu/coreos-overlay/tree/niftycloud-494

https://github.com/higebu/scripts/tree/niftycloud-494


oem-niftycloud

https://github.com/higebu/coreos-

overlay/tree/niftycloud-494/coreos-base/oem-niftycloud

% tree coreos-base/oem-niftycloud/

coreos-base/oem-niftycloud/

├── files

│ ├── cloud-config.yml # cloud-config for NIFTY Cloud

│ ├── coreos-setup-environment # set environment variables

│ ├── niftycloud-coreos-cloudinit # run coreos-cloudinit with user-data

│ ├── niftycloud-run-startup-scripts # run user scripts

│ └── niftycloud-ssh-key # set ssh key

└── oem-niftycloud-0.0.1.ebuild

1 directory, 6 files

oem-niftycloud


niftycloud format

https://github.com/higebu/scripts/blob/niftycloud-

494/build_library/vm_image_util.sh

## niftycloud

IMG_niftycloud_DISK_FORMAT=vmdk_scsi

IMG_niftycloud_DISK_LAYOUT=vm

IMG_niftycloud_CONF_FORMAT=vmx

IMG_niftycloud_OEM_PACKAGE=oem-niftycloud

vm_image_util.sh


open-vm-tools

It’s me!


Building CoreOS

( Customized )

For more detail:

https://coreos.com/docs/sdk-distributors/sdk/modifying-coreos/


Modify manifests/release.xml

<project groups="minilayout" name="higebu/coreos-overlay"

path="src/third_party/coreos-overlay" remote="private" revision="niftycloud-

494" upstream="refs/heads/master"/>

<project groups="minilayout" name="higebu/scripts" path="src/scripts"

remote="private" revision="niftycloud-494" upstream="refs/heads/master"/>

• Change repository names and revisions


Install depot_tools

% git clone

https://chromium.googlesource.com/chromium/tools/depot_tools.git

% export PATH="$PATH":`pwd`/depot_tools

For more details about depot_tools:

http://www.chromium.org/developers/how-tos/depottools


Bootstrap the SDK chroot

% mkdir coreos; cd coreos

% git config --global color.ui false # avoid interactive question

% repo init -u ssh://[email protected]/higebu/manifest.git -b niftycloud-

494 -g minilayout --repo-url

https://chromium.googlesource.com/external/repo.git

% repo init –m release.xml

% repo sync


Building an image

% cros_sdk --download

% cros_sdk -- "./set_shared_user_password.sh" "core"

% echo "amd64-usr" > src/scripts/.default_board

% cros_sdk -- "./setup_board"

% cros_sdk -- "./build_packages"

% cros_sdk -- "./build_image" "prod" "--group" "alpha"

% cros_sdk -- "./image_to_vm.sh" "--from=../build/images/amd64-

usr/latest" "--board=amd64-usr" "--prod_image" "--format"

"niftycloud"

Your image is in the following directory.

“src/build/images/amd64-usr/latest/”

• Use niftycloud format

• Use “cros_sdk --” for automation


NIFTY Cloud CoreOS images!


Thank you for listening!

We are hiring!

http://www.nifty.co.jp/recruit/

Building and Customizing CoreOS

Technology

Transcript of Building and Customizing CoreOS