Scripts which perform an installable binary image build for SONiC
Go to file
lguohan 63a044a87c [build]: fix dpkg admindir corruption issue in parallel build (#6408)
Fix #119

when parallel build is enable, multiple dpkg-buildpackage
instances are running at the same time. /var/lib/dpkg is shared
by all instances and the /var/lib/dpkg/updates could be corrupted
and cause the build failure.

the fix is to use overlay fs to mount separate /var/lib/dpkg
for each dpkg-buildpackage instance so that they are not affecting
each other.

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-20 23:06:13 -08:00
.github [github]: add templates for submitting issues and PR (#947) 2017-09-08 21:27:15 -07:00
device Potential fix for Celestica E1031 device hang 2020-12-04 12:39:47 -08:00
dockers [dhcpmon] Print Both Snapshot And Current Counters (#5374) 2020-09-16 09:57:36 -07:00
files [sonic-linux-kernel]: update kernel to 4.9.246 (#6461) 2021-01-16 12:33:23 -08:00
installer [sonic-linux-kernel]: update kernel to 4.9.246 (#6461) 2021-01-16 12:33:23 -08:00
platform [build]: wait for conflicts package to be uninstalled (#5039) 2021-01-20 23:06:13 -08:00
rules [build]: fix dpkg admindir corruption issue in parallel build (#6408) 2021-01-20 23:06:13 -08:00
sonic-slave [sonic-slave]: Install pympler to find the memory leaks in python (#4652) 2020-06-09 16:27:53 +00:00
sonic-slave-stretch [201811][apt] Instruct apt-get to NOT check the "Valid Until" date in Release files (#3975) 2020-01-08 08:34:45 -08:00
src [build]: fix dpkg admindir corruption issue in parallel build (#6408) 2021-01-20 23:06:13 -08:00
.gitignore [dhcp-relay]: Add DHCP Relay Monitor (#3886) (#4004) 2020-01-14 10:33:20 -08:00
.gitmodules [201811][quagga]: Use 201811 branch of sonic-quagga (#4966) 2020-07-14 10:09:11 -07:00
build_debian.sh [sonic-linux-kernel]: update kernel to 4.9.246 (#6461) 2021-01-16 12:33:23 -08:00
build_debug_docker_j2.sh 1) Build debug docker image for each docker (#3104) 2019-07-09 08:55:03 -07:00
build_docker.sh Split script: push_docker.sh (#89) 2016-12-01 02:18:59 -08:00
build_image.sh [vs]: fail the build when build kvm image fails (#2297) 2018-11-25 11:33:00 -08:00
build_kvm_image.sh [build] force Linux to drop cache before calling kvm (#2717) 2019-04-01 22:47:23 +00:00
check_install.py [vs]: fail the build when build kvm image fails (#2297) 2018-11-25 11:33:00 -08:00
dbg_files.sh Create the src archive in target/ when INSTALL_DEBUG_TOOLS=y (#3323) 2019-08-29 21:25:02 +00:00
functions.sh [build] When generating image version, handle case where current commit has no reachable tags (#2506) 2019-11-06 01:36:03 +00:00
get_docker-base.sh Add mkdir if the target dir does not exist (#130) 2016-12-16 02:19:15 +00:00
LICENSE updating readme, formatting in license 2016-03-09 17:39:34 +00:00
MAINTAINERS Adding license and maintainers 2016-03-08 19:10:18 -08:00
Makefile [build]: Makefile: make new step "make stretch" optional (#1936) 2018-08-16 15:54:31 -07:00
Makefile.work [build]: change user name to lower case when used in sonic-slave tag (#6319) 2021-01-19 09:57:57 -08:00
onie-image.conf [baseimage]: incrase docker ramfs from 800MB to 900MB (#3582) 2019-10-10 00:46:54 +00:00
onie-mk-demo.sh [image]: build sonic-broadcom.raw image for sonic conversion from ftos (#901) 2017-08-27 20:13:38 -07:00
push_docker.sh Update dockers with platform & SONiC version as part of name/tag. (#4337) 2020-04-15 17:19:56 +00:00
README.buildsystem.md [doc] fix typo in README.buildsystem.md (#1399) 2018-02-17 09:56:19 -08:00
README.md [build]: add build badge for 201811 branch 2018-12-05 18:29:55 +00:00
slave.mk [build]: fix dpkg admindir corruption issue in parallel build (#6408) 2021-01-20 23:06:13 -08:00
ThirdPartyLicenses.txt Config apt inside docker images to save disk space: auto clean, gz, no trans (#69) 2016-11-16 12:46:15 -08:00
update_screen.sh [rules/functions][slave.mk]: Refine build output (#838) 2017-07-25 09:49:39 +03:00

master: Barefoot: Barefoot Broadcom: Broadcom Mellanox: Mellanox Nephos: Nephos P4: P4 VS: VS

201811: Broadcom: Broadcom Barefoot: Mellanox Centec: Centec Nephos: Nephos Marvell: Marvell Mellanox: Mellanox VS: VS

201807: Broadcom: Broadcom Barefoot: Mellanox Centec: Centec Nephos: Nephos Marvell: Marvell Mellanox: Mellanox

201803: Broadcom: Broadcom Cavium: Cavium Centec: Centec Nephos: Nephos Marvell: Marvell Mellanox: Mellanox

sonic-buildimage

Build SONiC Switch Images

Description

Following is the instruction on how to build an (ONIE) compatiable network operating system (NOS) installer image for network switches, and also how to build docker images running inside the NOS. Note that SONiC image are build per ASIC platform. Switches using the same ASIC platform share a common image. For a list of supported switches and ASIC, please refer to this list

Hardware

Any server can be a build image server. We are using a server with 1T hard disk. The OS is Ubuntu 16.04.

Prerequisites

SAI Version

Please refer to SONiC roadmap on the SAI version for each SONiC release.

Clone or fetch the code repository with all git submodules

To clone the code repository recursively, assuming git version 1.9 or newer:

git clone https://github.com/Azure/sonic-buildimage.git

Usage

To build SONiC installer image and docker images, run the following commands:

# Ensure the 'overlay' module is loaded on your development system
sudo modprobe overlay

# Enter the source directory
cd sonic-buildimage

# (Optional) Checkout a specific branch. By default, it uses master branch
git checkout [branch_name]

# Execute make init once after cloning the repo, or after fetching remote repo with submodule updates
make init

# Execute make configure once to configure ASIC
make configure PLATFORM=[ASIC_VENDOR]

# Build Debian Stretch required targets (Manual execution optional; will also be executed as part of the build)
BLDENV=stretch make stretch

# Build SONiC image
make all

NOTE:

  • Recommend reserving 50G free space to build one platform.
  • Use http_proxy=[your_proxy] https_proxy=[your_proxy] make to enable http(s) proxy in the build process.
  • Add your user account to docker group and use your user account to make. root or sudo are not supported.

The SONiC installer contains all docker images needed. SONiC uses one image for all devices of a same ASIC vendor. The supported ASIC vendors are:

  • PLATFORM=broadcom
  • PLATFORM=marvell
  • PLATFORM=mellanox
  • PLATFORM=cavium
  • PLATFORM=centec
  • PLATFORM=nephos
  • PLATFORM=p4
  • PLATFORM=vs

For Broadcom ASIC, we build ONIE and EOS image. EOS image is used for Arista devices, ONIE image is used for all other Broadcom ASIC based devices.

make configure PLATFORM=broadcom
# build debian stretch required targets
BLDENV=stretch make stretch
# build ONIE image
make target/sonic-broadcom.bin
# build EOS image
make target/sonic-aboot-broadcom.swi

You may find the rules/config file useful. It contains configuration options for the build process, like adding more verbosity or showing dependencies, username and password for base image etc.

Every docker image is built and saved to target/ directory. So, for instance, to build only docker-database, execute:

make target/docker-database.gz

Same goes for debian packages, which are under target/debs/:

make target/debs/swss_1.0.0_amd64.deb

Every target has a clean target, so in order to clean swss, execute:

make target/debs/swss_1.0.0_amd64.deb-clean

It is recommended to use clean targets to clean all packages that are built together, like dev packages for instance. In order to be more familiar with build process and make some changes to it, it is recommended to read this short Documentation.

Notes:

  • If you are running make for the first time, a sonic-slave-${USER} docker image will be built automatically. This may take a while, but it is a one-time action, so please be patient.

  • The root user account is disabled. However, the created user can sudo.

  • The target directory is ./target, containing the NOS installer image and docker images.

    • sonic-generic.bin: SONiC switch installer image (ONIE compatiable)
    • sonic-aboot.bin: SONiC switch installer image (Aboot compatiable)
    • docker-base.gz: base docker image where other docker images are built from, only used in build process (gzip tar archive)
    • docker-database.gz: docker image for in-memory key-value store, used as inter-process communication (gzip tar archive)
    • docker-fpm.gz: docker image for quagga with fpm module enabled (gzip tar archive)
    • docker-orchagent-brcm.gz: docker image for SWitch State Service (SWSS) on Broadcom platform (gzip tar archive)
    • docker-orchagent-cavm.gz: docker image for SWitch State Service (SWSS) on Cavium platform (gzip tar archive)
    • docker-orchagent-mlnx.gz: docker image for SWitch State Service (SWSS) on Mellanox platform (gzip tar archive)
    • docker-orchagent-nephos.gz: docker image for SWitch State Service (SWSS) on Nephos platform (gzip tar archive)
    • docker-syncd-brcm.gz: docker image for the daemon to sync database and Broadcom switch ASIC (gzip tar archive)
    • docker-syncd-cavm.gz: docker image for the daemon to sync database and Cavium switch ASIC (gzip tar archive)
    • docker-syncd-mlnx.gz: docker image for the daemon to sync database and Mellanox switch ASIC (gzip tar archive)
    • docker-syncd-nephos.gz: docker image for the daemon to sync database and Nephos switch ASIC (gzip tar archive)
    • docker-sonic-p4.gz: docker image for all-in-one for p4 software switch (gzip tar archive)
    • docker-sonic-vs.gz: docker image for all-in-one for software virtual switch (gzip tar archive)

Contribution Guide

All contributors must sign a contribution license agreement before contributions can be accepted. Contact sonic-cla-agreements@microsoft.com.

GitHub Workflow

We're following basic GitHub Flow. If you have no idea what we're talking about, check out GitHub's official guide. Note that merge is only performed by the repository maintainer.

Guide for performing commits:

  • Isolate each commit to one component/bugfix/issue/feature
  • Use a standard commit message format:
[component/folder touched]: Description intent of your changes

[List of changes]

Signed-off-by: Your Name your@email.com

For example:

swss-common: Stabilize the ConsumerTable

* Fixing autoreconf
* Fixing unit-tests by adding checkers and initialize the DB before start
* Adding the ability to select from multiple channels
* Health-Monitor - The idea of the patch is that if something went wrong with the notification channel,
  we will have the option to know about it (Query the LLEN table length).

  Signed-off-by: user@dev.null
  • Each developer should fork this repository and add the team as a Contributor
  • Push your changes to your private fork and do "pull-request" to this repository
  • Use a pull request to do code review
  • Use issues to keep track of what is going on

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.