Scripts which perform an installable binary image build for SONiC
Go to file
Stephen cfa14ce1a6 [Mellanox]Fix issue #2720 Not able to read out values of voltage/temp/power on some cables (#2957)
* [device/mellanox/x86_64-mlnx_msn2700-r0/plugins/sfputil.py]
purpose and restrictions
1. reading eeprom via ethtool.
2. avoid changing common codes shared by all the manufacture (sonic-platform-common), contrain all the modifications with Mellanox-specific code.
current implementation
A new class based on SfpUtilBase and a new method _read_eeprom_specific_bytes_via_ethtool have been introduced in order to change the way the eprom DOM data is read. Typically the best practice to do this kind of thing is to contrain the modification within the function which execute reading operations only and keep other stuffs (especially the interface) untouched. However, this can hardly be achieved since the original reading function takes the file object as input parameter to represent the port. It is done by having the file object to point to /var/run/hwmanagement files, which will not be maintained in the future. As a result, a new interface has to be introduced with a port number/name as input parameter in order to get rid of the dependency on the those files:
_read_eeprom_specific_bytes_via_ethtool
Since the interface changed, all methods that call the interface should also be overwritten in order to call the new interface, including:
_read_eeprom_devid
get_transceiver_info_dict
get_transceiver_dom_info_dict
Only interface used to read eeprom DOM has been replaced and the main logic has not been changed except the following mentioned.
1. reading DOM data for sfp port, which is implementioned in get_transceiver_dom_info_dict. In this case a "calibration" should be firstly read from eeprom before other values like temperature, voltage, rx/tx power, can be parsed. However, this has been ignored in the original code, resulting in that the data cann't be parsed.
2. In the original implemention the data area containing the data are read from DOM separatedly in order to avoid read uncessary data and achieve a better performance. Having used ethtool to read DOM data, the performance gap between reading all the area and reading the spot data separatedly has been narrowed to almost zero. To make the code neat and readable, we change the way to read this data.

* [sfputil] Returns dict with all data set to N/A for ports without dom support
Currently, the way in which dom data is read has been changed from using sysfs to using ethtool.
The ethtool returns None for ports without dom support, resulting in None being returned. However, this fails xcvrd to add the TRANSCEIVER_DOM_SENSOR table entry of associated port to CONFIG_DB and then causes SNMP fail.
To address this issue a default dict is initialized with all data set to 'N/A' and is returned is the above case.
BTW, in the original implementation which sysfs is used to read dom data, even though non-None data is returned for ports without dom support, it does not contain valid data. This can result in wrong data in TRANSCEIVER_DOM_SENSOR table.

* [sfputil]
removing unnecessary empty lines
removing redundent code
replacing hardcoding strings/numbers with predefined const variables
2019-05-31 08:22:47 -07:00
.github [github]: add templates for submitting issues and PR (#947) 2017-09-08 21:27:15 -07:00
device [Mellanox]Fix issue #2720 Not able to read out values of voltage/temp/power on some cables (#2957) 2019-05-31 08:22:47 -07:00
dockers [docker-frr]: change default routing mode to separated and fix a bug in separated mode (#2961) 2019-05-31 07:39:40 -07:00
files [mellanox]: Fixed config reload race. (#2930) 2019-05-29 09:57:29 +03:00
installer [kernel]: update sonic kernel to 4.9.0-8-2 (#2468) 2019-01-25 00:46:09 -08:00
platform [docker-vs]: Start staticd by default (#2929) 2019-05-29 16:14:48 -07:00
rules [docker-ptf]: move docker-ptf to stretch (#2954) 2019-05-29 18:26:52 -07:00
sonic-slave [build]: fixed BFN target build (#2784) 2019-04-15 22:34:56 -07:00
sonic-slave-stretch [build]: make sonic-slave-stretch as the default build docker (#2921) 2019-05-27 15:50:51 -07:00
src [docker-frr]: change default routing mode to separated and fix a bug in separated mode (#2961) 2019-05-31 07:39:40 -07:00
.gitignore [.gitignore]: update inclusion of dbg files 2019-05-24 16:41:37 +00:00
.gitmodules [FRR]: Update frr to frr-7.0.1 (#2899) 2019-05-16 10:59:12 -07:00
build_debian.sh [build]: make sonic-slave-stretch as the default build docker (#2921) 2019-05-27 15:50:51 -07:00
build_debug_docker_j2.sh [build]: Updated Makefile infrastructure to build debug images. (#2753) 2019-04-13 17:05:18 -07:00
build_docker.sh Split script: push_docker.sh (#89) 2016-12-01 02:18:59 -08:00
build_image.sh [vs]: fail the build when build kvm image fails (#2297) 2018-11-25 11:33:00 -08:00
build_kvm_image.sh [build] force Linux to drop cache before calling kvm (#2717) 2019-03-29 15:25:17 -07:00
check_install.py [vs]: fail the build when build kvm image fails (#2297) 2018-11-25 11:33:00 -08:00
functions.sh [build] When generating image version, handle case where current commit has no reachable tags (#2506) 2019-01-31 14:48:48 -08:00
get_docker-base.sh Add mkdir if the target dir does not exist (#130) 2016-12-16 02:19:15 +00:00
LICENSE updating readme, formatting in license 2016-03-09 17:39:34 +00:00
MAINTAINERS Adding license and maintainers 2016-03-08 19:10:18 -08:00
Makefile [build]: make sonic-slave-stretch as the default build docker (#2921) 2019-05-27 15:50:51 -07:00
Makefile.work [build]: make sonic-slave-stretch as the default build docker (#2921) 2019-05-27 15:50:51 -07:00
onie-image.conf [vs]: build sonic vs kvm image (#2269) 2018-11-20 22:32:40 -08:00
onie-mk-demo.sh [image]: build sonic-broadcom.raw image for sonic conversion from ftos (#901) 2017-08-27 20:13:38 -07:00
push_docker.sh [docker] Refine docker tag for build number (#1484) 2018-03-12 14:45:35 -07:00
README.buildsystem.md [doc] fix typo in README.buildsystem.md (#1399) 2018-02-17 09:56:19 -08:00
README.md [build]: make sonic-slave-stretch as the default build docker (#2921) 2019-05-27 15:50:51 -07:00
slave.mk [build]: make sonic-slave-stretch as the default build docker (#2921) 2019-05-27 15:50:51 -07:00
ThirdPartyLicenses.txt Config apt inside docker images to save disk space: auto clean, gz, no trans (#69) 2016-11-16 12:46:15 -08:00
update_screen.sh [rules/functions][slave.mk]: Refine build output (#838) 2017-07-25 09:49:39 +03:00

master: Barefoot: Barefoot Broadcom: Broadcom Mellanox: Mellanox Nephos: Nephos P4: P4 VS: VS

201811: Broadcom: Broadcom Barefoot: Mellanox Centec: Centec Nephos: Nephos Marvell: Marvell Mellanox: Mellanox VS: VS

201807: Broadcom: Broadcom Barefoot: Mellanox Centec: Centec Nephos: Nephos Marvell: Marvell Mellanox: Mellanox

201803: Broadcom: Broadcom Cavium: Cavium Centec: Centec Nephos: Nephos Marvell: Marvell Mellanox: Mellanox

sonic-buildimage

Build SONiC Switch Images

Description

Following is the instruction on how to build an (ONIE) compatible network operating system (NOS) installer image for network switches, and also how to build docker images running inside the NOS. Note that SONiC image are build per ASIC platform. Switches using the same ASIC platform share a common image. For a list of supported switches and ASIC, please refer to this list

Hardware

Any server can be a build image server. We are using a server with 1T hard disk. The OS is Ubuntu 16.04.

Prerequisites

SAI Version

Please refer to SONiC roadmap on the SAI version for each SONiC release.

Clone or fetch the code repository with all git submodules

To clone the code repository recursively, assuming git version 1.9 or newer:

git clone https://github.com/Azure/sonic-buildimage.git

Usage

To build SONiC installer image and docker images, run the following commands:

# Ensure the 'overlay' module is loaded on your development system
sudo modprobe overlay

# Enter the source directory
cd sonic-buildimage

# (Optional) Checkout a specific branch. By default, it uses master branch
git checkout [branch_name]

# Execute make init once after cloning the repo, or after fetching remote repo with submodule updates
make init

# Execute make configure once to configure ASIC
make configure PLATFORM=[ASIC_VENDOR]

# Build SONiC image
make all

NOTE:

  • Recommend reserving 50G free space to build one platform.

  • If Docker's workspace folder, /var/lib/docker, resides on a partition without sufficient free space, you may encounter an error like the following during a Docker container build job:

    /usr/bin/tar: /path/to/sonic-buildimage/<some_file>: Cannot write: No space left on device

    The solution is to move the directory to a partition with more free space.

  • Use http_proxy=[your_proxy] https_proxy=[your_proxy] make to enable http(s) proxy in the build process.

  • Add your user account to docker group and use your user account to make. root or sudo are not supported.

The SONiC installer contains all docker images needed. SONiC uses one image for all devices of a same ASIC vendor. The supported ASIC vendors are:

  • PLATFORM=broadcom
  • PLATFORM=marvell
  • PLATFORM=mellanox
  • PLATFORM=cavium
  • PLATFORM=centec
  • PLATFORM=nephos
  • PLATFORM=p4
  • PLATFORM=vs

For Broadcom ASIC, we build ONIE and EOS image. EOS image is used for Arista devices, ONIE image is used for all other Broadcom ASIC based devices.

make configure PLATFORM=broadcom
# build debian stretch required targets
BLDENV=stretch make stretch
# build ONIE image
make target/sonic-broadcom.bin
# build EOS image
make target/sonic-aboot-broadcom.swi

You may find the rules/config file useful. It contains configuration options for the build process, like adding more verbosity or showing dependencies, username and password for base image etc.

Every docker image is built and saved to target/ directory. So, for instance, to build only docker-database, execute:

make target/docker-database.gz

Same goes for debian packages, which are under target/debs/:

make target/debs/swss_1.0.0_amd64.deb

Every target has a clean target, so in order to clean swss, execute:

make target/debs/swss_1.0.0_amd64.deb-clean

It is recommended to use clean targets to clean all packages that are built together, like dev packages for instance. In order to be more familiar with build process and make some changes to it, it is recommended to read this short Documentation.

Notes:

  • If you are running make for the first time, a sonic-slave-${USER} docker image will be built automatically. This may take a while, but it is a one-time action, so please be patient.

  • The root user account is disabled. However, the created user can sudo.

  • The target directory is ./target, containing the NOS installer image and docker images.

    • sonic-generic.bin: SONiC switch installer image (ONIE compatible)
    • sonic-aboot.bin: SONiC switch installer image (Aboot compatible)
    • docker-base.gz: base docker image where other docker images are built from, only used in build process (gzip tar archive)
    • docker-database.gz: docker image for in-memory key-value store, used as inter-process communication (gzip tar archive)
    • docker-fpm.gz: docker image for quagga with fpm module enabled (gzip tar archive)
    • docker-orchagent-brcm.gz: docker image for SWitch State Service (SWSS) on Broadcom platform (gzip tar archive)
    • docker-orchagent-cavm.gz: docker image for SWitch State Service (SWSS) on Cavium platform (gzip tar archive)
    • docker-orchagent-mlnx.gz: docker image for SWitch State Service (SWSS) on Mellanox platform (gzip tar archive)
    • docker-orchagent-nephos.gz: docker image for SWitch State Service (SWSS) on Nephos platform (gzip tar archive)
    • docker-syncd-brcm.gz: docker image for the daemon to sync database and Broadcom switch ASIC (gzip tar archive)
    • docker-syncd-cavm.gz: docker image for the daemon to sync database and Cavium switch ASIC (gzip tar archive)
    • docker-syncd-mlnx.gz: docker image for the daemon to sync database and Mellanox switch ASIC (gzip tar archive)
    • docker-syncd-nephos.gz: docker image for the daemon to sync database and Nephos switch ASIC (gzip tar archive)
    • docker-sonic-p4.gz: docker image for all-in-one for p4 software switch (gzip tar archive)
    • docker-sonic-vs.gz: docker image for all-in-one for software virtual switch (gzip tar archive)

Contribution Guide

All contributors must sign a contribution license agreement before contributions can be accepted. Contact sonic-cla-agreements@microsoft.com.

GitHub Workflow

We're following basic GitHub Flow. If you have no idea what we're talking about, check out GitHub's official guide. Note that merge is only performed by the repository maintainer.

Guide for performing commits:

  • Isolate each commit to one component/bugfix/issue/feature
  • Use a standard commit message format:
[component/folder touched]: Description intent of your changes

[List of changes]

Signed-off-by: Your Name your@email.com

For example:

swss-common: Stabilize the ConsumerTable

* Fixing autoreconf
* Fixing unit-tests by adding checkers and initialize the DB before start
* Adding the ability to select from multiple channels
* Health-Monitor - The idea of the patch is that if something went wrong with the notification channel,
  we will have the option to know about it (Query the LLEN table length).

  Signed-off-by: user@dev.null
  • Each developer should fork this repository and add the team as a Contributor
  • Push your changes to your private fork and do "pull-request" to this repository
  • Use a pull request to do code review
  • Use issues to keep track of what is going on

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.