Commit Graph

5294 Commits

Author SHA1 Message Date
mssonicbld
91033e110b
[ci/build]: Upgrade SONiC package versions (#13883) 2023-02-21 21:34:54 +08:00
Liu Shilong
b18751f721
[ci] Kill hanged docker build process to avoid build timeout issue. (#13726) (#13730)
Why I did it
Docker build has a low rate of hanging up.
It hangs on different steps. So, it looks like a bug in docker daemon.

How I did it
Start a daemon process to scan running time more than 1 hours, and kill the process.

How to verify it
2023-02-20 18:16:05 +08:00
mssonicbld
ddc6ae1d8b
[ci/build]: Upgrade SONiC package versions (#13878) 2023-02-18 20:06:12 +08:00
mssonicbld
57ddad3194
[ci/build]: Upgrade SONiC package versions (#13804) 2023-02-14 23:33:02 +08:00
mssonicbld
ab77eb5fce
[ci/build]: Upgrade SONiC package versions (#13782) 2023-02-11 21:42:56 +08:00
Liu Shilong
6741593e92 [build] Check if patches are applied before applying patches (#13386)
Why I did it
If make fails, we can't rerun the make process, because existing patches can't apply again.

How I did it
Check if patches are applied. if yes, don't apply patches again.

How to verify it
2023-02-02 22:32:43 +08:00
mssonicbld
f6cda03e84 [ci/build]: Upgrade SONiC package versions 2023-02-01 16:37:01 +08:00
selva
199661c216
[devices]: add support to Supermicro G3748 switches (#13420)
Why I did it
Enabled SONiC on Supermicro switch SSE G3748. This contains the code needed under "device" directory.

How I did it
As per the porting guide documentation posted in SONiC WiKi

How to verify it
Build SONiC with ARC=arm64 PLATFORM=marvell and download image from ONIE into Supermicro SSE G3748
2023-01-19 09:17:51 -08:00
Liu Shilong
5db68009ad
Fix sonic slave pipeline to set correct tag on sonic slave image. (#13177) (#13385) 2023-01-18 11:33:11 +08:00
mssonicbld
82f4a2628b
[ci/build]: Upgrade SONiC package versions (#13391) 2023-01-17 22:00:13 +08:00
mssonicbld
fa15a4504d
[ci/build]: Upgrade SONiC package versions (#13367) 2023-01-15 21:39:17 +08:00
mssonicbld
f2d4a1dae3
[ci/build]: Upgrade SONiC package versions (#13366) 2023-01-15 00:08:58 +08:00
Liu Shilong
b70bbbe318
[build] Fix sonic-host-services dependency deepdiff version issue (#13337)
Why I did it
sonic_host_services depends on deepdiff.
But latest deepdiff version has error.

How I did it
pin deepdiff to previous version.

How to verify it
2023-01-12 13:18:29 +08:00
xumia
fc0a64092a
[Ci] Remove the platform innovium from version auto upgrade pipeline (#13208)
Why I did it
[Ci] Remove the platform innovium from version auto upgrade pipeline

There is a build issue in the specific platform innovium, it blocks the upgrade job to run successfully, disable the version upgrade temporarily.

How I did it
Remove the upgrade job for innovium
2023-01-06 16:10:48 +08:00
mssonicbld
e9d5bb7952
[ci/build]: Upgrade SONiC package versions (#13201) 2022-12-30 06:44:21 +08:00
xumia
0e559e0c7a
[Build] Fix libyang build broken issue (#13162)
Why I did it
The libyang cannot be built with the latest version of cmake.
Example: https://dev.azure.com/mssonic/build/_build/results?buildId=181862&view=logs&j=993d6e22-aeec-5c03-fa19-35ecba587dd9&t=d0538dec-1681-5ff8-bd45-c0de13be9706

[ 96%] Building CXX object swig/python2/CMakeFiles/_yang2.dir/yangPYTHON_wrap.cxx.o
/sonic/src/libyang/libyang-1.0.73/build/swig/python2/yangPYTHON_wrap.cxx:3292:33: error: expected initializer before '.' token
 #  define SWIG_init    init_yang.so
                                 ^
/sonic/src/libyang/libyang-1.0.73/build/swig/python2/yangPYTHON_wrap.cxx:102537:1: note: in expansion of macro 'SWIG_init'
 SWIG_init(void) {
 ^~~~~~~~~
/sonic/src/libyang/libyang-1.0.73/build/swig/python2/yangPYTHON_wrap.cxx:101971:24: warning: 'swig_const_table' defined but not used [-Wunused-variable]
 static swig_const_info swig_const_table[] = {

See relative issue: #4315

How I did it
Not upgrade the cmake, change to use the dbus-python 1.2.18 which is compatible with cmake 3.13.4

How to verify it
See https://dev.azure.com/mssonic/build/_build/results?buildId=194756&view=results
2022-12-28 10:01:59 +08:00
mssonicbld
852d41ba95
[build][Bug]: Fix the command set_reproducible_mirrors not found issue (#10398) (#13173) 2022-12-26 15:55:18 +08:00
Liu Shilong
a3a704cf19
[build] Add retry when make SONiC image to improve success rate. (#12325) (#13131)
Why I did it
Makefile needs some dependencies from the Internet. It will fail for network related issue.
Retries will fix most of these issues.

How I did it
Add retries when running commands which maybe related with networking.

How to verify it
2022-12-23 18:51:43 +08:00
mssonicbld
64cc7c1b4f
[build] Fix issue between reproducible build and dood. (#11084) (#12845) (#13120) 2022-12-21 14:07:58 +08:00
xumia
35e3707aa2
[Build] Fix dbus-python installation issue in armhf (#12849)
Why I did it
Fix the python3 dbus-python installation issue in arm.

See https://dev.azure.com/mssonic/be1b070f-be15-4154-aade-b1d3bfb17054/_apis/build/builds/180980/logs/96

      
            CMake Error at CMakeLists.txt:1 (cmake_minimum_required):
              CMake 3.15 or higher is required.  You are running version 3.13.4
How I did it
Install the cmake package from buster-backports

How to verify it
Succeeded:

docker run --rm -it 8380970b72ea bash
sudo apt-get install -y -t buster-backports cmake
sudo pip3 install dbus-python
Where the docker image 8380970b72ea is the buster slave image in armhf.

Failed:

docker run --rm -it 8380970b72ea bash
sudo pip3 install dbus-python
2022-11-29 16:57:27 +08:00
mssonicbld
4d71dafc16
[ci/build]: Upgrade SONiC package versions (#12574) 2022-11-02 08:55:43 +08:00
xumia
ed20a6dec6 [Build][Bug] Fix apt-get remove version not lock issue (#12193)
Why I did it
Fix apt-get remove/purge version not locked issue when the apt-get options not specified.

How I did it
Add a space character before and after the command line parameters.
2022-11-01 18:54:28 +08:00
mssonicbld
56c41cbede
[ci/build]: Upgrade SONiC package versions (#12561) 2022-11-01 09:06:45 +08:00
Liu Shilong
5417aab4ec
[202106][ci] Cherry-pick PRs relative to reproducible build option from master branch. (#12350)
* [ci] Update azp template variable for reproducible build. (#11419)

* [ci] Disable reproducible build in master branch official build (#11452)

* [ci] Update reproducible build related pipeline. (#11810)

* [ci] Fix bug involved by PR 11810 which affect official build pipeline (#11891)

Why I did it
Fix the official build not triggered correctly issue, caused by the azp template path not existing.

How I did it
Change the azp template path.
2022-10-25 16:33:25 +08:00
xumia
1a0ced68f8
[202106] Change submodule path from Azure to sonic-net (#12311)
Why I did it
Change the path of sonic submodules that point to "Azure" to point to "sonic-net"

How I did it
Replace "Azure" with "sonic-net" on all relevant paths of sonic submodules
2022-10-13 23:30:54 +08:00
mssonicbld
148d38ed21
[ci/build]: Upgrade SONiC package versions (#12375) 2022-10-13 03:47:50 +08:00
mssonicbld
99133c5a7d
[actions] Add auto cherry-pick actions to release branch (#11496) (#12338)
* [actions] Add github actions to auto cherry-pick prs to release branches

* Add README, fix workflow

Co-authored-by: Liu Shilong <shilongliu@microsoft.com>
2022-10-10 17:24:27 +08:00
xumia
da545b23da
Fix dbus-run-session command not found issue when install dbus-python (#12009) (#12055)
Why I did it
Cherry-pick #12009, and fix code conflict.
Fix the dbus-pyhon installation failure when building docker-sonic-vs, caused by the command dbus-run-session not found.
The command "dbus-run-session" should be the new dependency introduced in dbus-python 1.3.2, the old version 1.2.18 does not have the issue.

How I did it
Install the dbus debian package which contains the command dbus-run-session.
It is not a blocking issue on release branches. The release branches with reproducible build feature can avoid such issue in official builds and PR builds, it only block the version upgrade (trying to upgrade from 1.2.18 to 1.3.2).
2022-09-26 20:43:11 +08:00
Liu Shilong
95df56b4ed
[ci] Update azp reference to support transfering organization from Azure to sonic-net (#11604) 2022-08-02 16:16:32 +08:00
Liu Shilong
1edac85362
[ci] Transfer organization from Azure to sonic-net for sonic-mgmt (#11559) (#11562)
Why I did it
Transfer organization from Azure to sonic-net for sonic-mgmt
2022-07-28 15:31:35 +08:00
Liu Shilong
bd51735a78
[ci] Fix test stage dependency issue. (#11386) (#11392)
Why I did it
When any of the test job failed in the test stage, the rerun will not work, the test stage will be skipped automaticall, so we do not have chance to rerun the test stage again, and the checks of the test will be always in failed status, block the PR to merge forever.

It should be caused by the condition in the Test stage, we should specify the status of the BuildVS stage.

How I did it
Fix stage dependency logic.
2022-07-11 19:03:38 +08:00
mssonicbld
2e5a24901f
[ci/build]: Upgrade SONiC package versions (#11373)
Upgrade SONiC Versions
2022-07-08 09:31:17 +08:00
xumia
0171c0e278
[Build] Add the missing debian security mirrors in slave images (#11305) (#11324)
Why I did it
The build below was broken, it was caused by one of the required debian mirror missing.
https://dev.azure.com/mssonic/build/_build/results?buildId=116719&view=logs&j=88ce9a53-729c-5fa9-7b6e-3d98f2488e3f&t=88f376cf-c35d-5783-0a48-9ad83a873284

 libpci-dev : Depends: libudev-dev (>= 196) but it is not going to be installed
 libsystemd-dev : Depends: libsystemd0 (= 232-25+deb9u14) but 232-25+deb9u13 is to be installed
How I did it
Add the missing mirrors for buster and stretch.
2022-07-05 09:23:16 +08:00
Liu Shilong
9fd9409590
[build] Add version files to docker image dependencies (#11193)
* [build] Add version files to docker image dependencies

* [ci] Support to skip vstest using include/exclude config file. (#11086)

example:
├── folderA
│  ├──  fileA (skip vstest)
│  ├──  fileB
│  └──  fileC
If we want to skip vstest when changing /folderA/fileA, and not skip vstest when changing fileB or fileC.

vstest-include:
^folderA/fileA

vstest-exclude:
^folderA
2022-06-22 14:13:08 +08:00
mssonicbld
8e331e077b
[ci/build]: Upgrade SONiC package versions (#10721)
Co-authored-by: mssonicbld <vsts@fv-az105-917.rmmgkgolfqletehdpj5nkpzfpa.ex.internal.cloudapp.net>
2022-06-19 12:46:22 +08:00
Shilong Liu
6ce393e3c0
[build] Add dependencies for sonic-config-engine to block bad PR. (#10770) (#11055)
Add dependencies device/* to sonic-config-engine
2022-06-17 15:44:53 +08:00
xumia
f9005e3dc0
[Build]: Support to use the base image version when a package version not specified (#10971) (#10975)
Why I did it
It is to fix issue: #10952
[Build]: Support to use the base image version when a package version not specified
2022-05-31 10:27:41 +08:00
Arun Saravanan Balachandran
6ebe5e6d50
[DellEMC S5248f] Remove duplicate ipmihelper.py (#10455)
Why I did it
To remove the ipmihelper.py in S5248f directory to prevent the image label being marked 'dirty', due to the file being replaced by the ipmihelper.py in common folder during build.

How I did it
Remove ipmihelper.py in S5248f directory.

How to verify it
Build a broadcom image and verify that the tracked files are not modified.

Which release branch to backport (provide reason below if selected)
 201811
 201911
 202006
 202012
 202106
 202111
Description for the changelog
DellEMC S5248f : Remove duplicate ipmihelper.py

Link to config_db schema for YANG module changes
A picture of a cute animal (not mandatory but encouraged)
2022-05-26 12:39:42 -07:00
Shilong Liu
a0ef7459f2
[ci] Add arm artifacts in common lib azure pipeline (#10891)
cherry-pick PR from master:
https://github.com/Azure/sonic-buildimage/pull/10817
2022-05-24 14:58:19 +08:00
Shilong Liu
76feaac0b6 [build] docker-sonic-mgmt replace USER by whoami (#9702) 2022-05-11 14:09:43 +08:00
Shilong Liu
0bbd384c9b Fix docker-sonic-mgmt reproducible related issue. (#9647)
Reproducible build script breaks docker-sonic-mgmt build.
2022-05-11 14:09:43 +08:00
Shilong Liu
7d5e7119f7 [ci] Support multi tags when pushing docker image (#10771) 2022-05-11 14:09:43 +08:00
mssonicbld
2b0bfe766f
[ci/build]: Upgrade SONiC package versions (#10661) 2022-04-30 19:06:09 +00:00
xumia
3e29919b3a
[Build]: Fix the buster slave not built issue when building configure (#10696)
Why I did it
[Build]: Fix the buster slave not built issue when building configure

When running build command "make configure", we can expect the buster slave will be built.
2022-04-28 16:13:21 +08:00
Shilong Liu
7a3e2c19b1
[submodule] Update submodule for sonic-mgmt-common (#10672) 2022-04-28 13:41:04 +08:00
xumia
32dbd3da04 [Build]: Fix host image debian package version issue (#10358)
Why I did it
Fix host image debian package version issue.
The package dependencies may have issue, when some of debian packages of the base image are upgraded. For example, libc is installed in base image, but if the mirror has new version, when running "apt-get upgrade", the package will be upgraded unexpected. To avoid such issue, need to add the versions when building the host image.

How I did it
The package versions of host-image should contain host-base-image.
2022-04-28 03:26:49 +00:00
xumia
e54cc71a16 Fix armhf version issue (#9382)
Why I did it
Fix some of the version files not used issue.
One of example version file version-py3-all-armhf, when building marvell-armhf, the version is used as expected, but it not use.
2022-04-28 03:26:40 +00:00
xumia
0cc75ce5f4
[Submodule]: update submodule for sonic-restapi (#10681)
Why I did it
Update submodule sonic-restapi
e83e0e8 Fix Ctype_char larger than address space issue in 32-bit armhf (#107)
2022-04-27 07:15:52 +08:00
Shilong Liu
56bccb6478
[ci] Add azure pipeline to build common libs. (#10367) (#10688)
Why I did it
To remove reference on Azure.sonic-buildimage artifacts.
Azure.sonic-buildimage has a higher failure rate.
2022-04-27 00:13:16 +08:00
xumia
f9f2235827
[Submodule]: Update submodule for sonic-telemetry (#10667)
Why I did it
Update sonic-telemetry submodules (to fix CVE-2021-3121 alert).

e56e9b4 Fix CVE-2021-3121 warning (#96)
bf1be4f [ci]: Support code diff coverage threshold 50% (#94)
64e516c Ported Marvell armhf build on x86 for debian buster to use cross-compilation instead of qemu emulation (#80)
e426388 [ci]: Support azp code coverage (#87)
0443e66 Remove DB Directory removal as part of make clean (#84)
085f29d Fix unhandled nil err check to prevent rpc causing a crash (#78)
2022-04-26 07:28:18 +08:00