Commit Graph

5960 Commits

Author SHA1 Message Date
Konstantin Vasin
7a8717073e [Build] update python package docker in host image to 6.1.1 (#14993)
Fix #14974
Refs: https://github.com/docker/docker-py/pull/3116
2023-05-19 16:32:39 +08:00
Liu Shilong
6efb96c040
Clear /etc/resolv.conf before building image (#12592) (#15104)
Cherry pick PR#12592

Why I did it
nameserver and domain entries from build system fsroot gets into sonic image.

How I did it
Clear /etc/resolv.conf before building image

How to verify it
Built image with it and verified with install that /etc/resolv.conf is empty

Co-authored-by: Devesh Pathak <54966909+devpatha@users.noreply.github.com>
2023-05-18 14:47:17 -07:00
mssonicbld
7ec9a1f6f1
[ci/build]: Upgrade SONiC package versions (#14924) 2023-05-04 00:16:43 +08:00
mssonicbld
c4c7f497b2
[ci/build]: Upgrade SONiC package versions (#14890) 2023-04-29 22:58:32 +08:00
mssonicbld
220d87eb54
[ci/build]: Upgrade SONiC package versions (#14811) 2023-04-23 22:40:00 +08:00
mssonicbld
7ce9a7f3bb
[ci/build]: Upgrade SONiC package versions (#14802) 2023-04-22 23:59:41 +08:00
mssonicbld
98d6c46ce0
[ci/build]: Upgrade SONiC package versions (#14721) 2023-04-19 23:29:42 +08:00
mssonicbld
3a2c16c5dd [ci/build]: Upgrade SONiC package versions 2023-04-19 06:32:08 +08:00
xumia
40780c072e
[Build][202111] Support Debian snapshot mirror to improve build stability (#14664)
Why I did it
Cherry-pick commits from master to support the snapshot based mirror, and fix the code conflicts.

ad162ae [Build] Optimize the version control for Debian packages (#14557)
38c5d7f [Build] Support j2 template for debian sources for docker ptf (#13198)
5e4826e [Ci] Support to use the same snapshot for all platform builds (#13913)
8206925 [Build] Change the default mirror version config file (#13786)
5e4a866 [Build] Support Debian snapshot mirror to improve build stability (#13097)
ac5d89c [Build] Support j2 template for debian sources (#12557)

Work item tracking
Microsoft ADO (number only): 18018114
How I did it
How to verify it
2023-04-18 14:32:31 +08:00
mssonicbld
0e5a2b9b3e
[ci/build]: Upgrade SONiC package versions (#14682) 2023-04-16 23:16:36 +08:00
mssonicbld
cbb77909c1
[ci/build]: Upgrade SONiC package versions (#14675) 2023-04-16 01:23:12 +08:00
mssonicbld
cb21b2126e
Pin mmh3 package version in sonic-slave-stretch docker (#14463) (#14470)
Why I did it
mmh3's new version 3.1.0 breaks pipeline build.
bullseye/buster/jessie pined the version to 2.5.1

How I did it
Pin mmh3's version as other dists.

How to verify it

Co-authored-by: Liu Shilong <shilongliu@microsoft.com>
2023-04-14 18:42:14 +08:00
Ravi [Marvell]
c73b81eb95
Add platform files for Innovium platform (#12652)
Why I did it
Add platform files for critical processes and default qos config for Innovium platforms

How I did it
Added default files for critical processes and qos config

How to verify it
Tested with autorestart/test_container_autorestart.py::test_containers_autorestart

Signed-off-by: rck-innovium rck@innovium.com
2023-03-30 11:33:51 -07:00
Liu Shilong
969de02c62
[ci] Fix build issue for vs vhdx image. #14426
Why I did it
sonic-slave-stretch build failed for mmh3 version update to 3.10 on Mar 24.

How I did it
Enable reproducible build for vhdx image.

How to verify it
2023-03-29 16:13:01 +08:00
Liu Shilong
502fe49ae9 [ci] Fix build issue for vs vhdx image. #14427
Why I did it
sonic-slave-stretch build failed for mmh3 version update to 3.10 on Mar 24.

How I did it
Enable reproducible build for vhdx image.

How to verify it
2023-03-28 20:53:23 +08:00
mssonicbld
fb319b4b36
[ci/build]: Upgrade SONiC package versions (#14315) 2023-03-19 23:09:51 +08:00
mssonicbld
a86de8aee1 [ci/build]: Upgrade SONiC package versions 2023-03-18 09:51:33 +08:00
Liu Shilong
8b8b6bd2b7 [build] Fix unexpected warnings: No names found, cannot describe anything. (#12963)
Why I did it
In PR check pipelines, there are too many duplicated warnings:
fatal: No names found, cannot describe anything.
SONIC_IMAGE_VERSION will not change in one build. We don't need to calculate in every reference. We just need calculate one time, then record it.
In Makefile, '=' will calculate again and again when it is referred.

How I did it
Fix it in Makefile.

How to verify it
Check this PR's check pipeline result.
2023-03-10 18:37:35 +08:00
mssonicbld
19e86f9f60
[ci/build]: Upgrade SONiC package versions (#14082) 2023-03-05 10:04:08 +08:00
mssonicbld
a86cadf13c
[ci/build]: Upgrade SONiC package versions (#13944) 2023-02-27 02:09:19 +08:00
mssonicbld
5ae5c053fc [ci/build]: Upgrade SONiC package versions 2023-02-22 22:33:20 +08:00
Liu Shilong
041dc55eb5 [ci] Fix docker hang issue and change template reference branch (#13894)
Why I did it
Azure pipeline change.
Use common template to make it easy to change common steps.
Fix docker hang issue.

How I did it
2023-02-22 20:55:37 +08:00
Liu Shilong
9d20dda40a
[ci] Kill hanged docker build process to avoid build timeout issue. (#13726) (#13597)
Why I did it
Docker build has a low rate of hanging up.
It hangs on different steps. So, it looks like a bug in docker daemon.

How I did it
Start a daemon process to scan running time more than 1 hours, and kill the process.

How to verify it
2023-02-22 13:15:53 +08:00
Liu Shilong
0798518244 [build] Check if patches are applied before applying patches (#13386)
Why I did it
If make fails, we can't rerun the make process, because existing patches can't apply again.

How I did it
Check if patches are applied. if yes, don't apply patches again.

How to verify it
2023-02-03 04:32:32 +08:00
jcaiMR
ed63f92b34
[202111] fix relay-reply dhcpv6 packet counter issue 2023-01-30 17:35:55 -08:00
Liu Shilong
f1f42c9a6a
Fix sonic slave pipeline to set correct tag on sonic slave image. (#13177) (#13384) 2023-01-18 11:32:19 +08:00
Liu Shilong
09aa92ef5b
[build] Fix sonic-host-services dependency deepdiff version issue (#13336)
Why I did it
sonic_host_services depends on deepdiff.
But latest deepdiff version has error.

How I did it
pin deepdiff to previous version.

How to verify it
2023-01-16 11:09:24 +08:00
Liu Shilong
7ca8c9a50a [build] Fix issue between reproducible build and dood. (#11084) (#12845) 2023-01-07 00:43:17 +08:00
mssonicbld
5275cf79a4
[ci/build]: Upgrade SONiC package versions (#13149) 2022-12-29 01:49:40 +08:00
Liu Shilong
e858dc0f40
[build] Add retry when make SONiC image to improve success rate. (#12325) (#13129)
Why I did it
Makefile needs some dependencies from the Internet. It will fail for network related issue.
Retries will fix most of these issues.

How I did it
Add retries when running commands which maybe related with networking.

How to verify it
2022-12-23 18:51:33 +08:00
mssonicbld
bbbc3f5c1c
[ci/build]: Upgrade SONiC package versions (#13096) 2022-12-19 00:39:24 +08:00
mssonicbld
6afa83a9a6
[ci/build]: Upgrade SONiC package versions (#13094) 2022-12-18 00:48:26 +08:00
mssonicbld
78900d83d2
[ci/build]: Upgrade SONiC package versions (#13019) 2022-12-12 01:40:02 +08:00
mssonicbld
1b1a534304
[ci/build]: Upgrade SONiC package versions (#12886) 2022-12-06 02:05:15 +08:00
mssonicbld
bc3781df8c
[ci/build]: Upgrade SONiC package versions (#12839) 2022-11-28 01:46:22 +08:00
mssonicbld
9f65069cfb
[ci/build]: Upgrade SONiC package versions (#12815) 2022-11-26 03:17:39 +08:00
xumia
d455db672a
Fix error handling when failing to install a deb package (#11846) (#12777)
Cherry-pick PR: #11846

Signed-off-by: Saikrishna Arcot sarcot@microsoft.com

Why I did it
The current error handling code for when a deb package fails to be
installed currently has a chain of commands linked together by && and
ends with exit 1. The assumption is that the commands would succeed,
and the last exit 1 would end it with a non-zero return code, thus
fully failing the target and causing the build to stop because of bash's
-e flag.

However, if one of the commands prior to exit 1 returns a non-zero
return code, then bash won't actually treat it as a terminating error.
From bash's man page:

-e      Exit immediately if a pipeline (which may consist of a single simple
	command), a list, or a compound command (see SHELL GRAMMAR above),
        exits with a non-zero status.  The shell does not exit if the
        command that fails is part of the  command  list  immediately
        following a while or until keyword, part of the test following the
        if or elif reserved words, part of any command executed in a && or
        || list except the command following the final && or ||, any
        command in a pipeline but the last, or if the command's return
        value is being inverted with !.  If a compound command other than a
        subshell returns a non-zero status because a command failed while
        -e was being ignored, the shell does not exit.
The part part of any command executed in a && or || list except the command following the final && or || says that if the failing command
is not the exit 1 that we have at the end, then bash doesn't treat it
as an error and exit immediately. Additionally, since this is a compound
command, but isn't in a subshell (subshell are marked by ( and ),
whereas { and } just tells bash to run the commands in the current
environment), bash doesn't exist. The result of this is that in the
deb-install target, if a package installation fails, it may be
infinitely stuck in that while-loop.

This was seen when the snmpd package upgrade happened, and
builds were failing to install the mismatching libsnmp-dev package,
the builds did not immediately terminate; instead, the installation
was retried again and again, suggesting it was stuck in some infinite
loop. The build jobs finally terminated only because of the timeout
specified for the jobs.

How I did it
There are two fixes for this: change to using a subshell, or use ;
instead of &&. Using a subshell would, I think, require exporting any
shell variables used in the subshell, so I chose to change the && to
;. In addition, at the start of the subshell, set +e is added in,
which removes the exit-on-error handling of bash. This makes sure that
all commands are run (the output of which may help for debugging) and
that it still exits with 1, which will then fully fail the target.

How to verify it
2022-11-24 09:37:15 +08:00
mssonicbld
a980784e91
[ci/build]: Upgrade SONiC package versions (#12693) 2022-11-21 01:26:43 +08:00
Ravindranath C K
66b6c212fc
[Innovium] Backport platform fixes from master (#12526)
Syncd container restart for Innovium:
   https://github.com/sonic-net/sonic-buildimage/pull/11497

 Innovium platform shell
   https://github.com/sonic-net/sonic-buildimage/pull/11845

Signed-off-by: rck-innovium rck@innovium.com
2022-11-04 11:29:05 -07:00
mssonicbld
10c12e12e4
[ci/build]: Upgrade SONiC package versions (#12586) 2022-11-03 02:39:43 +08:00
mssonicbld
7c13f90b59
[ci/build]: Upgrade SONiC package versions (#12552) 2022-10-31 01:24:53 +08:00
mssonicbld
17d9e21e76
[ci/build]: Upgrade SONiC package versions (#12548) 2022-10-29 02:39:20 +08:00
judyjoseph
ba3326088c
Update sonic-swss submodule with (#12521)
7f24448 [202111] cherrypick ACL fixes (#2298) and (#2351) (#2497)
2022-10-28 08:37:30 -07:00
mssonicbld
c500f5d476
[action] Use github code scan instead of LGTM. (#12402) (#12506) 2022-10-27 00:53:49 +08:00
xumia
01f8c0185b
[202111] Change submodule path from Azure to sonic-net (#12309)
Why I did it
Change the path of sonic submodules that point to "Azure" to point to "sonic-net"

How I did it
Replace "Azure" with "sonic-net" on all relevant paths of sonic submodules
2022-10-26 16:29:12 +08:00
Liu Shilong
28751cec56 [ci] Fix bug involved by PR 11810 which affect official build pipeline (#11891)
Why I did it
Fix the official build not triggered correctly issue, caused by the azp template path not existing.

How I did it
Change the azp template path.
2022-10-26 08:22:31 +08:00
Liu Shilong
fc9dee41a2 [ci] Update reproducible build related pipeline. (#11810) 2022-10-26 08:22:31 +08:00
Liu Shilong
acfb23653e [ci] Disable reproducible build in master branch official build (#11452) 2022-10-26 08:22:31 +08:00
Liu Shilong
cb4ac4285d [ci] Update azp template variable for reproducible build. (#11419) 2022-10-26 08:22:31 +08:00
mssonicbld
45b403d71d
[ci/build]: Upgrade SONiC package versions (#12422) 2022-10-18 13:57:10 +08:00