Commit Graph

62 Commits

Author SHA1 Message Date
Liu Shilong
1e812cd990
[ci] Update azp reference to support transfering organization from Azure to sonic-net (#11605)
Why I did it
When transfer repo to another organization, azp reference also need change.
Change azp reference to avoid pipeline failure.
2022-08-02 16:22:26 +08:00
Ying Xie
84a8bad821
[202012][prtest] use matching sonic-mgmt branch for 202012 branch PR tests (#11575)
Why I did it
202012 PR test is failing due to some recent change in sonic-mgmt master branch.

How I did it
Use matching sonic-mgmt branch to run 202012 branch PR tests.

How to verify it
this PR test.

Signed-off-by: Ying Xie ying.xie@microsoft.com
2022-07-29 11:09:12 -07:00
xumia
14f67b130d [ci] Fix some not sai package removed issue (#11544)
Only replace the file name starts with "cisco-".
2022-07-27 23:28:15 +00:00
Liu Shilong
54de99ba23
[build] Add version files to docker image dependencies (#11192)
* [build] Add version files to docker image dependencies

* [ci] Support to skip vstest using include/exclude config file. (#11086)

example:
├── folderA
│  ├──  fileA (skip vstest)
│  ├──  fileB
│  └──  fileC
If we want to skip vstest when changing /folderA/fileA, and not skip vstest when changing fileB or fileC.

vstest-include:
^folderA/fileA

vstest-exclude:
^folderA
2022-06-21 20:28:50 +08:00
Shilong Liu
4f19945b48
[ci] Enable default ACR in official/PR/UpgradeVersion pipelines. (#11052) 2022-06-09 15:58:39 +08:00
xumia
1a6cb0f409 [Ci]: Fix the target directory not empty issue when publishing artifacts #10972
Why I did it
Fix the target directory not empty issue when publishing artifacts.
Some of the artifacts are published to $(Build.ArtifactStagingDirectory)/target/ before source code checked out.
2022-06-08 01:21:49 +00:00
Saikrishna Arcot
3289598ea4
Split kvmtest t0 job into two jobs and run in parallel (#10044) (#10858)
Why I did it
Introduce 2 sub jobs for kvmtest t0 job in sonic-mgmt repo in PR Azure/sonic-mgmt#4861
But in sonic-buildimage repo, because section parameter is null, it always run the part 2 test scripts in kvmtest t0 job.
It missed the part 1 test scripts in kvmtest.sh.

How I did it
Split kvmtest t0 job into two sub jobs such as sonic-mgmt repo and run them in parallel to save time.

How to verify it
Submit PR will trigger the pipeline to run.

Signed-off-by: Zhaohui Sun <zhaohuisun@microsoft.com>
(cherry picked from commit 44028723ef)

Co-authored-by: Zhaohui Sun <94606222+ZhaohuiS@users.noreply.github.com>
2022-06-03 09:39:30 -07:00
Shilong Liu
5d2ae332d4
[ci] Add arm artifacts in common lib azure pipeline (#10892) 2022-06-03 12:20:49 +08:00
xumia
455d44efea [Ci]: Fix to trigger the publish pipeline in failure build issue (#10847)
Why I did it
It is not necessary to trigger the publish pipeline when build is failed.

How I did it
Remove the condition in the azp task, change to use template condition.
2022-05-24 23:14:29 +00:00
xumia
f6a52e31ec [Ci] Support to trigger a pipeline to download and publish artifacts to storage (#10820)
Why I did it
Support to trigger a pipeline to download and publish artifacts to storage and container registry.
Support to specify the patterns which docker images to upload.

How I did it
Pass the pipeline information and the artifact information by pipeline parameters to the pipeline which will be triggered a new build. It is to decouple the artifacts generation and the publish logic, how and where the artifacts/docker images will be published, depends on the triggered pipeline.

How to verify it
2022-05-16 23:28:06 +00:00
Shilong Liu
5779a92d99
[ci] Fix PR checker archieve artifacts step (#9357) (#10652)
Why I did it
When a failed job retry. Publish artifact will fail for duplicated name
2022-04-23 13:57:50 +08:00
xumia
55a6faf925 [Ci]: Support to sign image for cisco-8000 uefi secure boot (#10616)
Why I did it
[Ci]: Support to sign image for cisco-8000 uefi secure boot
2022-04-21 22:00:47 +00:00
Qi Luo
3fa538e58c
Revert "[ci] Set default ACR in UpgrateVersion/PR/official pipeline. (#10341)" (#10535)
This reverts commit f4bbcd1cf1. The original one was missing one file ".azure-pipelines/azure-pipelines-repd-build-variables.yml" and break the Azure pipeline.
2022-04-11 23:53:42 -07:00
xumia
fc727f0538 [Ci]: check if there is a sonic dirty version issue (#10445)
Why I did it
[Ci]: check if there is a sonic dirty version issue
If there is a dirty version issue in PR build, the build will be failed.
2022-04-11 23:10:06 +00:00
Shilong Liu
f4bbcd1cf1 [ci] Set default ACR in UpgrateVersion/PR/official pipeline. (#10341)
Why I did it
docker hub will limit the pull rate.
Use ACR instead to pull debian related docker image.

How I did it
Set DEFAULT_CONTAINER_REGISTRY in pipeline.
2022-04-08 11:19:10 +08:00
Lawrence Lee
a081d04807 [azp]: Fix type in slave container cleanup (#10424)
Signed-off-by: Lawrence Lee <lawlee@microsoft.com>
2022-04-03 18:20:04 +00:00
Shilong Liu
1c24f2e9df [ci] Add azure pipeline to build common libs. (#10367)
Why I did it
To remove reference on Azure.sonic-buildimage artifacts.
Azure.sonic-buildimage has a higher failure rate.
2022-03-31 20:39:49 +08:00
Shilong Liu
5b22cba8ca [build] Fix issues found in reproducible build. (#10407) 2022-03-31 20:39:49 +08:00
Shilong Liu
615b0d8d1b [ci] Use template from master branch in UpgrateVersion/sonic-slave pipeline (#10380) 2022-03-31 20:39:49 +08:00
Shilong Liu
f0000efff1 [ci] Fix remove sonic-slave-* docker image issue when building sonic-slave* (#10296) 2022-03-31 20:39:49 +08:00
Shilong Liu
491562b74b
[ci] Fix remove sonic-slave-* docker image issue when building sonic-slave* (#10296) (#10378) 2022-03-30 16:08:32 +08:00
xumia
db3c695bf1 [Build][Ci]: Support to use the cisco sai packages built by azp (#10102)
Why I did it
Support to use the cisco sai packages built by azp
2022-03-08 02:17:16 +00:00
xumia
6a6512246d
[Bug][Build]: fix the file not found issue caused by the relative path (#9450)
#### Why I did it
Merged from master branch: https://github.com/Azure/sonic-buildimage/pull/9443
Fix the nodesource.list cannot read issue, it is cased by the full path not used.

```
2021-12-03T06:59:26.0019306Z Removing intermediate container 77cfe980cd36
2021-12-03T06:59:26.0020872Z  ---> 528fd40e60f6
2021-12-03T06:59:26.0021457Z Step 81/81 : RUN post_run_buildinfo
2021-12-03T06:59:26.0841136Z  ---> Running in d804bd7e1b06
2021-12-03T06:59:29.1626594Z DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.
2021-12-03T06:59:34.2960105Z /usr/bin/sed: can't read nodesource.list: No such file or directory
2021-12-03T06:59:34.5094880Z The command '/bin/sh -c post_run_buildinfo' returned a non-zero code: 2
```
2021-12-07 23:42:33 -08:00
xumia
05351731d5
[Build]: Enable arm pr check #9362
Support marvell-armhf dpkg cache and the azp check.
Waiting for merging PR #9381 to 202012 branch, so only azp template change in this PR.

Move the VS build to a new stage BuildVS, change the Test stage only depending on BuildVS, running the BuildVS and the other platform's build in parallel. The Test stage do not has dependency on the marvel-armhf build, reduce the overall build time caused by longer build time of marvel-armhf build.
2021-12-04 09:31:53 +08:00
Shilong Liu
4533e64fb4 [CI] Fix Azure pipeline set -e not work. (#9282)
In azure pipeline template 'set -e' not works as expected.
2021-11-20 00:45:00 +00:00
Guohan Lu
bf1ed42588 [ci]: build centec arm64 to sonicbld-arm64 pool
Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-10-29 09:10:13 -07:00
xumia
027a35d7e5
[ci]: Change to build marvell-armhf on armhf pool (#8467) 2021-10-25 07:38:18 -07:00
xumia
967d8abe07 Fix failed to download cisco artifacts issue (#8942)
Why I did it
Fix the failure to download cisco artifacts issue
2021-10-15 00:40:10 +00:00
xumia
63037a20f9 [ci]: Support azp for cisco 8000 (#8654)
Why I did it
Setup Azure pipeline for cisco 8000.
2021-10-12 09:23:55 +00:00
Shilong Liu
040d5f343d Add pipeline to build vhdx image. (#8665)
* Add pipeline to build vhdx image
2021-10-06 09:04:57 -07:00
Shilong Liu
5ea763f60a Fix azp pipeline file which is involved by former PR (#8616) 2021-08-30 10:55:16 +08:00
Shilong Liu
6b69ddc861 [build] Fix reproducible build issues (#8548)
* [build] Fix reproducible build issues
2021-08-26 10:22:02 +00:00
Shilong Liu
7aad616832
[build]: Enable reproducible build for git docker (#8331) 2021-08-04 09:59:02 -07:00
Shilong Liu
a90280faa5
Add auto-version-upgrade for arm image (#8244) 2021-07-22 19:39:56 +08:00
Shilong Liu
770e055358 Enable reproducible build in base docker image sonic-slave-* (#8116) 2021-07-13 05:14:06 +00:00
xumia
568def48cf
Disable nephos docker syncd rpc temporarily (#8015)
Why I did it
Disable the nephos docker syncd rpc image temporarily
2021-06-30 18:25:55 +08:00
Guohan Lu
7d14a60620 [ci]: bump up build timeout to 48 hours for armhf and arm64
Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-06-22 09:49:49 -07:00
xumia
d47a035852 [ci]: build rpc image for mellanox (#7905) 2021-06-21 10:04:49 +00:00
Shilong Liu
be7bd73bbb [CI] Fix azp targets for innovium platform (#7870)
There is no rule to build swi target. The correct target is *.bin.
2021-06-21 09:55:14 +00:00
Myron Sosyak
bfa8549f9b [BFN] Add missed param for syncd-rpc build (#7792)
To fix syncd-rpc build for BFN paltform
2021-06-21 09:09:03 +00:00
Qi Luo
8b7091ff51 Revert some mistakenly merged/pushed code
* Revert "fix"

This reverts commit 93585b0a0a.

* Revert "Version control git (#6562)"

This reverts commit 52b87753db.

* Revert "Revert "[files/build/versions]: support reproduceable build for git (#5774)""

This reverts commit 1cb8daf585.

* Revert "[files/build/versions]: support reproduceable build for git (#5774)"

This reverts commit 547aa9b2c7.
2021-06-21 06:35:54 +00:00
Shilong Liu
93585b0a0a fix 2021-06-18 13:38:13 +08:00
Guohan Lu
fa321f182c [ci]: set -ex for official build to exit on any build failures
Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-06-15 17:32:07 +08:00
Myron Sosyak
b65b59c1b5 [BFN] Enable syncd-rpc build (#7646)
Why I did it
To enable syncd-rpc for Barefoot build

How I did it
Set the flag

How to verify it
ENABLE_SYNCD_RPC=y make configure PLATFORM=barefoot
ENABLE_SYNCD_RPC=y make all
2021-06-03 12:13:42 +00:00
novikauanton
556bb62db4
added barefoot to job filters (#7771)
Build failed with error "Failed to verify the package"
The reason of the fail is version verification
Version manager didn't find dependencies for the barefoot platform
2021-06-02 09:18:00 +08:00
xumia
dc6d5a78b9
Fix old versions not cleanup issue (#7575)
Why I did it
Fix some of the versions in files/build/versions folder not cleanup issue when generating new version configuration.
2021-05-11 23:01:15 +08:00
Guohan Lu
9d5b899452 [ci]: enable sonic-slave build on 202012 branch
Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-05-05 07:31:27 -07:00
Shilong Liu
90bcc51203 [CI] Add Bldenv pipeline files (#7458)
Add 3 pipeline files:

- pipeline for build docker image sonic-slave-[buster|jessie|stretch] for amd64/armhf/arm64, and push to ACR(sonicdev-microsoft.com)
- pipeline for build docker image sonic-mgmt, and push to ACR
- pipeline for cleaning dpkg cache which are created more than 30 days.

Co-authored-by: lguohan <lguohan@gmail.com>
2021-05-05 07:30:39 -07:00
Guohan Lu
7841b7513c [ci]: change timeout to 36 hours for armhf/arm64 build
Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-05-05 07:30:07 -07:00
Guohan Lu
a0575a7790 [ci]: increase official build to 12 hours
10-hour limit is not enough to finish several jobs.

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-05-05 07:11:59 -07:00