Commit Graph

2461 Commits

Author SHA1 Message Date
lguohan
f4fdf310b9
[build] Fix the snmp docker build error. (#7452) (#7459)
* [build] Fix the snmp docker build error. (#7452)

Issue is get_pip.py is moved to pip 21.1 (https://github.com/pypa/get-pip/commits/main) which is not compatible with 3.6.
Issue of pip itself is fixed as part of 21.1.1 in pip community (pypa/pip#9835).
However get-pip.py is still not updated to latest pip. Also get.pip.py does not support python 3.6 version explicitly (pypa/get-pip#88)

Step 15/29 : RUN curl https://bootstrap.pypa.io/get-pip.py | python3.6
 ---> Running in bece31f49267
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 1891k  100 1891k    0     0  9564k      0 --:--:-- --:--:-- --:--:-- 9600k
Traceback (most recent call last):
  File "<stdin>", line 24298, in <module>
  File "<stdin>", line 139, in main
  File "<stdin>", line 115, in bootstrap
  File "<stdin>", line 96, in monkeypatch_for_cert
  File "/tmp/tmp5fnxrz0a/pip.zip/pip/_internal/commands/__init__.py", line 9, in <module>
  File "/tmp/tmp5fnxrz0a/pip.zip/pip/_internal/cli/base_command.py", line 12, in <module>
  File "/tmp/tmp5fnxrz0a/pip.zip/pip/_internal/cli/cmdoptions.py", line 30, in <module>
  File "/tmp/tmp5fnxrz0a/pip.zip/pip/_internal/utils/hashes.py", line 2, in <module>
ImportError: cannot import name 'NoReturn'
The command '/bin/sh -c curl https://bootstrap.pypa.io/get-pip.py | python3.6' returned a non-zero code: 1
How I did:

Got the file from https://github.com/pypa/get-pip/tree/21.0 and added to the buildimage
pin pip to the previous release 21.0.1. (Similar is done in other public repos eg: grpc/grpc-java#8115)

Signed-off-by: Abhishek Dosi <abdosi@microsoft.com>
2021-04-28 23:08:26 -07:00
Ying Xie
b8137369c7
[device] add phy_an_lt_msft to permitted list (#7390)
Why I did it
201811 build was failing due to the newly added bcm config file key word was not on the permitted list

How I did it
add phy_an_lt_msft to permitted list.

How to verify it
Build device package.

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-04-20 21:37:50 -07:00
Joe LeVeque
4a3324b73e
[201811] Add SOC property to enable AN/LT on some platforms (#7388)
Why I did it
To enable autonegotiation/link training on some Broadcom-based platforms (Arista 7060 and 7260, Celestica DX010)

How I did it
Add appropriate SOC property for enabling the feature to the Broadcom config files of appropriate platforms
Also convert line endings to UNIX format for one Celestica file
2021-04-20 18:56:45 -07:00
Ying Xie
fa036c0ead
[201811][bcm sai] ugprade Broadcom SAI to 3.5.3.7-2 (#7385)
* 1d588e38 2021-03-25 | Pending changes for CS00011808451 (bcm_sai/REL_3.5.3, INT_3.5) [BrcmSAI]
* 53efbe91 2021-03-18 | Fix for CS00011810218 [BRCM-DevOps]
* ca0dc86c 2021-03-11 | Fix for CS00011808451 (msazure/INT_3.5, bcm_sai/REL_3.5.3, INT_3.5) [BrcmSAI]
* 208ea62e 2021-01-08 | Update changelog [BRCM-DevOps]
* 3961673c 2021-01-08 | Update version after sdk patch and egress obj leak fixes. [BRCM-DevOps]
* ce3818ad 2021-01-08 | Fix for CS00011581499 [BrcmSAI]
* 1e06157f 2021-01-08 | Merged SDk patch for CS00011651922 [BrcmSAI]
* 4d0c2c86 2021-04-06 | Merged PR 4328641: Add support for AN/LT (HEAD -> 3.5-201811, msazure/3.5-201811) [Joe LeVeque]

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-04-20 15:49:14 -07:00
Ying Xie
98c3bd757b
[201811][utilities] advance utilities submodule head (#7373)
* 72510da 2021-04-19 | [201811] Stop PMON docker before cold boot and soft reboot (#1515) (HEAD -> 201811, github/201811) [Aravind Mani]

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-04-20 15:33:46 -07:00
abdosi
a5b9abcd4b [201911] Fix easy_install error when installing pip (#7272)
see below error:

+ sudo https_proxy= LANG=C chroot ./fsroot easy_install pip==20.3.3
Searching for pip==20.3.3
Reading https://pypi.python.org/simple/pip/
Couldn't find index page for 'pip' (maybe misspelled?)
Scanning index of all packages (this may take a while)
Reading https://pypi.python.org/simple/
No local packages or working download links found for pip==20.3.3
error: Could not find suitable distribution for Requirement.parse('pip==20.3.3')

How I fix:

Install python-pip via apt-get
Pin the version to 20.3.3
Master has same changes.

Signed-off-by: Abhishek Dosi <abdosi@microsoft.com>
2021-04-16 00:09:13 +00:00
Ying Xie
ae401ff92a
[201811][utilities] advance submodule head (#7280)
Utilities:
* c96f19d 2021-04-08 | [load_minigraph]: Avoid starting PFCWD for EPMS devicetype (#1552) (HEAD -> 201811, github/201811) [Sumukha Tumkur Vani]

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-04-09 19:07:33 -07:00
Sumukha Tumkur Vani
b6ca3bd5bb
add EPMS devicetype (#7255) 2021-04-09 12:44:31 -07:00
Ying Xie
273f99d0e5
[201811][utilities] advance submodule head (#7266)
* d58ba82 2021-04-05 | Fix fast-reboot fdb filtering for IPv6 addresses (#1548) (github/201811) [Vaibhav Hemant Dixit]
* cc7ad9e 2021-03-24 | Fast reboot: check if the files are present before accessing (#1526) [Vaibhav Hemant Dixit]
* 410323a 2021-03-24 | [201811] Add missing variable DEVPATH to fast-reboot script (#1525) [Vaibhav Hemant Dixit]
* eb5023a 2021-03-21 | [201811] soft-reboot (#1487) [Sujin Kang]
* 3f10540 2020-12-08 | [fast-reboot] Fix fast-reboot when NDP entries are present (#1295) (HEAD -> 201811) [shlomibitton]

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-04-08 18:57:05 -07:00
Ying Xie
d2b9b1ec0c [Arista] add MMU configuration for Arista 7260 C64 (#7027)
Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-04-08 16:29:19 +00:00
Nazarii Hnydyn
72c506061c
[Mellanox] Improve FW upgrade logging: add syslog logger (#7221)
Basically mlnx-fw-upgrade.sh is used in two places:
1. https://github.com/Azure/sonic-buildimage/blob/201811/files/scripts/syncd.sh#L109
```bash
        /usr/bin/mst start
        /usr/bin/mlnx-fw-upgrade.sh
        /etc/init.d/sxdkernel start
        /sbin/modprobe i2c-dev
```
2. https://github.com/Azure/sonic-buildimage/blob/201811/device/mellanox/x86_64-mlnx_msn2700-r0/platform_reboot#L32
```bash
ParseArguments "$@"

${FW_UPGRADE_SCRIPT} --upgrade --verbose
EXIT_CODE="$?"
```

In first case the `stdout` is redirected to `syslog` directly by `systemd`.
Thus, the `syslog` logger is only required in second case.

#### Why I did it
* To improve ASIC/CPLD FW upgrade logging
* To improve CPLD upgrade time

#### How I did it
* Added `syslog` logger support
* Replaced `_pciconf0` -> `_pci_cr0` to reduce CPLD upgrade time

#### How to verify it
1. mlnx-fw-upgrade.sh --upgrade
2021-04-07 10:57:12 -07:00
Ying Xie
161bca602f
[202018][utilities] set the utilities submodule head properly (#7079)
Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-03-18 13:58:11 -07:00
Joe LeVeque
93fbb8fd96
[201811][sonic-config-engine] Parse AutoNegotiation element from LinkMetadata section of minigraph file (#7048)
Backport of https://github.com/Azure/sonic-buildimage/pull/7031 to the 201811 branch

#### Why I did it

To enable parsing the `AutoNegotiation` element from the LinkMetadata section of minigraph file

#### How I did it

Parse the value `AutoNegotiation` element from the `LinkMetadata` section of minigraph file. If the element is present, an `autoneg` key will be added to the port in the `PORT` table of Config DB with a value of either `0` or `1`

If an `autoneg` value is present in port_config.ini, the value from the minigraph will take precedence, overriding that value.

Also remove `AutoNegotiation` and `EnableAutoNegotiation` elements from the `DeviceInfo` section, as we will use this data in the `LinkMetadata` section to determine whether to enable auto-negotiation for a port.
2021-03-18 13:17:51 -07:00
rkdevi27
6c2fd18f51
Fixed S6000 abrupt reboot in 201811 (#6923)
Why I did it
The S6000 devices, the cold reboot is abrupt and it is likely to cause issues which will cause the device to land into EFI shell. Hence the platform reboot will happen after graceful unmount of all the filesystems as in S6100.

How I did it
Moved the platform_reboot to platform_reboot_override and hooked it to the systemd shutdown services as in S6100.
Fixed the "/host unmount failed" issue as well in 201811.

How to verify it
Issue "reboot" command to verify if the reboot is happening gracefully.
2021-03-12 11:09:54 -08:00
Vaibhav Hemant Dixit
2877cc9ff6
[submodule]: update sonic-utilities (#6991)
[201811] Warmboot script improvements - timeout in exec and disable swss autorestart Azure/sonic-utilities#1474
2021-03-11 20:19:20 -08:00
Wirut Getbamrung
37fc4d4afb
[platform/cel]: Fixed iSMT SMBUS conflict in Seastone-DX010. (#6889)
#### Why I did it
- The iSMT SMBUS I2c bus number conflicts in different kernel versions.

#### How I did it
- Add I2cbus number detector for iSMT bus
- Replace iSMT bus number in fancontrol config
2021-03-10 10:38:09 -08:00
Ying Xie
94c524276a
[201811][swss] advance swss submodule head (#6809)
[CRM] Safety check for division by 0 (#1569)
[crm]: Typecast to unit64_t to avoid divide by 0 during overflow (#1550)

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-02-17 22:23:25 -08:00
Aravind Mani
ca76c05890
[201811] Dell: Fix S6000 reboot issue (#6688)
#### Why I did it
Reboot command in Dell S6000 failed to reboot the switch.

#### How I did it
Added retry mechanism and CPU reset.
2021-02-16 15:37:44 -08:00
Volodymyr Samotiy
7d0c9f4b3b
[Mellanox] Update SDK repo pointer for kernel package v4.3.1646 with kernel v4.9.0-14 (#6719)
To update rebuilt Mellanox SDK kernel package v4.3.1646 with kernel v4.9.0-14.

Signed-off-by: Volodymyr Samotiy <volodymyrs@nvidia.com>
2021-02-08 08:33:44 -08:00
Volodymyr Samotiy
3d7f4fc45d
[Mellanox] Update SDK kernel package v4.3.1646 with kernel v4.9.0-14 (#6647)
Updated commit hash pointer in the relevant Makefile for the repository which contains SDK packages.

Signed-off-by: Volodymyr Samotiy <volodymyrs@nvidia.com>
2021-02-02 16:35:19 -08:00
Guohan Lu
db81349bae [ci]: reset the repo
Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-30 05:07:48 -08:00
Guohan Lu
ee4fa7b909 [pip2]: pin down pip to 20.3.3
With the release of pip21.0 (https://pypi.org/project/pip/#history) on branch
201811 stretch build is failing with below error logs:

As per https://pypi.org/project/pip/ pip21.0 does not not support python2
from Jan 2021. To fix this tag the pip to 20.3.3 version which was being used last
and is working fine.

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-30 05:07:48 -08:00
arlakshm
ddbfe0631d [baseimage]: add docker ps to the sudoer file (#6604)
fixes Azure/sonic-utilities#1389

With the recent changes in sudoer files. The  show commands fails for the read-only users.
The problem here is the 'docker ps' is failing in the function [get_routing_stack()](8a1109ed30/show/main.py (L54)) therefore all the CLI commands are failing.

Signed-off-by: Arvindsrinivasan Lakshmi Narasimhan <arlakshm@microsoft.com>
2021-01-29 08:38:47 -08:00
Qi Luo
a6295f82be
Cleanup sudoers file (#6523)
Same as https://github.com/Azure/sonic-buildimage/pull/6518
For 201811 branch
2021-01-21 14:42:10 -08:00
Guohan Lu
d40a82bf66 [ci]: add azure pipeline yaml
Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-20 23:06:13 -08:00
lguohan
ca74fe22fc [build]: setup -t option in docker run correctly (#6320)
use bash -t test flag to check if input device is tty or not

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-20 23:06:13 -08:00
Guohan Lu
1cca3ded45 [build]: fix dpkg uninstall bug
fix a bug when there are multiple debian packages to be uninstalled

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-20 23:06:13 -08:00
lguohan
63a044a87c [build]: fix dpkg admindir corruption issue in parallel build (#6408)
Fix #119

when parallel build is enable, multiple dpkg-buildpackage
instances are running at the same time. /var/lib/dpkg is shared
by all instances and the /var/lib/dpkg/updates could be corrupted
and cause the build failure.

the fix is to use overlay fs to mount separate /var/lib/dpkg
for each dpkg-buildpackage instance so that they are not affecting
each other.

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-20 23:06:13 -08:00
lguohan
7e282b89a2 [build]: wait for conflicts package to be uninstalled (#5039)
when parallel build is enabled, both docker-fpm-frr and docker-syncd-brcm
is built at the same time, docker-fpm-frr requires swss which requires to
install libsaivs-dev. docker-syncd-brcm requires syncd package which requires
to install libsaibcm-dev.

since libsaivs-dev and libsaibcm-dev install the sai header in the same
location, these two packages cannot be installed at the same time. Therefore,
we need to serialize the build between these two packages. Simply uninstall
the conflict package is not enough to solve this issue. The correct solution
is to have one package wait for another package to be uninstalled.

For example, if syncd is built first, then it will install libsaibcm-dev.
Meanwhile, if the swss build job starts and tries to install libsaivs-dev,
it will first try to query if libsaibcm-dev is installed or not. if it is
installed, then it will wait until libsaibcm-dev is uninstalled. After syncd
job is finished, it will uninstall libsaibcm-dev and swss build job will be
unblocked.

To solve this issue, _UNINSTALLS is introduced to uninstall a package that
is no longer needed and to allow blocked job to continue.

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-20 23:06:13 -08:00
lguohan
0510ecedcd [build]: change user name to lower case when used in sonic-slave tag (#6319)
sonic-slave tag only allows all lower case. In case the user
name is mixed case, we need to change user name to all lower case.

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-19 09:57:57 -08:00
Guohan Lu
74807be779 [submodule]: update sonic-swss
87e1a36 2020-04-16 | Do not set PG to Buffer porfile mapping again if already exist. (#1261) (HEAD -> 201811, origin/201811) [abdosi]

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-16 21:59:48 -08:00
Volodymyr Samotiy
312a596e5f
[submodule] Update swss submodules (#6394)
To add updated PFC storm detection logic for Mellanox platforms

swss commits

a1b6e5e [pfcwd] Update PFC storm detection logic for Mellanox platforms (#1523)
4999565 [acl] Remove Ethertype from L3V6 qualifiers (#1433)

Signed-off-by: Volodymyr Samotiy <volodymyrs@nvidia.com>
2021-01-16 21:58:08 -08:00
lguohan
4e08f4dcc3
[docker-orchagent]: make build depends only on sairedis package (#6467)
backport c4b5b002c3

make swss build depends only on libsairedis instead of syncd. This allows to build swss without depending
on vendor sai library.

Currently, libsairedis build also buils syncd which requires vendor SAI lib. This makes difficult to build
swss docker in buster while still keeping syncd docker in stretch, as swss requires libsairedis which also
build syncd and requires vendor to provide SAI for buster. As swss docker does not really contain syncd
binary, so it is not necessary to build syncd for swss docker.

[submodule]: update sonic-sairedis

* 9a66890 2020-06-28 | [build]: add option to build without syncd (HEAD -> 201811, origin/201811) [Guohan Lu]

Signed-off-by: Guohan Lu <lguohan@gmail.com>
2021-01-16 13:12:14 -08:00
lguohan
bcda39f394
[sonic-linux-kernel]: update kernel to 4.9.246 (#6461)
kernel ABI from 4.9.0-12 -> 4.9.0-14

Signed-off-by: Guohan Lu <lguohan@gmail.com>
Co-authored-by: Samuel Angebault <angebault.samuel@gmail.com>
2021-01-16 12:33:23 -08:00
Renuka Manavalan
b2e3ba800e
[tacacs]: Restore from TACACS backup if present, upon load-minigraph during update-graph action. (#6407)
Why I did it
During upgrade, if config is loaded from minigraph, it would miss TACACS credentials. This leads to device losing remote user accessibility

- How I did it
During update graph, when config is loaded from minigraph, look for TACACS credentials back-up and load that if available

- How to verify it
Remove /etc/sonic/config-db.json, save TACACS credentials in /etc/sonic/tacacs.json and do a Image upgrade. Do image upgrade and boot into new image. Verify remote user access is available.

NOTE: This change is available in master via PR #6285
2021-01-11 13:57:20 -08:00
Ying Xie
abdbda9435
[201811][bcm SAI] ugprade Broadcom SAI to version 3.5.3.6-2 (#6400)
- Rebase to Broadcom release 3.5.3.6.
- Taking fixes for: CS00011229318, CS00010775359, CS00011331832, CS00011444035, CS00011222060 and CS00010318905
- Taking CS00011581499 patch from Broadcom.

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2021-01-08 16:29:57 -08:00
Wirut Getbamrung
a416f49676
[platform/cel-haliburton]: add watchdog service (#6259)
Haliburton needed watchdog daemon to monitor the basic health of a machine. If something goes wrong, such as a crashing program overloading the CPU, or no more free memory on the system, watchdog can safely reboot the machine,
2020-12-26 03:04:21 -08:00
Volodymyr Samotiy
d609b406be
[Mellanox] Update SAI to version 1.14.3 (#6156)
* [SAI] Add PFC pause duration counters in microseconds
**- Why I did it**
To add PFC pause duration counters in microseconds
**- How I did it**
Updated SAI to version 1.14.3
**- How to verify it**

**- Description for the changelog**
[Mellanox] Update SAI to version 1.14.3
2020-12-14 23:51:14 -08:00
Shi Su
0574db2760
[201811][warm-reboot] Remove warmboot file path that overrides the default path (#6201)
This PR adds the changes in #6198 to 201811 branch to support warm-reboot image upgrade for kvm images.

The sai.profile file in kvm images overrides the warmboot file with path /var/cache/sai_warmboot.bin. Since the directory /var/cache is not mounted in syncd, it will be cleared in an image upgrade, the warm-reboot image upgrade will fail if the file is put in the directory.

Remove the path that overrides the default path. The warmboot file path will then be the default value /var/warmboot/sai-warmboot.bin. Since /var/warmboot/ is mounted by /host/warmboot/ in the host, it could survive an image upgrade.
2020-12-13 22:48:29 -08:00
Shi Su
40bd77c915
201811][syncd] Fix directory mount for vs syncd docker (#6200)
Since DOCKER_SYNCD_VS is no longer being used, the mount option does not properly mount the warmboot file directory. Fix the mount option so that the directory is properly mounted.
2020-12-13 22:42:02 -08:00
Sumukha Tumkur Vani
0eb8f773f4
Potential fix for Celestica E1031 device hang
set CPU max_cstate to 0
2020-12-04 12:39:47 -08:00
Ying Xie
93302d1810
[bcm SAI] Upgrade Broadcom SAI to version 3.5.3.5-3 (#5734)
- Include change to CS00011229318.

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2020-10-29 08:53:29 -07:00
Neetha John
6b96b8e4ac
[knet] Address Tx drop No DMA resource issue (#5727)
Signed-off-by: Neetha John <nejo@microsoft.com>
2020-10-28 08:29:16 -07:00
Aravind Mani
701a304b6d [Dell S6100] Properly release memory upon ICH driver deinit (#5561)
During platform deinitialization, dell_ich is not removed properly and when we do initialize s6100 platform, ICH driver sysfs attributes are not attached. Because of this, get_transceiver_change_event returns error and this leads xcvrd to crash.
2020-10-14 18:48:45 +00:00
pavel-shirshov
6c2801b846 teamd: fix possible race in master ifname callback (#4109)
- What I did
Ported a fix from libteam master to our master.
Fixes #4070
Fixes #3649

- How I did it
Applied patch jpirko/libteam@c723737 from upstream.

- How to verify it
Build image for your DUT and warm-reboot your DUT 10 times. Check that all PortChannels are up and no error messages in teamd.log
2020-10-09 15:59:56 +00:00
Ying Xie
9ea38c417c [rc.local] separate configuration migration and grub installation logic (#5528)
To address issue #5525

Explicitly control the grub installation requirement when it is needed.
We have scenario where configuration migration happened but grub
installation is not required.

Signed-off-by: Ying Xie <ying.xie@microsoft.com>
2020-10-05 15:11:35 +00:00
Ying Xie
4c80d996ba
Revert "[201811][platform/cel]: Port fancontrol changes for dx010/e1031 to 201811 branch (#4867)" (#5496)
This reverts commit c9d86f0587.
2020-09-29 18:02:47 -07:00
Ying Xie
81e9ec6be6
Revert "[201811][platform-cel]: Fix dx010 FSC error (#4949)" (#5485)
This reverts commit ec07d10748.
2020-09-29 08:01:02 -07:00
Aravind Mani
7e6fa15784
Dell S6100 fix mux log issue (#5413)
IOM completion log was not seen in syslog.
2020-09-21 12:19:07 -07:00
Aravind Mani
bee516e370
Dell S6100- Fix PCA MUX attachment issue (#5401)
* Dell S6100- Fix PCA MUX attachment t issue

* Update s6100_i2c_enumeration.sh

* Update s6100_i2c_enumeration.sh
2020-09-20 20:05:53 -07:00