sonic-buildimage/device/mellanox/x86_64-mlnx_msn3800-r0
Volodymyr Samotiy f1d6655004
[Mellanox] Disable SSD NCQ on Mellanox platforms (#17567)
- Why I did it
Based on some research some products might experience an occasional IO failures in the communication between CPU and SSD because of NCQ.
There seems to be a problem between some kernel versions and some SATA controllers.

Syslog error message examples:

Error "ata1: SError: { UnrecovData Handshk }" - "failed command: WRITE FPDMA QUEUED".
Error "ata1: SError: { RecovComm HostInt PHYRdyChg CommWake 10B8B DevExch }" - "failed command: READ FPDMA QUEUED".
Some vendors already disabled NCQ on their platforms in SONiC due to similar issue:

[Arista] Disable ATA NCQ for a few products #13739 [Arista] Disable ATA NCQ for a few products
[Arista] Disable SSD NCQ on DCS-7050CX3-32S #13964 [Arista] Disable SSD NCQ on DCS-7050CX3-32S
Also there are other discussions on Debian/Ubuntu forums about similar issues and it was suggested to disable NCQ:

https://askubuntu.com/questions/133946/are-these-sata-errors-dangerous

- How I did it
Add a kernel parameter to tell libata to disable NCQ

- How to verify it
Use FIO tool - fio --direct=1 --rw=randrw --bs=64k --ioengine=libaio --iodepth=64 --runtime=120 --numjobs=4
2024-01-28 16:26:07 +02:00
..
ACS-MSN3800 [ppi]: Enable global port late create for all Mellanox HWSKUs. (#16945) 2023-11-01 21:50:14 -07:00
Mellanox-SN3800-C64 [Mellanox][Switching Mode] Enable Store-And-Forward switching mode on specific platforms (#16781) 2023-10-09 19:00:02 +03:00
Mellanox-SN3800-D24C52 [ppi]: Enable global port late create for all Mellanox HWSKUs. (#16945) 2023-11-01 21:50:14 -07:00
Mellanox-SN3800-D28C49S1 [ppi]: Enable global port late create for all Mellanox HWSKUs. (#16945) 2023-11-01 21:50:14 -07:00
Mellanox-SN3800-D28C50 [ppi]: Enable global port late create for all Mellanox HWSKUs. (#16945) 2023-11-01 21:50:14 -07:00
Mellanox-SN3800-D100C12S2 [ppi]: Enable global port late create for all Mellanox HWSKUs. (#16945) 2023-11-01 21:50:14 -07:00
Mellanox-SN3800-D112C8 [ppi]: Enable global port late create for all Mellanox HWSKUs. (#16945) 2023-11-01 21:50:14 -07:00
plugins [Mellanox]Implement plugins for PSU, fan and thermal (#4041) 2020-01-24 11:27:32 -08:00
default_sku [mellanox]: Added SN3800 platform (#3262) 2019-08-01 16:25:44 -07:00
installer.conf [Mellanox] Disable SSD NCQ on Mellanox platforms (#17567) 2024-01-28 16:26:07 +02:00
pcie.yaml [Mellanox]: Fix PCIEd configuration files for SN3700 and SN3800 systems (#6913) 2021-03-01 12:36:18 +02:00
platform_asic Add platform_asic file to each platform folder in sonic-device-data based package (#8542) 2021-10-08 19:27:48 -07:00
platform_components.json [Mellanox] Update platform components config files. (#5685) 2020-10-25 19:44:37 +02:00
platform_reboot [mellanox]: Added SN3800 platform (#3262) 2019-08-01 16:25:44 -07:00
platform_wait [mellanox]: Added SN3800 platform (#3262) 2019-08-01 16:25:44 -07:00
platform.json [mellanox] Fix DPB supported breakout modes (#10072) 2022-02-25 18:33:35 +05:30
pmon_daemon_control.json [mellanox] Update SN3800 device configs. (#3633) 2019-10-19 12:11:58 +03:00
port_peripheral_config.j2 [Mellanox] Add NVIDIA Copyright header to "mellanox" files (#8799) 2021-10-17 19:03:02 +03:00
sensors.conf [Mellanox] Auto correct PSU voltage threshold (WA) (#10394) 2022-04-14 08:14:40 +03:00
system_health_monitoring_config.json [Mellanox] Add system health configuration file for Mellanox platforms (#4834) 2020-07-13 10:20:22 -07:00
thermal_policy.json Add thermal control support for SONiC (#3949) 2020-03-09 10:41:10 -07:00