sonic-buildimage/device/mellanox/x86_64-nvidia_sn5600-r0
Volodymyr Samotiy 15a0f912bd [Mellanox] Disable SSD NCQ on Mellanox platforms (#17567)
- Why I did it
Based on some research some products might experience an occasional IO failures in the communication between CPU and SSD because of NCQ.
There seems to be a problem between some kernel versions and some SATA controllers.

Syslog error message examples:

Error "ata1: SError: { UnrecovData Handshk }" - "failed command: WRITE FPDMA QUEUED".
Error "ata1: SError: { RecovComm HostInt PHYRdyChg CommWake 10B8B DevExch }" - "failed command: READ FPDMA QUEUED".
Some vendors already disabled NCQ on their platforms in SONiC due to similar issue:

[Arista] Disable ATA NCQ for a few products #13739 [Arista] Disable ATA NCQ for a few products
[Arista] Disable SSD NCQ on DCS-7050CX3-32S #13964 [Arista] Disable SSD NCQ on DCS-7050CX3-32S
Also there are other discussions on Debian/Ubuntu forums about similar issues and it was suggested to disable NCQ:

https://askubuntu.com/questions/133946/are-these-sata-errors-dangerous

- How I did it
Add a kernel parameter to tell libata to disable NCQ

- How to verify it
Use FIO tool - fio --direct=1 --rw=randrw --bs=64k --ioengine=libaio --iodepth=64 --runtime=120 --numjobs=4
2024-02-01 04:32:27 +08:00
..
ACS-SN5600 [202305][buffers] Add 'create_only_config_db_buffers.json' file for the Mellanox devices (not MSFT SKU) (#17006) 2023-11-03 14:27:17 +08:00
plugins [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00
default_sku [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00
installer.conf [Mellanox] Disable SSD NCQ on Mellanox platforms (#17567) 2024-02-01 04:32:27 +08:00
pcie.yaml [Mellanox] Update SN5600 sensors.conf and pcie.yaml files (#14883) 2023-05-02 10:36:57 +03:00
platform_asic [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00
platform_components.json [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00
platform_reboot [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00
platform_wait [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00
platform.json [Mellanox] [SN5600] Removing 8x DPB mode from platform files (#17071) (#17119) 2023-11-08 22:48:22 +08:00
pmon_daemon_control.json [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00
sensors.conf [Mellanox] Update SN5600 sensors.conf and pcie.yaml files (#14883) 2023-05-02 10:36:57 +03:00
system_health_monitoring_config.json [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00
thermal_policy.json [Mellanox] Add device files for SN5600 (#12831) 2022-11-30 19:47:50 +02:00