Posted on Wednesday, November 27 2019 @ 14:54 CET by Thomas De Maesschalck
Hewlett Packard Enterprise issued a warning that third-party SAS SSDs found in various of the company's enterprise server and storage products contain a bug that causes them to fail after 32,768 hours, which equals 3 years, 270 days and 8 hours non-stop operation. Once the drives have failed, it's no longer possible to recover data.
IMPORTANT: This HPD8 firmware is considered a critical fix and is required to address the issue detailed below. HPE strongly recommends immediate application of this critical fix. Neglecting to update to SSD Firmware Version HPD8 will result in drive failure and data loss at 32,768 hours of operation and require restoration of data from backup in non-fault tolerance, such as RAID 0 and in fault tolerance RAID mode if more drives fail than what is supported by the fault tolerance RAID mode logical drive. By disregarding this notification and not performing the recommended resolution, the customer accepts the risk of incurring future related errors.
HPE was notified by a Solid State Drive (SSD) manufacturer of a firmware defect affecting certain SAS SSD models (reference the table below) used in a number of HPE server and storage products (i.e., HPE ProLiant, Synergy, Apollo, JBOD D3xxx, D6xxx, D8xxx, MSA, StoreVirtual 4335 and StoreVirtual 3200 are affected).
The issue affects SSDs with an HPE firmware version prior to HPD8 that results in SSD failure at 32,768 hours of operation (i.e., 3 years, 270 days 8 hours). After the SSD failure occurs, neither the SSD nor the data can be recovered. In addition, SSDs which were put into service at the same time will likely fail nearly simultaneously.
Details and firmware updates can be found
at HP. It's seems the issue is related due to the use of a signed integer that keeps track of the total number of hours of disk uptime. Once the value is too high the disk goes bonkers.
