8 × 12 TB in RAID 5: the numbers
| Usable space | 84 TB (76.4 TB in Windows) |
|---|---|
| Raw space | 96 TB |
| Used for protection | 12 TB |
| Efficiency | 88% |
| Drives that can fail | Any 1 |
| Rebuild at 150 MB/s | 22 h |
| Rebuild at 50 MB/s (busy) | 2.8 days |
| Data read during rebuild | 84 TB |
| Read error risk, desktop drives | over 99% |
| Read error risk, NAS drives | 49% |
Rebuild
Replacing a failed drive means writing a full 12 TB drive. At 150 MB/s with no other load that takes about 22 h; on a busy array running at 50 MB/s, about 2.8 days. The rebuild reads every surviving drive: 84 TB in total.
Read errors
Reading 84 TB, the chance of at least one unreadable sector is over 99% with desktop drives (1 per 1014 bits) and 49% with NAS drives (1 per 1015). Nothing is left to correct it, so the affected file, or on some controllers the whole rebuild, fails. These are worst-case datasheet rates; real drives usually do better.
Our take
With 12 TB drives we would pick RAID 6. One more drive in RAID 6 gives the same 84 TB and survives two failures. Keeping 8 drives, RAID 6 gives 72 TB. RAID 10 with the same drives gives 48 TB, faster writes and shorter rebuilds.