DL4100 has 2 bad drives

My DL4100 NAS is about 4 years old and recently it shows 2 bad drives.

I am looking for guidance to purchase new drives but I am having a challenge finding Red WD 4.0TB WD40EFRX model hard drives.

Aside from the size of the HDD, can I use another brand?

Hi Aggie,

Here is the Hard Drive Compatibility List for My Cloud DL4100: https://support-en.wd.com/app/products/product-detail/p/128#WD_compatibility

Also, to purchase new drive with model number please visit the WD store link:

How much data have you got on your DL4100? I recently helped someone else on this WD community and where he was also experiencing bad drive problems, turned out all he had to do was upgrade the RAM in his DL4100 from 2Gb to 6Gb. Worth investigating if this might be the case.

1 Like

I agree with the RAM upgrade and I also suggest using WD gold hard disks which are slightly more reliable

1 Like

Thanks for your feedback. I have taken the NAS off my network however I am using a USB 3.0 to connect to my laptop to move the personal data but Windows does not accept it. Am I able to do it or I can only pull the data off the network? I apologize about the Noob question.

Thanks for your guidance.

Re you trying to copy files from the NAS when it is off the netwrork?

Yes, that is correct. Appreciate any guidance Gramps.

You are not alone. I would say that the majority of people out there do not have backups of their data. The biggest advantage to getting a NAS seems to be able to put all your files in one place so you can say goodbye to them in one large swoop. These days you have a 50-50 chance of losing your data from hardware failure vs Malware. Air gapped backups are a must these days.

You said it showed 2 bad drives. Were you able to get to any of the data at that time? How were the drives configured? You mentioned 4tb drives. Do you remember if your storage capacity was close to 16tb or closer to 12tb?

You cannot use a USB cable between your laptop and the DL4100 to “see” your data.

1 Like

If you want to throw money at the problem, servers like the one backblaze use are not that expensive. 15, 30 and 45 disk models use software RAID

Stacked up they use blocks of 15 disks to add yet another layer of fault tolerance.

EIA racks are $2000 a column and servers start at $5000 with about 8 of them to a rack

1 Like

Fault tolerance and backups are not the same thing. It does not matter how much the spindle cost to contain a bad copy of a file.

Redundant copies make for a more reliable recovery situation. I use BD50 media for critical backups and media are low cost. USB sticks are now larger in capacity to be considered.

USB sticks are vulnerable to ransomware but BD50 are immune. BD50 also last decades on a shelf.

Thanks Gramp for your help. Bad news, I was not able to recover any data. Now I have 3 bad drives now. Not sure I can recover right?

I reboot the system. Now it shows only two bad drives out of four (they have red lights). Each one if 4TBs

Here are my RAID settings.

Here is what it says about my system disks. Does this mean I only have one bad drive? I am a bit confused why I have two red lights on the web page.

I am frantically pulling the data off before I lose my personal stuff.

if you are getting files keep at. Follow-up with a status report when done

1 Like

Just for your info, this was the result of a DL4100 running out of RAM and and also the Swap file.

The person who I helped who had a DL4100 that appears to be showing faulty drives has 2Gb installed and this was repetitively occurring.

Check the S.M.A.R.T. data of the drive itself to see if the drive’s controller is reporting any problems.

2021-04-25T10:36:58.688200-05:00 warning kernel: [163651.795807] restsdk-server invoked oom-killer: gfp_mask=0x14280ca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), nodemask=(null),  order=0, oom_score_adj=0
2021-04-25T10:36:58.813080-05:00 info kernel: [163651.810225] restsdk-server cpuset=/ mems_allowed=0
2021-04-25T10:36:58.813091-05:00 warning kernel: [163651.815691] CPU: 0 PID: 3912 Comm: restsdk-server Tainted: P           O    4.14.22 #1
2021-04-25T10:36:58.813095-05:00 warning kernel: [163651.824638] Hardware name: To be filled by O.E.M. WDBNEZ0160KBK-40/To be filled by O.E.M., BIOS 0ACFJ020 12/02/2014
2021-04-25T10:36:58.813099-05:00 warning kernel: [163651.836397] Call Trace:
2021-04-25T10:36:58.813103-05:00 warning kernel: [163651.839230]  dump_stack+0x46/0x63
2021-04-25T10:36:58.813106-05:00 warning kernel: [163651.843028]  dump_header+0x90/0x1e4
2021-04-25T10:36:58.813109-05:00 warning kernel: [163651.847021]  oom_kill_process.cold.22+0xc/0x401
2021-04-25T10:36:58.813113-05:00 warning kernel: [163651.852178]  ? has_capability_noaudit+0x17/0x20
2021-04-25T10:36:58.813117-05:00 warning kernel: [163651.857333]  ? oom_badness+0x14d/0x270
2021-04-25T10:36:58.813120-05:00 warning kernel: [163651.861614]  out_of_memory+0x1c9/0x440
2021-04-25T10:36:58.813123-05:00 warning kernel: [163651.865897]  __alloc_pages_slowpath+0xb1f/0xc80
2021-04-25T10:36:58.813126-05:00 warning kernel: [163651.871054]  __alloc_pages_nodemask+0x1ce/0x200
2021-04-25T10:36:58.813130-05:00 warning kernel: [163651.876211]  alloc_pages_vma+0xc8/0x180
2021-04-25T10:36:58.813133-05:00 warning kernel: [163651.880591]  __handle_mm_fault+0x66f/0xa10
2021-04-25T10:36:58.813136-05:00 warning kernel: [163651.885262]  handle_mm_fault+0x85/0x180
2021-04-25T10:36:58.813139-05:00 warning kernel: [163651.889642]  __do_page_fault+0x1e4/0x440
2021-04-25T10:36:58.813142-05:00 warning kernel: [163651.894120]  ? page_fault+0x65/0x80
2021-04-25T10:36:58.813145-05:00 warning kernel: [163651.898110]  page_fault+0x7b/0x80
2021-04-25T10:36:58.813148-05:00 warning kernel: [163651.901906] RIP: 0033:0x7fb22bdd93a1
2021-04-25T10:36:58.813151-05:00 warning kernel: [163651.905992] RSP: 002b:00007fb202fe8f88 EFLAGS: 00010206
2021-04-25T10:36:58.813154-05:00 warning kernel: [163651.911925] RAX: 00007fb181a013c0 RBX: 00007fb201a2c060 RCX: 00007fb12b06b430
2021-04-25T10:36:58.813157-05:00 warning kernel: [163651.919985] RDX: 000000000966ac00 RSI: 00007fb121a00840 RDI: 00007fb181a013c0
2021-04-25T10:36:58.813160-05:00 warning kernel: [163651.928053] RBP: 00007fb202fe8ff0 R08: 000000000000000c R09: 00007fb18b06bff0
2021-04-25T10:36:58.813163-05:00 warning kernel: [163651.936113] R10: 00007fb1dbe31c30 R11: 00007fb1dec19dbc R12: 00007fb1dec19dcc
2021-04-25T10:36:58.813166-05:00 warning kernel: [163651.944181] R13: 00007fb201a2c060 R14: 00007fb202fe9050 R15: 00007fb22b998200
2021-04-25T10:36:58.813169-05:00 warning kernel: [163651.952265] Mem-Info:
2021-04-25T10:36:58.813172-05:00 warning kernel: [163651.954905] active_anon:268033 inactive_anon:89349 isolated_anon:0
2021-04-25T10:36:58.813175-05:00 warning kernel: [163651.954905]  active_file:710 inactive_file:707 isolated_file:64
2021-04-25T10:36:58.813178-05:00 warning kernel: [163651.954905]  unevictable:55590 dirty:0 writeback:22 unstable:0
2021-04-25T10:36:58.813181-05:00 warning kernel: [163651.954905]  slab_reclaimable:68995 slab_unreclaimable:7332
2021-04-25T10:36:58.813184-05:00 warning kernel: [163651.954905]  mapped:1568 shmem:1785 pagetables:2689 bounce:0
2021-04-25T10:36:58.813187-05:00 warning kernel: [163651.954905]  free:3964 free_pcp:306 free_cma:0
2021-04-25T10:36:58.813196-05:00 warning kernel: [163651.992993] Node 0 active_anon:1072132kB inactive_anon:357396kB active_file:2920kB inactive_file:2728kB unevictable:222360kB isolated(anon):0kB isolated(file):256kB mapped:6272kB dirty:0kB writeback:88kB shmem:7140kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
2021-04-25T10:36:58.813202-05:00 warning kernel: [163652.019812] Node 0 DMA free:7912kB min:64kB low:80kB high:96kB active_anon:7236kB inactive_anon:516kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15996kB managed:15900kB mlocked:0kB kernel_stack:0kB pagetables:52kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
2021-04-25T10:36:58.813206-05:00 warning kernel: [163652.049160] lowmem_reserve[]: 0 1962 1962 1962
2021-04-25T10:36:58.813209-05:00 warning kernel: [163652.054225] Node 0 DMA32 free:7944kB min:8124kB low:10152kB high:12180kB active_anon:1064908kB inactive_anon:356880kB active_file:2912kB inactive_file:2864kB unevictable:222360kB writepending:88kB present:2065128kB managed:2018112kB mlocked:10212kB kernel_stack:3472kB pagetables:10704kB bounce:0kB free_pcp:1224kB local_pcp:588kB free_cma:0kB
2021-04-25T10:36:58.813213-05:00 warning kernel: [163652.088135] lowmem_reserve[]: 0 0 0 0
2021-04-25T10:36:58.813216-05:00 warning kernel: [163652.092325] Node 0 DMA: 12*4kB (UE) 23*8kB (UE) 26*16kB (UE) 13*32kB (UME) 13*64kB (UE) 7*128kB (UME) 4*256kB (UME) 0*512kB 2*1024kB (E) 1*2048kB (U) 0*4096kB = 7912kB
2021-04-25T10:36:58.813219-05:00 warning kernel: [163652.109159] Node 0 DMA32: 20*4kB (UM) 429*8kB (UM) 205*16kB (UME) 22*32kB (UME) 5*64kB (M) 1*128kB (M) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 7944kB
2021-04-25T10:36:58.813223-05:00 info kernel: [163652.124729] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
2021-04-25T10:36:58.813226-05:00 warning kernel: [163652.134256] 57984 total pagecache pages
2021-04-25T10:36:58.813229-05:00 warning kernel: [163652.138639] 503 pages in swap cache
2021-04-25T10:36:58.813232-05:00 warning kernel: [163652.142632] Swap cache stats: add 914155844, delete 914137345, find 301166408/363061458
2021-04-25T10:36:58.813240-05:00 warning kernel: [163652.151677] Free swap  = 0kB
2021-04-25T10:36:58.813245-05:00 warning kernel: [163652.154992] Total swap = 1785832kB
2021-04-25T10:36:58.813248-05:00 warning kernel: [163652.158888] 520281 pages RAM
2021-04-25T10:36:58.813251-05:00 warning kernel: [163652.162199] 0 pages HighMem/MovableOnly
2021-04-25T10:36:58.813254-05:00 warning kernel: [163652.166580] 11778 pages reserved
2021-04-25T10:36:58.813257-05:00 info kernel: [163652.170281] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds swapents oom_score_adj name
2021-04-25T10:36:58.813260-05:00 info kernel: [163652.179916] [ 2132]     0  2132      745      395       6       3       38             0 xmldb
2021-04-25T10:36:58.813263-05:00 info kernel: [163652.189643] [ 2135]     0  2135      664      354       5       3       32             0 xmldb
2021-04-25T10:36:58.813266-05:00 info kernel: [163652.199371] [ 2145]     0  2145      581      361       5       3       33             0 acpid
2021-04-25T10:36:58.813269-05:00 info kernel: [163652.209099] [ 2535]     0  2535    55926      857      23       3      192             0 rsyslogd
2021-04-25T10:36:58.813277-05:00 info kernel: [163652.219106] [ 2548]     0  2548      611      356       6       3       24             0 mserver
2021-04-25T10:36:58.813282-05:00 info kernel: [163652.229026] [ 2567]     0  2567     4172      417       8       3       59             0 mail_daemon
2021-04-25T10:36:58.813286-05:00 info kernel: [163652.239335] [ 2689]     0  2689     1176      546       6       3       25             0 zcip
2021-04-25T10:36:58.813289-05:00 info kernel: [163652.248963] [ 2690]     0  2690     1176      431       6       3       30             0 udhcpc
2021-04-25T10:36:58.813292-05:00 info kernel: [163652.258787] [ 2794]     0  2794     2162      508       8       3       72             0 sysinfod
2021-04-25T10:36:58.813295-05:00 info kernel: [163652.268803] [ 2797]     0  2797      664      407       5       3       18             0 xmldb
2021-04-25T10:36:58.813298-05:00 info kernel: [163652.278531] [ 3002]     0  3002    65084      507      18       3      106             0 wdlcds
2021-04-25T10:36:58.813309-05:00 info kernel: [163652.288353] [ 3010]     0  3010    11387      509      14       3      103             0 power_monitor
2021-04-25T10:36:58.813314-05:00 info kernel: [163652.298856] [ 3020]     0  3020     2721      526       9       3       90             0 wdlcd_sub_daemo
2021-04-25T10:36:58.813317-05:00 info kernel: [163652.309551] [ 3051] 65531  3051     2161      357       8       3       98             0 dbus-daemon
2021-04-25T10:36:58.813321-05:00 info kernel: [163652.319859] [ 3066]     0  3066     2055      522       8       3       73             0 avahi-daemon
2021-04-25T10:36:58.813324-05:00 info kernel: [163652.330264] [ 3381]     0  3381    11031      602      13       3      105             0 fan_control
2021-04-25T10:36:58.813327-05:00 info kernel: [163652.340571] [ 3387]     0  3387     2114      491       8       3       40             0 set_pwm
2021-04-25T10:36:58.813334-05:00 info kernel: [163652.350491] [ 3616]     0  3616    11325      420      18       3      826             0 php-fpm
2021-04-25T10:36:58.813339-05:00 info kernel: [163652.360410] [ 3617]     0  3617    11325      282      17       3      841             0 php-fpm
2021-04-25T10:36:58.813342-05:00 info kernel: [163652.370328] [ 3618]     0  3618    11325      282      17       3      841             0 php-fpm
2021-04-25T10:36:58.813345-05:00 info kernel: [163652.380248] [ 3619]     0  3619    11325      282      17       3      841             0 php-fpm
2021-04-25T10:36:58.813348-05:00 info kernel: [163652.390166] [ 3646]     0  3646     9681      638      23       3     5785             0 httpd
2021-04-25T10:36:58.813351-05:00 info kernel: [163652.399891] [ 3670]     0  3670    49581      595      20       3     1622             0 chk_io
2021-04-25T10:36:58.813354-05:00 info kernel: [163652.409714] [ 3732]     0  3732      687      340       5       3       38             0 xmldb
2021-04-25T10:36:58.813357-05:00 info kernel: [163652.419439] [ 3739]     0  3739   178896      727      35       5     2136             0 nasAdmin
2021-04-25T10:36:58.813361-05:00 info kernel: [163652.429455] [ 3741]     0  3741     2160      407       7       3       51             0 system_daemon
2021-04-25T10:36:58.813365-05:00 info kernel: [163652.439958] [ 3814]     0  3814     2121      487       8       3       37             0 fireAlert
2021-04-25T10:36:58.813372-05:00 info kernel: [163652.450072] [ 3838]     0  3838      973      969       6       3        0           -17 iscsid
2021-04-25T10:36:58.813377-05:00 info kernel: [163652.459894] [ 3858]     0  3858    21421      605      10       3      216             0 monit
2021-04-25T10:36:58.813380-05:00 info kernel: [163652.469619] [ 3922]     0  3922     1176      212       7       3       30             0 init
2021-04-25T10:36:58.813383-05:00 info kernel: [163652.479247] [ 3950]     0  3950      741      336       6       3       39             0 xmldb
2021-04-25T10:36:58.813386-05:00 info kernel: [163652.488973] [ 5153]     0  5153     1394      297       7       3       50             0 rotatelogs
2021-04-25T10:36:58.813389-05:00 info kernel: [163652.499184] [ 5158]     0  5158     1394      335       7       3       48             0 rotatelogs
2021-04-25T10:36:58.813397-05:00 info kernel: [163652.509395] [ 5160]     0  5160     9703      405      23       3     5803             0 httpd
2021-04-25T10:36:58.813402-05:00 info kernel: [163652.519120] [ 5161]     0  5161   310812      466      65       4     5887             0 httpd
2021-04-25T10:36:58.813405-05:00 info kernel: [163652.528845] [ 5204]     0  5204     8818      514      21       3      578             0 smbd
2021-04-25T10:36:58.813408-05:00 info kernel: [163652.538473] [ 5207]     0  5207     8063      294      19       3      504             0 smbd-notifyd
2021-04-25T10:36:58.813411-05:00 info kernel: [163652.548882] [ 5209]     0  5209     5548      426      14       3      377             0 nmbd
2021-04-25T10:36:58.813480-05:00 info kernel: [163652.558511] [ 5223]     0  5223     7179      622      18       3     2767             0 python3
2021-04-25T10:36:58.813486-05:00 info kernel: [163652.568431] [ 5233]     0  5233      595      341       5       3       27             0 ConnectivitySer
2021-04-25T10:36:58.813496-05:00 info kernel: [163652.579128] [10342]     0 10342   266958      517      32       4      157             0 upnp_nas_device
2021-04-25T10:36:58.813501-05:00 info kernel: [163652.589824] [10443]     0 10443     8818      267      20       3      569             0 cleanupd
2021-04-25T10:36:58.813504-05:00 info kernel: [163652.599841] [10470]     0 10470     1881      399       7       3      130             0 netatalk
2021-04-25T10:36:58.813507-05:00 info kernel: [163652.609858] [10476]     0 10476     1770      472       7       3      176             0 afpd
2021-04-25T10:36:58.813510-05:00 info kernel: [163652.619486] [10477]     0 10477     1341      439       8       3      131             0 cnid_metad
2021-04-25T10:36:58.813518-05:00 info kernel: [163652.629697] [10565]     0 10565     1979      353       8       3       44             0 apkg
2021-04-25T10:36:58.813523-05:00 info kernel: [163652.639325] [10616]     0 10616   175814       17      12       5      300             0 restsdk-serverd
2021-04-25T10:36:58.813526-05:00 info kernel: [163652.650022] [10678]     0 10678   175814       17      11       4      106             0 otaclientd
2021-04-25T10:36:58.813529-05:00 info kernel: [163652.660233] [10693]     0 10693   178688      413      27       4      898             0 otaclient
2021-04-25T10:36:58.813532-05:00 info kernel: [163652.670345] [10725]     0 10725      664      366       6       3       35             0 xmldb
2021-04-25T10:36:58.813535-05:00 info kernel: [163652.680070] [10747]     0 10747    10672      490      14       3       94             0 chk_hotplug
2021-04-25T10:36:58.813542-05:00 info kernel: [163652.690379] [11434]     0 11434     1252      540       6       3       42             0 crond
2021-04-25T10:36:58.813547-05:00 info kernel: [163652.700103] [ 7661]     0  7661     2760     2100       8       3        0             0 atop
2021-04-25T10:36:58.813551-05:00 info kernel: [163652.709730] [ 3899]     0  3899  1180716   352817    1943       8   425404             0 restsdk-server
2021-04-25T10:36:58.813554-05:00 info kernel: [163652.720330] [29576]     0 29576     2217      415       8       3        0             0 curl
2021-04-25T10:36:58.813557-05:00 info kernel: [163652.729950] [30547]     0 30547     1176      501       7       4        0             0 sh
2021-04-25T10:36:58.813560-05:00 info kernel: [163652.739384] [30548]     0 30548     2408      737       9       3        0             0 smartctl
2021-04-25T10:36:58.813567-05:00 info kernel: [163652.749400] [30549]     0 30549     1176      536       7       3        0             0 grep
2021-04-25T10:36:58.813572-05:00 info kernel: [163652.759028] [30550]     0 30550     1176      484       6       3        0             0 grep
2021-04-25T10:36:58.813575-05:00 info kernel: [163652.768656] [30696]     0 30696      926      329       5       3        0             0 wdLogUploader.s
2021-04-25T10:36:58.813578-05:00 err kernel: [163652.779350] Out of memory: Kill process 3899 (restsdk-server) score 792 or sacrifice child
2021-04-25T10:36:58.813581-05:00 err kernel: [163652.788686] Out of memory: top1: 'restsdk-server'(3899), used 1411268kB, oom_score_adj is 0
2021-04-25T10:36:58.813584-05:00 err kernel: [163652.798118] Out of memory: top2: 'atop'(7661), used 8400kB, oom_score_adj is 0
2021-04-25T10:36:58.813587-05:00 err kernel: [163652.806287] Out of memory: top3: 'iscsid'(3838), used 3876kB, oom_score_adj is -17
2021-04-25T10:36:58.813590-05:00 err kernel: [163652.814844] Out of memory: top4: 'rsyslogd'(2535), used 3428kB, oom_score_adj is 0
2021-04-25T10:36:58.813593-05:00 err kernel: [163652.823402] Out of memory: top5: 'smartctl'(30548), used 2948kB, oom_score_adj is 0
2021-04-25T10:36:58.813596-05:00 err kernel: [163652.832085] Killed process 3899 (restsdk-server) total-vm:4722864kB, anon-rss:1408684kB, file-rss:2584kB, shmem-rss:0kB
2021-04-25T10:36:58.813599-05:00 info kernel: [163653.198013] oom_reaper: reaped process 3899 (restsdk-server), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
2021-04-25T10:59:41.913709-05:00 warning kernel: [165015.029603] netatalk invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null),  order=0, oom_score_adj=0
2021-04-25T10:59:42.206805-05:00 info kernel: [165015.043417] netatalk cpuset=/ mems_allowed=0
1 Like

Update, I am having problems retrieving data from the RAID5. I am only able to pull half of it off. I get these errors that show the crazy size is 512 PD… I assume that is because the data and drives are not syncing.

image

I was able to order a few more WD RED 4.0 TB drives to replace the two bad ones and hopes it will rebuild so I can recover all the files. I am also exploring to purchase more RAM too. Thanks Gramps and Myron for guidance.

Hopefully in a few days I can share some good news.

Thanks everyone for your guidance.

I searched in the forum, internet and on the manual but could not find a direct answer… does the DL-4100 support hot swap for hard drive or do I need to manually shut down to replace?

Super Thanks to Gramps and Myron. I have replaced the 2 bad hard drives and also adding 4gb RAM per Myron’s recommendation. Vastly improved the temperature. Should be faster too.

Unfortunately with 2 bad 4 TB hard drives, I lost some data but was able to retrieve 80%. I think due the many power outages in my area may have impacted the drives so I will be buying a future UPS to further protect immediate shut downs.

1 Like