Clean OS (Debian), OpenMediaVault and other "firmwares"

So what’s your opinion of DSM? I’ve now given up on OMV as having a big slowdown, big log files and takes forever to edit users/share folders.

Hey Bibek_Sahi,

My requirement is to integrate with windows active directory, so DSM build is really my only choice outside of just using vanilla Samba 4.2.10 on Debian 6.5. I liked the Samba 4.2.10 on Debian 6.5 route because I could have just added Debian based software at will, but I was getting some pretty slow writes and somewhat slow reads compared to the original configuration provided by Wester Digital on my WD MyCloud 3TB Gen1, so I decided to go with the DSM 5.2 to make it easy on myself and try to get the best of both worlds.

DSM 5.2 setup APPEARS to be a little faster than the vanilla Samba 4.2.10 on Debian 6.5 setup, but not as fast as the WD MyCloud base configuration that Western Digital provides out of the box. I’m still looking for the secret sauce / config that WD has that makes it faster. I’ve copied over all the relevent settings from smb.conf and optimized the NIC, but it’s still a bit slower.

Here are my benchmarks while the NAS’s are at rest and on the same exact physical network using NAS performance tester 1.7 transfering a 400MB file:

WD MyCloud 3TB G1:

Running a 400MB file write on \\wdmycloud.lan.net\test 3 times...
Iteration 1:     74.02 MB/sec
Iteration 2:     71.69 MB/sec
Iteration 3:     79.27 MB/sec
-----------------------------
Average (W):     74.99 MB/sec
-----------------------------
Running a 400MB file write on \\wdmycloud.lan.net\test 3 times...
Iteration 1:     101.52 MB/sec
Iteration 2:     112.54 MB/sec
Iteration 3:     99.98 MB/sec
-----------------------------
Average (R):     104.68 MB/sec
-----------------------------

Debian 6.5 / Samba 4.2.10:

Running a 400MB file write on \\debian1.lan.net\test 3 times...
Iteration 1:     24.65 MB/sec
Iteration 2:     22.61 MB/sec
Iteration 3:     23.44 MB/sec
-----------------------------
Average (W):     23.56 MB/sec
-----------------------------
Running a 400MB file read on  \\debian1.lan.net\test 3 times...
Iteration 1:     40.52 MB/sec
Iteration 2:     38.27 MB/sec
Iteration 3:     39.12 MB/sec
-----------------------------
Average (R):     39.30 MB/sec
-----------------------------

Synology DSM 5.2:

Running a 400MB file write on \\dsm5.lan.net\test 3 times...
Iteration 1:     31.61 MB/sec
Iteration 2:     32.61 MB/sec
Iteration 3:     33.46 MB/sec
-----------------------------
Average (W):     32.56 MB/sec
-----------------------------
Running a 400MB file read on \\dsm5.lan.net\test 3 times...
Iteration 1:     50.59 MB/sec
Iteration 2:     61.39 MB/sec
Iteration 3:     59.26 MB/sec
-----------------------------
Average (R):     57.08 MB/sec
-----------------------------

As a result I decided to just stick with Synology DSM 5.2 for now. I’ve hit up Fox_exe to see if he would be gracious enough to build a DSM 6.xx upgrade or fresh install :slight_smile:

My setup will ultimately be 2 MyCloud 3TB G1’s hopefully running a later version of Synology DSM 6.xx rsync’ng between each other locally, then one will sync with some cloud backup service for remote backup disaster recovery needs.

I’m open to any feedback on the configs if anyone has figured out how to get the last few drops of precious performance out of these guys.

1 Like

Thanks Jason. A good detailed reply.

Secret is simple (Umm… maybe not…):
In WD firmware we have patches in samba (Imporved splice, 64k memory page size support). Same in kernel. Only these changes do best performance. Not configs.
Maybe little network tuning will speed get some speed.

As a option - possible to install samba from stock firmware (v03.xx), change few configs (Because WD’ samba does’t support pam auth, only samdb, and dont have a half of original samba’s functionality).
Its boost network speed up to 60-70 MBps.

1 Like

So, is Synology stock samba implementation less efficient / slower than WD out of the box? The way I understand it, I’m now running Synology DSM 5.2 (provided for the most part by Synology) on WD hardware… if that’s true, are WD MyCloud’s actually faster vs the Synology out of the box?

Nope.
In synology installed faster CPU (Same series, but “top” model. 2x1.2GHz vs 2x650MHz in WD), so there is no need to add any tweaks in software for increase performance.

Is it feasible to upgrade / reformat the data part ion on the Synology build to EXT4? Would there be any benefit to doing that at all?

Its OOT but related to debricking.
My device (wd mycloud 2nd gen 4TB) got stuck in safe mode, I tried to upload firmware via web base but it simply wont work, no progress but spinning thing, tried many browser but none are working. (no precentage showing)

I boot using usb debricking method (usbrecovery.tar.gz) and telnet the device just fine, I can mount my data partition also. My question is, how can I upload the original wdmycloud firmware or debian firmware using telnet, where to copy, how to extract bin file etc… All the guide seem to be from a working normal web gui.
Can anyone guide me…?

Thanks

1 Like

https://ftp.anionix.ru/WDMyCloud/WDMyCloud-Gen2/_Unbricking_en.txt

WOW…thanks for your response… I appreciate your time and value your work.
the thing is : 7. After reboot device get old IP address and accessable via Web-GUI (Recovery mode). Use original firmware (.bin file) here. >> I cant upload the firmware… it just spining but no progress precentage.
I did RMA it today and got a new unit.

Thank anyway

Hi,

is any clean installations manual that i can follow to install in my cloud ex4 this firmware?
i dint find in the fox_exe google drive.
Another question, i loose the data is i install the Debian firmware, now i have the system in raid5 and a lot of data.

thanks,
keep the good work

I have WD Mycloud 4TB GEN2. I instal Debian Jessie. Sometime after “reboot” command NAS not reboot correctly, NAS stay in “jammed state”. Network is disconnect (ssh), front LED stay in orange permanent light (red and green LED), no blink. For fix it I must swtich power off/on… After 1 week of some experiments in linux (munit, cacti, hddtem, smartctl…) NAS only sometimes boot correctly. After boot proces (blink blue LED) is jammed with LED orange permanent light… I must try more times switch power off/on for fix. But now after 2 weeks NAS never boot correctly, it is always in jammed state with orange light. I found it in my network, ping is working but nothing more (ssh, telnet, http…).

I try “usbrecovery”… on 2GB USB flash disk and sd card reader with 1GB card.

  1. Use any USB Flash drive, format it to FAT32 (Important!)
  2. Unpack usbrecovery.tar.gz to this drive (You will get “boot” folder and 4 files inside)
  3. Plug this USB drive to WD MyCloud, turn on power. Wait yellow-red (blinking) light.
  4. Connect via Telnet (Search IP in your router, unde DHCP section.)

In NAS boot process (blink blue led) card reader is blink, but NAS never boot from USB.

What is reason of this errors?
how to fix it? thx

Card readers not supported. Only “normal” USB-Flash.

I opened wd box, connect to UART, if I manually restart ssh service through UART, ssh worked ok. I did try reinstall debian, after some complications… it is done and wd my cloud work with new Debian without any faults:) Only /dev/sda is mounted only to /home. /mnt and /media are empty.

Jan 01 00:00:09 wdmc systemd[1]: systemd-remount-fs.service: main process exited, code=exited, status=1/FAILURE
Jan 01 00:00:09 wdmc systemd[1]: Failed to start Remount Root and Kernel File Systems.
Jan 01 00:00:09 wdmc systemd[1]: Unit systemd-remount-fs.service entered failed state.
Jan 01 00:00:09 wdmc systemd-remount-fs[1323]: mount: /dev/pts not mounted or bad option
Jan 01 00:00:09 wdmc systemd-remount-fs[1323]: In some cases useful info is found in syslog - try
Jan 01 00:00:09 wdmc systemd-remount-fs[1323]: dmesg | tail or so.

Hello all, and thanks especially to @Fox_exe for the provided software.
I am having issues in recompiling the kernel, though. I am running debian jessie on my gen1 wd mycloud and am trying to recompile the kernel to add the network namespaces.
I am using this source and extracted the config from my running sda5 partition (with the ./build/linux/scripts/extract-ikconfig script). With the recompiled kernel I get a bootloop.
I get several entries like the following:

[    4.237477] ------------[ cut here ]------------
[    4.237494] WARNING: at /build/linux/fs/sysfs/dir.c :481 sysfs_create_dir+0x191/0x1f8 ()
[    4.237506] sysfs: cannot create duplicate filename '/module/sunrpc  '
[    4.237516] Modules linked in:
[    4.237540] [<840167d1>] (unwind_backtrace+0x1/0x8c ) from [<8403bec5>] (warn_slowpath_fmt+0x49/0x94 )
[    4.237565] [<8403bec5>] (warn_slowpath_fmt+0x49/0x94 ) from [<84140d8d>] (sysfs_create_dir+0x191/0x1)
[    4.237597] [<84140d8d>] (sysfs_create_dir+0x191/0x1f8 ) from [<84234789>] (kobject_add_internal+0x9d)
[    4.237626] [<84234789>] (kobject_add_internal+0x9d/0x1b8 ) from [<84234973>] (kobject_init_and_add+0)
[    4.237657] [<84234973>] (kobject_init_and_add+0xcf/0xd8 ) from [<845d0f81>] (locate_module_kobject+0)
[    4.237682] [<845d0f81>] (locate_module_kobject+0x55/0xa0 ) from [<845d10a3>] (param_sysfs_init+0xd7/)
[    4.237736] [<845d10a3>] (param_sysfs_init+0xd7/0x120 ) from [<840085df>] (do_one_initcall+0x43/0x104)
[    4.237768] [<840085df>] (do_one_initcall+0x43/0x104 ) from [<845cb6c3>] (kernel_init+0xfb/0x164 )
[    4.237796] [<845cb6c3>] (kernel_init+0xfb/0x164 ) from         [<840126fd>] (kernel_thread_exit+0x1/0x8 )
[    4.237811] ---[ end trace 1b75b31a2719edb0 ]---
[    4.237826] kobject_add_internal  failed for sunrpc   with -EEXIST, don't try to register things with.
[    4.237865] [<840167d1>] (unwind_backtrace+0x1/0x8c ) from [<8423486d>] (kobject_add_internal+0x181/0)
[    4.237894] [<8423486d>] (kobject_add_internal+0x181/0x1b8 ) from [<84234973>] (kobject_init_and_add+)
[    4.237925] [<84234973>] (kobject_init_and_add+0xcf/0xd8 ) from [<845d0f81>] (locate_module_kobject+0)
[    4.237950] [<845d0f81>] (locate_module_kobject+0x55/0xa0 ) from [<845d10a3>] (param_sysfs_init+0xd7/)
[    4.237973] [<845d10a3>] (param_sysfs_init+0xd7/0x120 ) from [<840085df>] (do_one_initcall+0x43/0x104)
[    4.237999] [<840085df>] (do_one_initcall+0x43/0x104 ) from [<845cb6c3>] (kernel_init+0xfb/0x164 )
[    4.238025] [<845cb6c3>] (kernel_init+0xfb/0x164 ) from [<840126fd>] (kernel_thread_exit+0x1/0x8 )

For many other modules besides sunrpc. I compiled several kernels for raspberry pi’s and other ARM systems in the past and I usually am able to find a solution, but in this case I think the sorces might have issues.
I tried to download the git release 3.2.68 of the kernel, and to apply the kernel patch in your repo, but it fails to apply.

Please, help me.

My cloud is full but i cant delete anything

Thanks a million for your hard work @Fox_exe. If its okay with you I would like to build of your work write a tutorial on building and compiling the kernel with your patches and create a small github repository for a debian based distro for the WD My Cloud 2 Gen so people can contribute or collaborate. Right now I’ve got it all running using Fox_exe’s kernel and file system (the light never turns green but otherwise the kernel seems to boot fine). Does anyone have interest in helping me put something together. I’d like it so people can build it themselves, fork it, and validate that its legit.

Im asked for help about 2 years… And got respond only from 5 (!) mans… 2 of it - russian.
Ps: And i say “Bit thanx” to 2 mans from Netherlands, who has offered the devices to me for experiences. (WDMC Mirror Gen1 and Gen2)
And one Russian guy (For exchenge mine WDMC Gen1 to Gen2)
Ps: https://github.com/FoxExe/wdmc-gen1-tools

Hi and first of all: Thanks, all in all its a great projekt!

BUT: For me this projekt is only interesting for testing a little bit and i cant understand why everyone is so happy with his Debian for daily use because it is simply too slow!

On my first MyCloud i installed DSM 5.2…at the first time i loved ist, but what is with the Speed? With WD-Firmware i copied with ca. 80MB/s to MyCloud and read with ca. 100MB/s…now with DSM Upgrade/Mod i have never more speed than 35-40 MB/s.

On second MyCloud i tried Clean Debian (until now all 3 Versions). Jessie and Wheezy works great all in all, but have the same issue like DSM…never more than 35-40MB/s.

I read this thread and many says that the 64k version with smb 4 works very fast, but i can´t start samba on this version! It installs and then dont start the services…so this is useless too for me.

Is there someone who can say me, how it get back my speed with copy and write und the MyCloud? Because…with this state i have now i would reinstall the original WD-Firmware…yes, its horrible this firmware, but its the only way to copy my big files with a nice datarate upper 80MB/s.

Thanks for answers, hope you can rescue me MODS and can tell me, how i can speed up my Debian or my DSM5.2.

1 Like

For up speed - need modify Samba sources and build it “from scratch” (Modified sources available in “WD GPL Sourcecode” archive).
Its increase speed upto ~70mbps. For full 100 - need 64k memory page support in kernel.

1 Like