Clean OS (Debian), OpenMediaVault and other "firmwares"

Is there a compiled samba 4 bin for 4k debian? I’ve installed a clean debian and updated it to the latest possible version, installed samba v4 but the speed is depressing. I’m getting something around 20MB\s with any settings i try.

Strange. Minimum is 45/30 (Read/Write) MB/s (W/o any tuning).
Up to 75/40MB/s after tuning and ~90mb/s after replace samba to WD version.
Google for “Tuning samba for RaspberyPI”. We have similar hardware, so almost all instructions can work.

1 Like

Just reinstalled a clean system and updated it.

PRETTY_NAME=“Debian GNU/Linux 9 (stretch)”
NAME=“Debian GNU/Linux”
VERSION_ID=“9”
VERSION=“9 (stretch)”
Samba version 4.5.8-Debian

Nothing like custom bins and config is default (only 2 shares added). Maximium writing speed i get is 25 MB\s.
I’ve managed to get 130 MB\s using a piece of software named TeraCopy but it drops back to 25 MB\s after writing 1,4GB or so. I’m not even sure if it’s real or a bug (IOTOP never shows DISK WRITE greater than 35 MB\s).
Can you please give me the contents of your smb.conf? Also is there a custom bin i can install for my system?
I’ve tried pretty much any combo of socket options and cache settings from this topic but never got anything better than 25 MB\s.

I get about 50mb without any tuning.

dd if=/dev/zero of=testfile bs=1M count=1024 oflag=direct status=progress
1027604480 bytes (1.0 GB, 980 MiB) copied, 21.0154 s, 48.9 MB/s
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 22.0074 s, 48.8 MB/s

samba-4.6.4-r0 and kernel 4.12.0

Use iperf3 to check your network connection, if network is fine.

Johns

1 Like

dd if=/dev/zero of=testfile bs=1M count=1024 oflag=direct status=progress
1063256064 bytes (1.1 GB, 1014 MiB) copied, 26.0043 s, 40.9 MB/s
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 26.3461 s, 40.8 MB/s

I’m honestly not sure what this test does, so i’ve ran another dd to /sda4 data partition and got 92MB\s there.
I’ve used iperf3 and got 36MB\s over TCP and 112MB\s with the -u flag (UDP). Results are almost the same for both of my Windows and Debian systems in client to server test, but Debian shows 20-25 MB\s over TCP.
Meanwhile Samba still never touches 30 MB\s.
What can i do now? I assume i can’t force samba to use UDP at all times?

I have tested how fast are the writes on the mounted samba drive.

I think we have found your problem, your network is too slow.
Bad wire, bad switch, bad router, bad network card, …
Too long wires, too much traffic, …

wdmycloud 3.10.70+ #5 SMP Wed Jun 7 23:38:41 +05 2017 armv7l Linux
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-120.00 sec  13.0 GBytes   930 Mbits/sec  765             sender
[  4]   0.00-120.00 sec  13.0 GBytes   930 Mbits/sec                  receiver

You should get arround 1000 MBits.

Connect the WD My Cloud without any switch/router to your pc and test.

When you get better performance with iperf3, than your samba will be faster too.

Johns

I’ll try a direct connection later, but i really doubt it’s the network.
Because i’ve just messed with the sysctl settings and managed to get 10 more MB\s by changing WD’s clean debian settings, now i get 44 MB\s in iperf3, but still only 25 in Samba.
I’ll probably regret it because i believe these setting are far from optimal for our hardware, but here are the new ones that made my tests faster:

net.ipv4.tcp_window_scaling = 1
net.core.rmem_max = 16777216
net.ipv4.tcp_rmem = 4096 87380 16777216
net.ipv4.tcp_wmem = 4096 16384 16777216

And the results for TCP (Windows to Debian):

[ ID] Interval Transfer Bandwidth
[ 5] 0.00-10.01 sec 0.00 Bytes 0.00 bits/sec sender
[ 5] 0.00-10.01 sec 444 MBytes 372 Mbits/sec receiver

Hi Guys.
Firstly sorry by my english. I’m from Brazil and english don’t is my primary language.
Second thanks to @Fox_exe by give us a lot of information and tools. You really did a great job.
I would like share a information about my difficult in install OMV.
My problem:
I installed Debian + OMV in my Gen2 mycloud 6TB single bay. But I have big problem. I couldn’t see any devices when I tryed add file systems. In Shared folder I could´t add to, because in device list didnt show any.
I try followed howto of @Fox_exe with just 3 partition. In wiki of openmediavault I read “Harddisks are only listed in Storage > Filesystems > Create > Device if they are clean. Make sure the disks do not contain a filesystem or partition. If your harddrive is not clean, wipe it before usage.”
Then I followed the how_to of @Fox_exe but I created 4 partition.
I change this part:

End format HDD…

parted /dev/sda
rm 3
mkpart primary 4G 100%
mkpart primary 1G 4G
q
mkfs.ext4 /dev/sda2
mkfs.ext4 /dev/sda3
for this:

End format HDD…

parted /dev/sda
rm 3
mkpart primary 4G 10G
mkpart primary 1G 4G
mkpart primary 10G 100%
q

mkfs.ext4 /dev/sda2
mkfs.ext4 /dev/sda3
mkfs.ext4 /dev/sda4

Then I mount /dev/sda4 through GUI in storage/file system and Then I could create file system normally.
I hope that this information will be useful for someone who, like me, does not know linux very well.

Hey Guys,
Got some problem.
I can’t tell my Gen2 with OMV to sleep after x hours (Spindown)
Change the settings in “Physical disk properties” and all services disabled up to SSH.
Any ideas or suggestions ?

Hi, first thanks for everything!
I have been using gen 1 mycloud with your clean debian.
Few days ago I did dist-upgrade from jessie to stretch. Since then, my console is printing tons of messages just like below instead of a simple OK message. It is from running “service sshd restart”
What can I do to change back to the simple message?

Sent message type=method_call sender=n/a destination=org.freedesktop.systemd1 object=/org/freedesktop/systemd1 interface=org.freedesktop.systemd1.Manager member=GetUnit cookie=1 reply_cookie=0 error=n/a
Sent message type=method_call sender=n/a destination=org.freedesktop.systemd1 object=/org/freedesktop/systemd1/unit/multi_2duser_2etarget interface=org.freedesktop.DBus.Properties member=Get cookie=2 reply_cookie=0 error=n/a
Calling manager for RestartUnit on sshd.service, replace
Sent message type=method_call sender=n/a destination=org.freedesktop.systemd1 object=/org/freedesktop/systemd1 interface=org.freedesktop.systemd1.Manager member=RestartUnit cookie=1 reply_cookie=0 error=n/a
Sent message type=method_call sender=n/a destination=org.freedesktop.systemd1 object=/org/freedesktop/systemd1 interface=org.freedesktop.systemd1.Manager member=GetUnit cookie=2 reply_cookie=0 error=n/a
Sent message type=method_call sender=n/a destination=org.freedesktop.systemd1 object=/org/freedesktop/systemd1/unit/ssh_2eservice interface=org.freedesktop.DBus.Properties member=Get cookie=3 reply_cookie=0 error=n/a
Adding /org/freedesktop/systemd1/job/251 to the set
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1 interface=org.freedesktop.systemd1.Manager member=JobNew cookie=2 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.systemd1.Manager.JobNew() on /org/freedesktop/systemd1
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/unit/ssh_2eservice interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=5 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/unit/ssh_2eservice
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/unit/ssh_2eservice interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=6 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/unit/ssh_2eservice
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/job/251 interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=7 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/job/251
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/unit/ssh_2eservice interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=8 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/unit/ssh_2eservice
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/unit/ssh_2eservice interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=9 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/unit/ssh_2eservice
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/job/251 interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=10 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/job/251
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/unit/ssh_2eservice interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=11 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/unit/ssh_2eservice
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/unit/ssh_2eservice interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=12 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/unit/ssh_2eservice
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1/job/251 interface=org.freedesktop.DBus.Properties member=PropertiesChanged cookie=13 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.DBus.Properties.PropertiesChanged() on /org/freedesktop/systemd1/job/251
Got message type=signal sender=n/a destination=n/a object=/org/freedesktop/systemd1 interface=org.freedesktop.systemd1.Manager member=JobRemoved cookie=14 reply_cookie=0 error=n/a
Got D-Bus request: org.freedesktop.systemd1.Manager.JobRemoved() on /org/freedesktop/systemd1
Got result done/Success for job ssh.service

Hmm… Maybe change log level or similar?

Hey guys,

Is it sensible and at all possible to run OMV 3 Erasmus on a WD Gen1?

And if so, how can I upgrade the Stoneburner 2.2.14 to Erasmus?

~# uname -a
Linux MYCLOUDE-6TB 3.2.26 #4 SMP Fri Aug 1 01:55:50 YEKT 2014 wd-2.0-rel armv7l GNU/Linux

First thing - replace kernel to 3.2.68 (Latest).
Then - replace Wheezy to Jessie in /etc/apt/sources.list
do apt update && apt upgrade && apt dist-upgrade
Then - change sources for OMV repo and do apt update/upgrade again.

…reboot and pray…

And what i have to do, to replace the Kernel?
And where can I find the new kernel or where do I get this?

Pray?

Reads as if it does not really work.
Is the Stoneburner running under Jessie or is Jessie nothing for the GEN1?

I test Jessie + OMV 3.0.6 on kernel 3.2.68. Worrks perfect, but while migrate from Wheezy to Jessie i got few little problems (pfe module cant load, ssh keys brocken etc… All success fixed via UART.)

And how do I upgrade the kernel?
Is it enough if I simply extract the .tar.gz and overwrite with the current files?

https://www.google.co.uk/search?q=update+linux+kernel

Which firmware/OS is the fastest AND has working sleep for old GEN1 4TB mycloud?

Do not need any features, just NAS (samba). I do not use cloud features. I access via VPN when away, so its still “local”. I have MyCloud blocked from ALL internet traffic for security.

hi!
i am trying to install on a WD mirror 2.generation.

  1. try to install debian as app - ok, working i have a chrooted debian. where to go from here?

  2. when i try to install wd-to-dsm.bin i get an error during install. installation aborts ???

  3. i have been reading the forum.
    you install a uImage and a uRamdisk to a usb and start from usb.
    system was same as before ( i renamed uImage-debian-a385 to uImage)

  4. i tried to copy uImage and uRamdisk to /mnt/boot
    rebooted
    nothing

i am really lost on how to install debian or dsm ???
maybe you can share (a link) howto setup your development step by step ( bad english no problem speak the same :wink: )

For Gen1 (firmware v.04.xx):

cd /tmp wget http://anionix.ddns.net/WDMyCloud/WDMyCloud-Gen1/Developing/Linux-3.2.68-bin.tar.gz tar xvzf Linux-3.2.68-bin.tar.gz -C / dd if=/uImage of=/dev/sda5 reboot