@Bill_S please pass this to your programmers to have them work on it ASAP!! (yeah right…)
The scans are your #1 problem leading to complete customer dissatisfaction and if you don’t fix this, sooner or later, probably sooner, you won’t have any satisfied customers at all…
So I bought a 3rd Cloud today… and I left all the services running as is… managed to set everything up, connected and mapped to my Mac mini. Was running fine since it is an empty system. Copied one video file to it and I was surprise to see that the dashboard reported the 1 video immediately.
The chaos all started when I plugged in a USB drive that contains something like a quarter million files; about a 100GB of ebooks, jpegs, etc. The surprising thing was my Passport drive was recognized and mounted (FW04.04.01-112) without problems, but I knew it was trouble as soon as I felt the sluggishness however since this was my new test drive I would let it weather it out.
I kept myself logged in via SSH and every so often I would issue a ps -ALL to see how things were doing as I could hear the attached USB drive thrashing…
For some reason I decided to see if I could eject my USB drive… and that is when I noticed that
- no dashboard response, exited and attempted to view dashboard but got a total blank page.
- the mounted cloud drive disconnected when I tried to copy some files to it.
- was unable to mount the drive again
- attempted to stop the wdmcserverd, but SSH was barely responsive. Managed to issue one stop command before SSH locked
- Once wdmcserverd was stop, all SSH response returned but still no Dashboard, nor the ability to mount. The drive had disappeared.
This is what your customers will see if they mount a USB drive, full of files, to the Cloud; the system eventually locks.
This is the same/similar problem that occurred two years ago and you never fixed it.
Grab a USB drive and fill it with photos, ebooks approximately a quarter million… seriously that is the amount of files that I have just for epubs, another quarter million for photos.
Yes the workaround is to turn off “Media Serving” but how many of your customer will know how to do that?
I think it is time for your programmers to find another solution to create thumbnails, indexes and databases of the media.
This one problem is causing:
- slow and unresponsive drive
- slow or blank dashboard
- disconnection, drop outs
- total system lock
and yet we know, without the scans, your cloud still works except we don’t have thumbnails. I think it is fair to have the thumbnails or index built at the time of query?
or have a button that says scan now… under the user control so they can turn on and off the scans. Scans should be by directory not by shares as I do want to have Cloud access, just not everything thumbnails or indexed. I have photo directories that would be nice to have thumbnails but the other photo directories do not.
So figure it out…
Do something… really…
Every time I hit a little brick wall, it all adds up; all those little things.
I don’t know what to do with 3 x 4TB clouds but since they contain a 4TB red drive, it is tempting to pick up a QNap drive and simply raid them creating a single 8TB raid 5 volume. This thought has passed my mind constantly over the last 2 years.
Edit: So one of the other thing I was testing was the eventual sleep that you promised that once the scans were done, the device would sleep. I have less then a dozen files on the device, one movie file and my supporting script directory. I left it alone all evening and almost all night till 4am until I couldn’t stand the fact that my new cloud did not sleep. Remember that this Cloud is running on the latest firmware 04.04.01-112 and restsdk is still not patched.
Here is the log file:
2015-11-09T20:54:25.285169-08:00 di=k6NucgsedY notice logger: Restarting services 2015-11-09T22:20:37.244854-08:00 di=k6NucgsedY notice logger: exit standby after 8 (since 2015-11-09 22:20:29.686867002 -0800) 2015-11-09T22:30:56.477530-08:00 di=k6NucgsedY notice logger: exit standby after 7 (since 2015-11-09 22:30:49.266867002 -0800) 2015-11-09T22:41:55.083642-08:00 di=k6NucgsedY notice logger: exit standby after 47 (since 2015-11-09 22:41:08.676867002 -0800) 2015-11-09T22:58:06.502868-08:00 di=k6NucgsedY notice logger: exit standby after 359 (since 2015-11-09 22:52:07.266867002 -0800) 2015-11-09T23:08:26.137226-08:00 di=k6NucgsedY notice logger: exit standby after 8 (since 2015-11-09 23:08:18.646867002 -0800) 2015-11-09T23:34:27.844150-08:00 di=k6NucgsedY notice logger: exit standby after 888 (since 2015-11-09 23:19:39.646867002 -0800) 2015-11-10T00:01:10.444271-08:00 di=k6NucgsedY notice logger: exit standby after 990 (since 2015-11-09 23:44:39.986867002 -0800) 2015-11-10T00:01:42.854078-08:00 di=k6NucgsedY notice logger: Rotated atop, atop_size=14631952 atop_upload_size=903298 2015-11-10T00:13:32.885850-08:00 di=k6NucgsedY notice logger: exit standby after 7 (since 2015-11-10 00:13:25.346867002 -0800) 2015-11-10T00:30:10.492607-08:00 di=k6NucgsedY notice logger: exit standby after 386 (since 2015-11-10 00:23:44.926867002 -0800) 2015-11-10T00:42:33.241600-08:00 di=k6NucgsedY notice logger: exit standby after 8 (since 2015-11-10 00:42:25.726867002 -0800) 2015-11-10T01:01:54.155815-08:00 di=k6NucgsedY notice logger: exit standby after 549 (since 2015-11-10 00:52:45.326867002 -0800) 2015-11-10T01:17:10.413106-08:00 di=k6NucgsedY notice logger: exit standby after 304 (since 2015-11-10 01:12:06.266867002 -0800) 2015-11-10T02:01:20.562516-08:00 di=k6NucgsedY notice logger: exit standby after 2038 (since 2015-11-10 01:27:22.446867002 -0800) 2015-11-10T02:53:13.173649-08:00 di=k6NucgsedY notice logger: exit standby after 2501 (since 2015-11-10 02:11:32.486867002 -0800) 2015-11-10T03:00:03.408793-08:00 di=k6NucgsedY notice getNewFirmwareUpgrade.sh: begin script: immediate send_alert auto 2015-11-10T03:00:03.481344-08:00 di=k6NucgsedY notice getNewFirmwareUpgrade.sh: http://support.wdc.com/nas/list.asp?devtype=sq&devfw=04.04.01-112&devlang=eng&devsn=&auto=0&devid=***** 2015-11-10T03:00:05.933675-08:00 di=k6NucgsedY notice logger: ga_collect: dryrun=0, first=1 2015-11-10T03:00:25.732887-08:00 di=k6NucgsedY notice logger: ga_collect: dryrun=0, first=0 2015-11-10T03:01:01.834127-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/", "capacityK":1968336, "totalK":659264, "partition":"rootfs" } 2015-11-10T03:01:01.880774-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/", "capacityK":1968336, "totalK":659264, "partition":"/dev/root" } 2015-11-10T03:01:01.913407-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/run", "capacityK":40960, "totalK":3904, "partition":"tmpfs" } 2015-11-10T03:01:01.952100-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/run/lock", "capacityK":40960, "totalK":64, "partition":"tmpfs" } 2015-11-10T03:01:01.978658-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/dev", "capacityK":10240, "totalK":0, "partition":"tmpfs" } 2015-11-10T03:01:02.003643-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/run/shm", "capacityK":5120, "totalK":0, "partition":"tmpfs" } 2015-11-10T03:01:02.023366-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/tmp", "capacityK":102400, "totalK":3264, "partition":"tmpfs" } 2015-11-10T03:01:02.051809-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/var/log", "capacityK":40960, "totalK":10048, "partition":"ramlog-tmpfs" } 2015-11-10T03:01:02.071494-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"/DataVolume", "capacityK":3841069352, "totalK":1199592, "partition":"/dev/sda4" } 2015-11-10T03:01:02.211121-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"dataSize", "mountPoint":"93de3f6b1c6f991dd33d2212f3ed9055/var/media/", "capacityK":3906546640, "totalK":1771440, "partition":"/dev/sdb2" } 2015-11-10T03:01:02.259823-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"rootfs", "inode":125184, "iused":25169, "mountPoint":"/" } 2015-11-10T03:01:02.279219-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"/dev/root", "inode":125184, "iused":25169, "mountPoint":"/" } 2015-11-10T03:01:02.298846-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"tmpfs", "inode":1815, "iused":247, "mountPoint":"/run" } 2015-11-10T03:01:02.318624-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"tmpfs", "inode":1815, "iused":5, "mountPoint":"/run/lock" } 2015-11-10T03:01:02.338317-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"tmpfs", "inode":1815, "iused":176, "mountPoint":"/dev" } 2015-11-10T03:01:02.358258-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"tmpfs", "inode":1815, "iused":2, "mountPoint":"/run/shm" } 2015-11-10T03:01:02.377697-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"tmpfs", "inode":20480, "iused":77, "mountPoint":"/tmp" } 2015-11-10T03:01:02.404931-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"ramlog-tmpfs", "inode":1815, "iused":110, "mountPoint":"/var/log" } 2015-11-10T03:01:02.424613-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"/dev/sda4", "inode":243900416, "iused":2695, "mountPoint":"/DataVolume" } 2015-11-10T03:01:02.524537-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"inodeUsage", "filesystem":"/dev/sdb2", "inode":0, "iused":0, "mountPoint":"93de3f6b1c6f991dd33d2212f3ed9055/var/media/" } 2015-11-10T03:01:04.268253-08:00 di=k6NucgsedY notice BaseOSlog: { "msgid":"usageSize", "totalB":2027561616, "photos":0, "video":990707537, "music":0, "other":1036854079 } 2015-11-10T03:05:02.299070-08:00 di=k6NucgsedY notice logger: disable lazy init 2015-11-10T03:15:46.356066-08:00 di=k6NucgsedY notice logger: exit standby after 8 (since 2015-11-10 03:15:38.786651001 -0800) 2015-11-10T03:28:52.360260-08:00 di=k6NucgsedY notice logger: exit standby after 174 (since 2015-11-10 03:25:58.406651001 -0800) 2015-11-10T03:39:12.075818-08:00 di=k6NucgsedY notice logger: exit standby after 8 (since 2015-11-10 03:39:04.556651001 -0800) 2015-11-10T03:40:53.697994-08:00 di=k6NucgsedY warning wdmcserver: Received signal 2, stopping listeners. 2015-11-10T03:41:03.322333-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:41:13.324119-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:41:23.325603-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:41:33.327029-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:41:43.328416-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:41:53.329942-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:42:03.331349-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:42:13.332765-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:42:23.334186-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:42:33.335626-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:42:43.337033-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:42:53.341483-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:43:03.345296-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:43:13.346926-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:43:23.348389-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:43:33.349874-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:43:43.351299-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:43:53.352767-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:44:03.354218-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:44:13.355660-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:44:23.357108-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:44:33.358501-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:44:43.360001-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused 2015-11-10T03:44:53.363765-08:00 di=k6NucgsedY notice restsdk[6963]: paths.go:49: Could not dial crawler socket at '/tmp/WDMCRequest.socket', error: dial unix /tmp/WDMCRequest.socket: connect: connection refused