Indexing 1TB of data 4 days - restsdk-server at 80%

My Cloud OS 5 Personal & Network Attached Storage My Cloud Mirror
1

Hi

my WD My Cloud Gen 2 after update has been indexing my HD for more than 4 days already ( 1TB of data ) and overall the unit seems occupied.

Processes shows ‘restsdk-server’ and ‘top’ is eating 80% of the CPU resource.

Can you help me to deactivate Indexing which I do not need?

PS: after a reboot, the device is basically unresponsive. occasionally I can get into the menu but then it becomes unresponsive again.

image
image817×506 16.5 KB

3 Likes
3

@vendo232, Please find the below points

  1. All of your content will still be accessible from PC locally using SMB or AFP.
    How To Map a WD Network Drive on Windows 10
    How to Map a WD Network Drive on Windows 10 and Windows 11

  2. Accessing content from mobile and web apps will require cloud access turned on and content indexed

  3. Turning off cloud access,

  • will disable access to web and mobile apps access

  • will disable indexing

My Cloud OS 5: How To Disable and Enable My Cloud Indexing and Media Services
https://support-en.wd.com/app/answers/detail/a_id/29819/

  1. You can turn off web and mobile app access for individual shares
    My Cloud OS 5: User Share Indexing
    My Cloud OS 5: User Share Cloud Access and Indexing

  2. Depending on the amount of content on your device, indexing can take from a couple of days to multiple days.

  3. Rebooting the device will not stop indexing, but will continue to index and may add delays

1 Like
4

Thank you, I have disabled Cloud and it helped.

5

– - - yes; disabling the cloud access stops indexing; but it also disables one of the biggest features of the OS/5 upgrade.

I think the real issue is;

  • Indexing is too slow.
  • Indexing should not be on a share-by-share basis. You should only index chosen directories.

I would like to recommend a modification to the software such that you can chose which directories within a share are subject to indexing/thumbnail generation and which ones have access without thumbnails.

Note that I don’t need to have the nas rescanning EVERY file I transfer into a given share. I really don’t need it to try to generate thumbnails for every piece of music; every photo; every video on the drive. Worse; it really doesn’t need to attempt thumbnails for every excel file or PDF on the drive.

Now. . .I could potentially put all the files I want indexed into a separate share, but that seems . . . . suboptimal. What that would lead to is shares like “User A indexed files” “User A non-indexed files” and so on for each user. Much easier to say “Only index Photos folder for 2020 on this share”; and call it a day.

I face this often with Twonky servers. . .it tries to index music and whatnot EVERYWHERE on the drive. . .including backups; working folders; ringtones. . . . EVERYTHING. The result is a disorganized mess. And it takes alot of time.

My solution to this twonky problem was simply: Go into the configuration and point the software to the nicely organized “Music” folder. It then gives a nice result and ignores all the random crud on the drive.

Thank you for listening. Have a nice day.

5 Likes
6

I unfortunately took the steps to upgrade to OS5 and now i am regretting it. Here is why:
Since i have upgraded it is indexing 8tb of both hard drives. If i turn off *Mobile & Web APP Access, then my share disappear from the cloud app. This is utterly nonsense!
Instead it should have a functionality that we could turn indexing off while still be able to access the folders using the app cloud app. It really defeats the purpose. AND cannot even see any sort of progress bar as to how much is done or how much is left!

Warning everyone what once you upgrade it will index the harddrives which could take days and if you disable indexing you cant see share on cloud app.

WD, please do something about it or you will have a lot of upset users.

7

In every way (except maybe security) the OS5 cloud (and the app) is currently substantially inferior to the OS3 version.

Just a few things:

Lack of file data (date / time and size) in the list view
5GB upload limit
Inability to copy across shares

Also, I’m surprised they didn’t come up with a replacement for the local file manager.

To be fair, I don’t know if WD intend to address any or all of these points, given this is still pre-release.

1 Like
8

Dear Customer Support,

May I ask you why my PR4100 is being indexing whole data after second update from 5.03 to 5.04 firmware version? First time it took about 2 days and it seems it will happen again.

Will it happen every update? This is ridiculous…

Bernard

9

Pitching in here. My Gen2 Mirror has been indexing for four (five?) days now. It just won’t stop. There’s no progress bar of any sort or any way go telling me what’s actually going on. I’ve removed a tonne of content from it and it’s still indexing. It’s insane.

I don’t even need the content indexing, just give me folder navigation and I’m good.

10

IMPORTANT35pxx45px Important:

It may take from a few hours up to a few days or more to complete Indexing depending on the size and type of your content. Rebooting the My Cloud will restart the indexing process again

11

Turning OFF Cloud Access will stop the indexing.

12

Well, yeah, I have done that now but then I lose remote access. I want remote access but without the indexing. The indexed image view gives me nothing I need, a navigable folder view is more than fine. If I could kill the indexing process I’d happily do that.

1 Like
13

@tracheotomy_bob I understand your suggestion.

Indexing is a process included on My Cloud OS 3 as well and is also required for Remote Access. The difference is My Cloud OS 5 is indexing 100% of the content already on the device.

OS 3 INDEXING EXAMPLE:
If you performed a quick or full factory restore of the My Cloud on OS 3, disabled Remote Access , Indexing will also be turned off. Then copied 100% of the content onto the My Cloud OS 3. Once Cloud Access in turned ON in My Cloud OS 3, 100% of the content will be indexed similar to what OS 5 is doing now.

I hope this explanation helps.

14

With OS 3 it could be turned off. I never needed to do it because it actually worked ok but it was always an option. With OS 5 indexing doesn’t work very well. The app is useless until indexing has finished which just didn’t happen in a reasonable timeframe. I don’t think it should take days and days to index content.

I’ve got a 40TB PR4100 and that indexed all the films and TV programmes that are on there and generated a list of pretty useless key frames. The images mean absolutely nothing and unless the key frame actually lands on something useful the image gives no clue as to what it actually relates to. That’s just not useful functionality. Navigating by folder structure has value because I know where things are, navigating by randomly selected images is useless.

The PR4100 indexing finished pretty quickly, the Gen 2 indexing took days and days and days and I just gave up on it in the end. Again, it was generating pages of useless images but it never actually finished. It’s super frustrating.

If we could at least add a .noindex file to folders so the indexing process would skip that folder that would be something. We really need a way to either disable indexing globally or have a way to tell the process to ignore a folder. Something that lets us manage the indexing in a sensible way.

15

4 days and a 6TB PR 2100 is still at 100% CPU, with high user being restsdk_server.

Is this really expected, or is there a BUG?
Regards
Bruce

16

It doesn’t help at all.

17

Thank God I have my own vpn and don’t need their remote access bullcrap, my pr4100 32TB has been under full load for more than a week non stop… I have just turned it off, I might turn it back on when they release an update because this is unbelivable.

1 Like
18

I reenabled remote access my my Gen2 and after six days it’s still indexing. This is nuts. Using the WD app it takes at least ten minutes to present the initial folder list (if it ever completes) and then navigating to a subfolder takes around another five minutes. Some contents just never appear, if that folder has images in then some load and some don’t. The Photos view constantly says “Please try again”. It never works.

The UI on the device can’t tell me whether indexing has finished or not. It just says “Retrieving information” and that’s it. On the Configure Cloud Access page the only user that is supposed to have cloud access is logged out (why is it always logging me out?) and the connection status is never reported. IF I do manage to log in (which is rare because it always gets stuck saying “updating”) then the status appears to still be “indexing”.

Six days, 1TB of content and it’s still not working. SIX DAYS! That’s just poor. There is absolutely nothing positive about this update. I need the performance I had before and this is not cutting it.

19

it’s maddening
I’ve been indexing for almost a week and it gets stuck.
the hard drives and the fan are running 24 hours and the temperature does not drop.

I have disabled access to the cloud
so that the hard disks rest and instead I access the nas through ftp explorer and smb locally.
but even so the restsdk process is still using a lot of memory.
I think I’m going to switch to synology

20

Same here.
Basically everything OS 3 offered is now useless or not working at all. Waiting for an hour to just log on to your device. Used the “power plan” option before to shut down the device at night, but since this s***tty indexing process starts again whenever the device powers up and effectively block access to your data, this option is useless. Even when indexing has completed finally, performance is much, much worse than under OS 3. Obviously, UX was not taken into consideration in the development of OS 5. Switching off remote access just to stop indexing is utterly ridiculous.

@WD: get this fixed! Even considering to buy another brand right now - never to return to WD again…

21

same issue, it runs indexation since 7 days now and my Mirror Gen2 is slow to die. No news from WD about this issue