My Cloud OS5 - Indexing taking forever

No, didn’t want to mess with indexing. I will now and report back. Thanks

A reboot now shows the %. 34% after 20+ days. Should I still open a case? Thanks for the help!

I spoke to soon, the % has now disappeared. :frowning:

my experience is that the % disappears when cpu load is too high. you have to be patient till the % reappear

at the moment the collection of log file is impossible as the device is too busy to react on user input
as soon as i get in i will send

Reboot the My Cloud and collect the logs.

Logs uploaded to WD

image
2 days later 9%
4 days for 8%!!!
can’t be real.
i will now reboot as @SBrown suggested and hope to be able to generate logs

latest news!
after reboot as @SBrown suggested. teh system restarted, i was even capable of creating a log file.
but, above all and to much of my exitement:
image
the indexing was not 9% as before the reboot but 989% now.
wo i will stay patient before filing a case

92% after 30+ days. Had to reboot again for the %. Hopefully it will be done in a few days. Trying to play video is painful.

All I know is my indexing from start to finish took 2 months… For a small business with remote access staff, this has now 1000000% turned me off WD. We are in the process of moving to another server setup. WD will no longer be my home server. Once its completed I will be moving all the files over to a new drive, pulling the drives and selling off the WD server.

1 Like

image another 24 hrs later… back to 7% indexing!
so 24hr to reverse 98% to 7% weird!
but at least imanaged to create logs. will file a case.
BUT in all the behavior is inacceptable more than a week for a system to be ready for use after an upgrade that suggests a short time necessary for upgrade.
if i knew this i stayed with os3

My EX2 Ultra OS5 work fine until last firmware update. Now is one week that it continue to “build previews” and fan remain from 3500 to 8000 RPM due to cpu usage… It do again indexing but in a couple of hours it was finished and have some moments where is “Connected” without tasks for 5/10 mins alternating “building preview” all day long for one week also without copy files or doing anythings on cloud shared folders. Grrrr

Im in 2 months right now.
the 1st month indexing is completed!!! for 5.7 TB of data…
the 2nd month is generating thumbnails!!! and yet not finished.
Really dissapointed

1 Like

~40 days now. 5.10.122 was applied a couple nights ago. Still no % even after two reboots. No response from WD case.

@skiingj1 what’s your case number please?

Thanks - Incident: 210227-000276

@skiingj1

I see a single Share called Public in the smb.xml file which is used by the AdminUI.
However, I see something in the /etc/samba/smb.conf file which doesn’t match the smb.xml file.
Looks like the Samba Shares are out of sync which could be causing some issues with RESTSDK which does all the indexing.

2021-02-25T09:13:11.875374-08:00 di=p7XFjQX5hu info RestSDK_AdminUI: {“msgid”:“RestSDK_AdminUI”,“corid”:“AUI:82e03d6c-39fd-4244-adc2-0235dc3652fa”,“function”:“get_device_scan_progresss”,“message”:“Public - status:[complete] scan_file_count:[157412] expect_file_count:[157412]”}
2021-02-25T09:13:12.035234-08:00 di=p7XFjQX5hu info RestSDK_AdminUI: {“msgid”:“RestSDK_AdminUI”,“corid”:“AUI:82e03d6c-39fd-4244-adc2-0235dc3652fa”,“function”:“get_sdk_activity”,“message”:“http://localhost:8001/sdk/v1/device/activityStats”}
2021-02-25T09:13:12.149859-08:00 di=p7XFjQX5hu info RestSDK_AdminUI: {“msgid”:“RestSDK_AdminUI”,“corid”:“AUI:82e03d6c-39fd-4244-adc2-0235dc3652fa”,“function”:“get_sdk_status”,“message”:“activityStats lastUpdate time: [3.14974905]”}
2021-02-25T09:13:12.154870-08:00 di=p7XFjQX5hu info RestSDK_AdminUI: {“msgid”:“RestSDK_AdminUI”,“corid”:“AUI:82e03d6c-39fd-4244-adc2-0235dc3652fa”,“function”:“get_sdk_status”,“message”:“sdk status is [busy]”}

[BRN30055C12DC5A_002501]
comment = 
path = /mnt/HD/HD_a2/BRN30055C12DC5A_002501
browseable = yes
public = no
available = no
oplocks = yes
follow symlinks = yes
map archive = no
read list = "admin"
write list = "admin"
invalid users = "nobody"
valid users = "admin","admin"
vfs objects = catia fruit streams_xattr

SUGGESTION:

I would recommend a System Only Restore and update to 5.10.122 before enable Cloud Access.

Thanks SBrown! I will disable cloud access to get my CPU back, do a backup, run system restore (which if I read correctly will not delete data), and upgrade to 122 (if it reverts back as I’m already on 122). Thanks again.

@skiingj1 What’s the source of the majority of your data? GoPro? Drone? What extension?
I’m seeing a lot of exif reading issues and retries?

err restsdk[5817]: {“corid”:“rrp:RrarQj-JgmMI_H-NqFkd”,“file”:“monitor.go”,“fn”:“Error”,“gitTime”:1609976679,“githash”:“803b1a3”,“importPath”:“vendor/stash.wdmv.wdc.com/midy/goshared/stat”,“line”:686,“msgid”:“error”,“trace”:[{“importPath”:“internal/trans/image”,“file”:“image.go”,“fn”:“(*exifReadLimiter).Read”,“line”:458,“message”:“reading too much exif data”},{“importPath”:“internal/trans/image”,“file”:“image.go”,“fn”:“ExifOrientation”,“line”:416},{“importPath”:“internal/trans/image/vips”,“file”:“libvips.go”,“fn”:“Vips.Config”,“line”:297}]}
info restsdk[5817]: {“attempt”:2,“corid”:“rrp:ossuiH9BPYMOtY-AawwM”,“file”:“resize.go”,“fileID”:“v2uwlklwjgibswksgki2cji7”,“fn”:“(*CachingResizer).runPending.func1”,“gitTime”:1609976679,“githash”:“803b1a3”,“importPath”:“internal/trans/resize”,“line”:1025,“msgid”:“retry create previews”}