My Cloud got many "Exception" and cannot be accessed

Hi, 

I have a My Cloud that has cannot access issue, only power cycle can bring My Cloud back, I found some pepole have similar issue here. I tried to login to My Cloud by SSH and got the Kernel log before My Cloud disconnected, and I found there are many “Exception” in kernel, is that normally? does anyone have same Exception message?

Below messages are from my My Cloud.

Thanks.

One of the Exception message in “kernel.log.1” file

Mar 19 08:54:03 Getter2 kernel: [240237.875453] Exception stack(0xcd945fb0 to 0xcd945ff8)
Mar 19 08:54:03 Getter2 kernel: [240237.880632] 5fa0: 45d07020 80808080 00103618 45efb000
Mar 19 08:54:03 Getter2 kernel: [240237.888967] 5fc0: 020eab60 002f7600 00000438 00000780 020ecc00 017cacb0 017c9260 00000000
Mar 19 08:54:03 Getter2 kernel: [240237.897289] 5fe0: 80808080 bed59578 4017c5d1 40d63dc0 20000010 ffffffff
Mar 19 08:54:03 Getter2 kernel: [240237.904051] Task in /ffmpeg killed as a result of limit of /ffmpeg
Mar 19 08:54:03 Getter2 kernel: [240237.910364] memory: usage 81920kB, limit 81920kB, failcnt 520730
Mar 19 08:54:03 Getter2 kernel: [240237.916504] memory+swap: usage 81920kB, limit 81920kB, failcnt 8566
Mar 19 08:54:03 Getter2 kernel: [240237.922921] Mem-info:
Mar 19 08:54:03 Getter2 kernel: [240237.925300] DMA per-cpu:
Mar 19 08:54:03 Getter2 kernel: [240237.927938] CPU 0: hi: 6, btch: 1 usd: 0
Mar 19 08:54:03 Getter2 kernel: [240237.932862] CPU 1: hi: 6, btch: 1 usd: 5
Mar 19 08:54:03 Getter2 kernel: [240237.937768] Normal per-cpu:
Mar 19 08:54:03 Getter2 kernel: [240237.940667] CPU 0: hi: 90, btch: 15 usd: 67
Mar 19 08:54:03 Getter2 kernel: [240237.945590] CPU 1: hi: 90, btch: 15 usd: 11
Mar 19 08:54:03 Getter2 kernel: [240237.950509] active_anon:11396 inactive_anon:18362 isolated_anon:0
Mar 19 08:54:03 Getter2 kernel: [240237.950515] active_file:3938 inactive_file:5736 isolated_file:0
Mar 19 08:54:03 Getter2 kernel: [240237.950520] unevictable:0 dirty:0 writeback:0 unstable:0
Mar 19 08:54:03 Getter2 kernel: [240237.950525] free:11584 slab_reclaimable:2824 slab_unreclaimable:1786
Mar 19 08:54:03 Getter2 kernel: [240237.950531] mapped:2932 shmem:906 pagetables:480 bounce:0
Mar 19 08:54:03 Getter2 kernel: [240237.980563] DMA free:43936kB min:364kB low:452kB high:544kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:44704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Mar 19 08:54:03 Getter2 kernel: [240238.017031] lowmem_reserve: 0 48728 48728
Mar 19 08:54:03 Getter2 kernel: [240238.021402] Normal free:2400kB min:1588kB low:1984kB high:2380kB active_anon:45584kB inactive_anon:73448kB active_file:15752kB inactive_file:23160kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:194912kB mlocked:0kB dirty:0kB writeback:0kB mapped:11728kB shmem:3624kB slab_reclaimable:11296kB slab_unreclaimable:7144kB kernel_stack:1520kB pagetables:1920kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Mar 19 08:54:03 Getter2 kernel: [240238.061437] lowmem_reserve: 0 0 0
Mar 19 08:54:03 Getter2 kernel: [240238.065124] DMA: 1*4kB 1*8kB 0*16kB 3*32kB 1*64kB 2*128kB 2*256kB 2*512kB 1*1024kB 0*2048kB 10*4096kB = 43948kB
Mar 19 08:54:03 Getter2 kernel: [240238.075538] Normal: 542*4kB 12*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2280kB
Mar 19 08:54:03 Getter2 kernel: [240238.086305] 13969 total pagecache pages
Mar 19 08:54:03 Getter2 kernel: [240238.090258] 3208 pages in swap cache
Mar 19 08:54:03 Getter2 kernel: [240238.093984] Swap cache stats: add 1753951, delete 1750743, find 2481275/2760661
Mar 19 08:54:03 Getter2 kernel: [240238.101421] Free swap = 468004kB
Mar 19 08:54:03 Getter2 kernel: [240238.104869] Total swap = 500732kB
Mar 19 08:54:03 Getter2 kernel: [240238.123924] 65536 pages of RAM
Mar 19 08:54:03 Getter2 kernel: [240238.127087] 11815 free pages
Mar 19 08:54:03 Getter2 kernel: [240238.130070] 7896 reserved pages
Mar 19 08:54:03 Getter2 kernel: [240238.133351] 4611 slab pages
Mar 19 08:54:03 Getter2 kernel: [240238.136260] 8650 pages shared
Mar 19 08:54:03 Getter2 kernel: [240238.139333] 3208 pages swap cached
Mar 19 08:54:03 Getter2 kernel: [240238.142860] [pid] uid tgid total_vm rss cpu oom_adj oom_score_adj name
Mar 19 08:54:03 Getter2 kernel: [240238.150492] [8932] 0 8932 25600 20847 1 0 0 ffmpeg
Mar 20 01:05:29 Getter2 kernel: [298523.221718] wdmcserver: page allocation failure: order:1, mode:0x20
Mar 20 01:05:29 Getter2 kernel: [298523.228155] [] (unwind_backtrace+0x0/0xf8) from [] (warn_alloc_failed+0xf0/0x118)
Mar 20 01:05:29 Getter2 kernel: [298523.237531] [] (warn_alloc_failed+0xf0/0x118) from [] (__alloc_pages_nodemask+0x9b8/0xb04)
Mar 20 01:05:29 Getter2 kernel: [298523.247701] [] (__alloc_pages_nodemask+0x9b8/0xb04) from [] (cache_alloc_refill+0x330/0x59c)
Mar 20 01:05:29 Getter2 kernel: [298523.258032] [] (cache_alloc_refill+0x330/0x59c) from [] (kmem_cache_alloc+0x70/0x114)
Mar 20 01:05:29 Getter2 kernel: [298523.267762] [] (kmem_cache_alloc+0x70/0x114) from [] (sk_prot_alloc.isra.26+0x24/0x158)
Mar 20 01:05:29 Getter2 kernel: [298523.277655] [] (sk_prot_alloc.isra.26+0x24/0x158) from [] (sk_clone+0x14/0x240)
Mar 20 01:05:29 Getter2 kernel: [298523.286860] [] (sk_clone+0x14/0x240) from [] (inet_csk_clone+0x10/0x7c)
Mar 20 01:05:29 Getter2 kernel: [298523.295359] [] (inet_csk_clone+0x10/0x7c) from [] (tcp_create_openreq_child+0x18/0x398)
Mar 20 01:05:29 Getter2 kernel: [298523.305249] [] (tcp_create_openreq_child+0x18/0x398) from [] (tcp_v4_syn_recv_sock+0x30/0x2a4)
Mar 20 01:05:29 Getter2 kernel: [298523.315746] [] (tcp_v4_syn_recv_sock+0x30/0x2a4) from [] (tcp_check_req+0x31c/0x4e0)
Mar 20 01:05:29 Getter2 kernel: [298523.325370] [] (tcp_check_req+0x31c/0x4e0) from [] (tcp_v4_do_rcv+0xf0/0x2c0)
Mar 20 01:05:29 Getter2 kernel: [298523.334383] [] (tcp_v4_do_rcv+0xf0/0x2c0) from [] (tcp_v4_rcv+0x72c/0x82c)
Mar 20 01:05:29 Getter2 kernel: [298523.343134] [] (tcp_v4_rcv+0x72c/0x82c) from [] (ip_local_deliver_finish+0xc8/0x250)
Mar 20 01:05:29 Getter2 kernel: [298523.352759] [] (ip_local_deliver_finish+0xc8/0x250) from [] (ip_rcv_finish+0x3dc/0x424)
Mar 20 01:05:29 Getter2 kernel: [298523.362655] [] (ip_rcv_finish+0x3dc/0x424) from [] (__netif_receive_skb+0x354/0x3e8)
Mar 20 01:05:29 Getter2 kernel: [298523.372285] [] (__netif_receive_skb+0x354/0x3e8) from [] (netif_receive_skb+0x84/0x94)
Mar 20 01:05:29 Getter2 kernel: [298523.382258] [] (netif_receive_skb+0x84/0x94) from [] (pfe_eth_poll+0x638/0x71c [pfe])
Mar 20 01:05:29 Getter2 kernel: [298523.392066] [] (pfe_eth_poll+0x638/0x71c [pfe]) from [] (net_rx_action+0x80/0x284)
Mar 20 01:05:29 Getter2 kernel: [298523.401527] [] (net_rx_action+0x80/0x284) from [] (__do_softirq+0xd4/0x2ac)
Mar 20 01:05:29 Getter2 kernel: [298523.410369] [] (__do_softirq+0xd4/0x2ac) from [] (irq_exit+0x48/0x8c)
Mar 20 01:05:29 Getter2 kernel: [298523.418700] [] (irq_exit+0x48/0x8c) from [] (asm_do_IRQ+0x80/0xac)
Mar 20 01:05:29 Getter2 kernel: [298523.426768] [] (asm_do_IRQ+0x80/0xac) from [] (__irq_usr+0x34/0xa0)

One of the Exception message in “kernel.log.2” file

Mar 19 08:54:03 Getter2 kernel: [240237.875453] Exception stack(0xcd945fb0 to 0xcd945ff8)
Mar 19 08:54:03 Getter2 kernel: [240237.880632] 5fa0: 45d07020 80808080 00103618 45efb000
Mar 19 08:54:03 Getter2 kernel: [240237.888967] 5fc0: 020eab60 002f7600 00000438 00000780 020ecc00 017cacb0 017c9260 00000000
Mar 19 08:54:03 Getter2 kernel: [240237.897289] 5fe0: 80808080 bed59578 4017c5d1 40d63dc0 20000010 ffffffff
Mar 19 08:54:03 Getter2 kernel: [240237.904051] Task in /ffmpeg killed as a result of limit of /ffmpeg
Mar 19 08:54:03 Getter2 kernel: [240237.910364] memory: usage 81920kB, limit 81920kB, failcnt 520730
Mar 19 08:54:03 Getter2 kernel: [240237.916504] memory+swap: usage 81920kB, limit 81920kB, failcnt 8566
Mar 19 08:54:03 Getter2 kernel: [240237.922921] Mem-info:
Mar 19 08:54:03 Getter2 kernel: [240237.925300] DMA per-cpu:
Mar 19 08:54:03 Getter2 kernel: [240237.927938] CPU 0: hi: 6, btch: 1 usd: 0
Mar 19 08:54:03 Getter2 kernel: [240237.932862] CPU 1: hi: 6, btch: 1 usd: 5
Mar 19 08:54:03 Getter2 kernel: [240237.937768] Normal per-cpu:
Mar 19 08:54:03 Getter2 kernel: [240237.940667] CPU 0: hi: 90, btch: 15 usd: 67
Mar 19 08:54:03 Getter2 kernel: [240237.945590] CPU 1: hi: 90, btch: 15 usd: 11
Mar 19 08:54:03 Getter2 kernel: [240237.950509] active_anon:11396 inactive_anon:18362 isolated_anon:0
Mar 19 08:54:03 Getter2 kernel: [240237.950515] active_file:3938 inactive_file:5736 isolated_file:0
Mar 19 08:54:03 Getter2 kernel: [240237.950520] unevictable:0 dirty:0 writeback:0 unstable:0
Mar 19 08:54:03 Getter2 kernel: [240237.950525] free:11584 slab_reclaimable:2824 slab_unreclaimable:1786
Mar 19 08:54:03 Getter2 kernel: [240237.950531] mapped:2932 shmem:906 pagetables:480 bounce:0
Mar 19 08:54:03 Getter2 kernel: [240237.980563] DMA free:43936kB min:364kB low:452kB high:544kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:44704kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Mar 19 08:54:03 Getter2 kernel: [240238.017031] lowmem_reserve: 0 48728 48728
Mar 19 08:54:03 Getter2 kernel: [240238.021402] Normal free:2400kB min:1588kB low:1984kB high:2380kB active_anon:45584kB inactive_anon:73448kB active_file:15752kB inactive_file:23160kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:194912kB mlocked:0kB dirty:0kB writeback:0kB mapped:11728kB shmem:3624kB slab_reclaimable:11296kB slab_unreclaimable:7144kB kernel_stack:1520kB pagetables:1920kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Mar 19 08:54:03 Getter2 kernel: [240238.061437] lowmem_reserve: 0 0 0
Mar 19 08:54:03 Getter2 kernel: [240238.065124] DMA: 1*4kB 1*8kB 0*16kB 3*32kB 1*64kB 2*128kB 2*256kB 2*512kB 1*1024kB 0*2048kB 10*4096kB = 43948kB
Mar 19 08:54:03 Getter2 kernel: [240238.075538] Normal: 542*4kB 12*8kB 1*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2280kB
Mar 19 08:54:03 Getter2 kernel: [240238.086305] 13969 total pagecache pages
Mar 19 08:54:03 Getter2 kernel: [240238.090258] 3208 pages in swap cache
Mar 19 08:54:03 Getter2 kernel: [240238.093984] Swap cache stats: add 1753951, delete 1750743, find 2481275/2760661
Mar 19 08:54:03 Getter2 kernel: [240238.101421] Free swap = 468004kB
Mar 19 08:54:03 Getter2 kernel: [240238.104869] Total swap = 500732kB
Mar 19 08:54:03 Getter2 kernel: [240238.123924] 65536 pages of RAM
Mar 19 08:54:03 Getter2 kernel: [240238.127087] 11815 free pages
Mar 19 08:54:03 Getter2 kernel: [240238.130070] 7896 reserved pages
Mar 19 08:54:03 Getter2 kernel: [240238.133351] 4611 slab pages
Mar 19 08:54:03 Getter2 kernel: [240238.136260] 8650 pages shared
Mar 19 08:54:03 Getter2 kernel: [240238.139333] 3208 pages swap cached
Mar 19 08:54:03 Getter2 kernel: [240238.142860] [pid] uid tgid total_vm rss cpu oom_adj oom_score_adj name
Mar 19 08:54:03 Getter2 kernel: [240238.150492] [8932] 0 8932 25600 20847 1 0 0 ffmpeg
Mar 19 08:54:03 Getter2 kernel: [240238.158233] Memory cgroup out of memory: Kill process 8932 (ffmpeg) score 990 or sacrifice child
Mar 19 08:54:03 Getter2 kernel: [240238.167209] Killed process 8932 (ffmpeg) total-vm:102400kB, anon-rss:81916kB, file-rss:1472kB
Mar 19 08:54:39 Getter2 kernel: [240273.714576] ffmpeg invoked oom-killer: gfp_mask=0xd0, order=0, oom_adj=0, oom_score_adj=0
Mar 19 08:54:39 Getter2 kernel: [240273.723095] ffmpeg cpuset=/ mems_allowed=0
Mar 19 08:54:39 Getter2 kernel: [240273.727483] [] (unwind_backtrace+0x0/0xf8) from [] (dump_header.isra.5+0x8c/0x1e8)
Mar 19 08:54:39 Getter2 kernel: [240273.737540] [] (dump_header.isra.5+0x8c/0x1e8) from [] (mem_cgroup_out_of_memory+0xb8/0x160)
Mar 19 08:54:39 Getter2 kernel: [240273.747925] [] (mem_cgroup_out_of_memory+0xb8/0x160) from [] (mem_cgroup_handle_oom+0x188/0x310)
Mar 19 08:54:39 Getter2 kernel: [240273.758689] [] (mem_cgroup_handle_oom+0x188/0x310) from [] (__mem_cgroup_try_charge.constprop.32+0x62c/0x898)
Mar 19 08:54:39 Getter2 kernel: [240273.770762] [] (__mem_cgroup_try_charge.constprop.32+0x62c/0x898) from [] (mem_cgroup_newpage_charge+0x78/0xc8)
Mar 19 08:54:39 Getter2 kernel: [240273.783390] [] (mem_cgroup_newpage_charge+0x78/0xc8) from [] (handle_pte_fault+0x184/0x770)
Mar 19 08:54:39 Getter2 kernel: [240273.793676] [] (handle_pte_fault+0x184/0x770) from [] (handle_mm_fault+0xc8/0xd8)
Mar 19 08:54:39 Getter2 kernel: [240273.803093] [] (handle_mm_fault+0xc8/0xd8) from [] (do_page_fault+0x108/0x304)
Mar 19 08:54:39 Getter2 kernel: [240273.812747] [] (do_page_fault+0x108/0x304) from [] (do_DataAbort+0x34/0x98)
Mar 19 08:54:39 Getter2 kernel: [240273.821788] [] (do_DataAbort+0x34/0x98) from [] (__dabt_usr+0x34/0x40)

 

It looks like those are due to Out-of-Memory conditions where both RAM and SWAP are overrun.

It’s possible they might be part of the reason of the loss of access…

Thanks Tony,

Does anyone know how to fix that??

Andy_Chen wrote:

 

Does anyone know how to fix that??

This would be a daunting task.

Maybe reading your private mail in this forum helps :wink: