Hey guys I recently updated the HiveOS to the latest version from the shell (self upgrade failed) doesn’t work, finally upgraded through local ssh and rebooted; it was okay for some hours but after that i saw that there’s nothing to show in hiveOS miner page and checked the Rigs the realized the MotherBoard wasn’t active!!! PSU terminals was connected correctly, checked all risers and other extensions everything was ok, tried to turn the MB by other PSU (Fresh new and tested PSU on other devices), it won’t turn on! (the Bios setting is ok and the AC power then turn on option is active), tried to connect the 8 Pins connector to the MB and the 24 Pin connector, but nothing worked; tried to just connect the 8 Pins to the MB and used a Jack for the 24 Pin connector (Green + Black) it turned on!
tested that it’s working now but i want to know why it just acted like that?! the Watch Dog is Hardware one - HL-340 - and it was Okay for months i’m sure that it’s not the problem and tested by commands in ssh to reset and shutdown the rig and it was okay!
tried to understand the logs, searched more than 100 websites for the exact issue but didn’t found anything helpful.
before the Update to 0.6-200@210302 everything was Okay!
the rig HW-config:
PSU = 4 * 750 W (server powers) for GPUs + 250W for MB
GPU = 14 AMD 8 G (92 Watt maximum with OC)
MB = Asus B250 ME
RAM = 4 GB DDR5 , 2666 Mhz
Storage = 64 GB USB3 Sandisk Flash Drive
CPU = Intel Core i3
Syslog from failed exact time:
Month 4 09:20:43 xxx-hive kernel: [52115.057582][ T2856] nanominer: page allocation failure: order:0, mode:0x104cc2(GFP_HIGHUSER|__GFP_RETRY_MAYFAIL), nodemask=(null),cpuset=/,mems_allowed=0
Month 4 09:20:43 xxx-hive kernel: [52115.057585][ T2856] CPU: 1 PID: 2856 Comm: nanominer Tainted: G OE 5.4.80-hiveos #201206
Month 4 09:20:43 xxx-hive kernel: [52115.057586][ T2856] Hardware name: System manufacturer System Product Name/B250 MINING EXPERT, BIOS 1208 09/24/2019
Month 4 09:20:43 xxx-hive kernel: [52115.057586][ T2856] Call Trace:
Month 4 09:20:43 xxx-hive kernel: [52115.057590][ T2856] dump_stack+0x66/0x8b
Month 4 09:20:43 xxx-hive kernel: [52115.057592][ T2856] warn_alloc+0xfe/0x160
Month 4 09:20:43 xxx-hive kernel: [52115.057594][ T2856] __alloc_pages_slowpath+0xd06/0xd40
Month 4 09:20:43 xxx-hive kernel: [52115.057595][ T2856] __alloc_pages_nodemask+0x2cf/0x320
Month 4 09:20:43 xxx-hive kernel: [52115.057600][ T2856] amdttm_pool_populate+0x214/0x440 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057602][ T2856] ? map_vm_area+0x32/0x40
Month 4 09:20:43 xxx-hive kernel: [52115.057603][ T2856] ? __vmalloc_node_range+0x221/0x290
Month 4 09:20:43 xxx-hive kernel: [52115.057606][ T2856] amdttm_populate_and_map_pages+0x24/0x250 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057607][ T2856] ? __vmalloc_node_flags_caller+0x3c/0x50
Month 4 09:20:43 xxx-hive kernel: [52115.057610][ T2856] ttm_tt_populate.part.9+0x1e/0x60 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057612][ T2856] amdttm_tt_bind+0x4a/0x60 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057614][ T2856] ttm_bo_handle_move_mem+0x56b/0x620 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057617][ T2856] ttm_bo_evict+0x18f/0x3c0 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057618][ T2856] ? call_function_interrupt+0xa/0x20
Month 4 09:20:43 xxx-hive kernel: [52115.057678][ T2856] ? amdgpu_bo_subtract_pin_size+0x60/0x60 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.057691][ T2856] ? drm_add_display_info+0x61e/0x8a0 [drm]
Month 4 09:20:43 xxx-hive kernel: [52115.057694][ T2856] ttm_mem_evict_first+0x125/0x3b0 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057696][ T2856] amdttm_bo_mem_space+0x203/0x300 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057745][ T2856] ? amdgpu_bo_subtract_pin_size+0x60/0x60 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.057747][ T2856] amdttm_bo_validate+0xf0/0x170 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057786][ T2856] ? amdgpu_bo_subtract_pin_size+0x60/0x60 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.057796][ T2856] ? drm_add_display_info+0x61e/0x8a0 [drm]
Month 4 09:20:43 xxx-hive kernel: [52115.057798][ T2856] amdttm_bo_init_reserved+0x2d2/0x3c0 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.057837][ T2856] amdgpu_bo_do_create+0x205/0x570 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.057877][ T2856] ? amdgpu_bo_subtract_pin_size+0x60/0x60 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.057916][ T2856] amdgpu_bo_create+0x40/0x1f0 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.057917][ T2856] ? newidle_balance+0x301/0x3b0
Month 4 09:20:43 xxx-hive kernel: [52115.057919][ T2856] ? dbs_update_util_handler+0x16/0x90
Month 4 09:20:43 xxx-hive kernel: [52115.057959][ T2856] amdgpu_gem_object_create+0xc5/0x1b0 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.057999][ T2856] amdgpu_gem_create_ioctl+0xa4/0x2a0 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.058039][ T2856] ? amdgpu_gem_object_close+0x240/0x240 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.058046][ T2856] drm_ioctl_kernel+0xac/0xf0 [drm]
Month 4 09:20:43 xxx-hive kernel: [52115.058053][ T2856] drm_ioctl+0x2eb/0x3b0 [drm]
Month 4 09:20:43 xxx-hive kernel: [52115.058093][ T2856] ? amdgpu_gem_object_close+0x240/0x240 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.058129][ T2856] amdgpu_drm_ioctl+0x49/0x80 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.058131][ T2856] do_vfs_ioctl+0xa4/0x640
Month 4 09:20:43 xxx-hive kernel: [52115.058133][ T2856] ? __switch_to+0x101/0x3d0
Month 4 09:20:43 xxx-hive kernel: [52115.058134][ T2856] ksys_ioctl+0x70/0x80
Month 4 09:20:43 xxx-hive kernel: [52115.058135][ T2856] __x64_sys_ioctl+0x16/0x20
Month 4 09:20:43 xxx-hive kernel: [52115.058136][ T2856] do_syscall_64+0x52/0x1a0
Month 4 09:20:43 xxx-hive kernel: [52115.058138][ T2856] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Month 4 09:20:43 xxx-hive kernel: [52115.058140][ T2856] RIP: 0033:0x7f8e26006317
Month 4 09:20:43 xxx-hive kernel: [52115.058143][ T2856] Code: Bad RIP value.
Month 4 09:20:43 xxx-hive kernel: [52115.058143][ T2856] RSP: 002b:00007f8db27f6e88 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Month 4 09:20:43 xxx-hive kernel: [52115.058144][ T2856] RAX: ffffffffffffffda RBX: 00007f8db27f7000 RCX: 00007f8e26006317
Month 4 09:20:43 xxx-hive kernel: [52115.058145][ T2856] RDX: 00007f8db27f6ef0 RSI: 00000000c0206440 RDI: 0000000000000017
Month 4 09:20:43 xxx-hive kernel: [52115.058145][ T2856] RBP: 00007f8db27f6ef0 R08: 0000000000000000 R09: 0000000000200000
Month 4 09:20:43 xxx-hive kernel: [52115.058146][ T2856] R10: 0000000000000000 R11: 0000000000000246 R12: 00000000c0206440
Month 4 09:20:43 xxx-hive kernel: [52115.058146][ T2856] R13: 0000000000000017 R14: 00007f8db27f6fd0 R15: 00007f8d94677b40
Month 4 09:20:43 xxx-hive kernel: [52115.058147][ T2856] Mem-Info:
Month 4 09:20:43 xxx-hive kernel: [52115.058150][ T2856] active_anon:110633 inactive_anon:13744 isolated_anon:0
Month 4 09:20:43 xxx-hive kernel: [52115.058150][ T2856] active_file:91 inactive_file:20 isolated_file:0
Month 4 09:20:43 xxx-hive kernel: [52115.058150][ T2856] unevictable:0 dirty:0 writeback:0 unstable:0
Month 4 09:20:43 xxx-hive kernel: [52115.058150][ T2856] slab_reclaimable:5887 slab_unreclaimable:33137
Month 4 09:20:43 xxx-hive kernel: [52115.058150][ T2856] mapped:37 shmem:13982 pagetables:1720 bounce:0
Month 4 09:20:43 xxx-hive kernel: [52115.058150][ T2856] free:23207 free_pcp:141 free_cma:0
Month 4 09:20:43 xxx-hive kernel: [52115.058151][ T2856] Node 0 active_anon:442532kB inactive_anon:54976kB active_file:364kB inactive_file:80kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:148kB dirty:0kB writeback:0kB shmem:55928kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 268288kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
Month 4 09:20:43 xxx-hive kernel: [52115.058152][ T2856] Node 0 DMA free:15564kB min:272kB low:340kB high:408kB active_anon:0kB inactive_anon:20kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15892kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Month 4 09:20:43 xxx-hive kernel: [52115.058154][ T2856] lowmem_reserve[]: 0 1227 3827 3827 3827
Month 4 09:20:43 xxx-hive kernel: [52115.058155][ T2856] Node 0 DMA32 free:31880kB min:21576kB low:26968kB high:32360kB active_anon:548kB inactive_anon:2756kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1399636kB managed:1301476kB mlocked:0kB kernel_stack:0kB pagetables:56kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Month 4 09:20:43 xxx-hive kernel: [52115.058156][ T2856] lowmem_reserve[]: 0 0 2600 2600 2600
Month 4 09:20:43 xxx-hive kernel: [52115.058157][ T2856] Node 0 Normal free:45384kB min:45732kB low:57164kB high:68596kB active_anon:441984kB inactive_anon:52200kB active_file:120kB inactive_file:312kB unevictable:0kB writepending:0kB present:2736128kB managed:2662972kB mlocked:0kB kernel_stack:7728kB pagetables:6824kB bounce:0kB free_pcp:564kB local_pcp:248kB free_cma:0kB
Month 4 09:20:43 xxx-hive kernel: [52115.058159][ T2856] lowmem_reserve[]: 0 0 0 0 0
Month 4 09:20:43 xxx-hive kernel: [52115.058160][ T2856] Node 0 DMA: 1*4kB (M) 1*8kB (M) 2*16kB (U) 1*32kB (M) 2*64kB (UM) 2*128kB (UM) 1*256kB (M) 1*512kB (M) 2*1024kB (UM) 0*2048kB 3*4096kB (M) = 15564kB
Month 4 09:20:43 xxx-hive kernel: [52115.058164][ T2856] Node 0 DMA32: 324*4kB (UM) 236*8kB (M) 153*16kB (UM) 70*32kB (UM) 31*64kB (M) 16*128kB (UM) 11*256kB (UM) 4*512kB (M) 5*1024kB (UM) 5*2048kB (M) 0*4096kB = 32128kB
Month 4 09:20:43 xxx-hive kernel: [52115.058167][ T2856] Node 0 Normal: 3244*4kB (ME) 1784*8kB (ME) 725*16kB (UME) 208*32kB (UM) 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 45504kB
Month 4 09:20:43 xxx-hive kernel: [52115.058171][ T2856] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Month 4 09:20:43 xxx-hive kernel: [52115.058171][ T2856] Node 0 hugepages_total=128 hugepages_free=128 hugepages_surp=0 hugepages_size=2048kB
Month 4 09:20:43 xxx-hive kernel: [52115.058172][ T2856] 14204 total pagecache pages
Month 4 09:20:43 xxx-hive kernel: [52115.058172][ T2856] 0 pages in swap cache
Month 4 09:20:43 xxx-hive kernel: [52115.058173][ T2856] Swap cache stats: add 0, delete 0, find 0/0
Month 4 09:20:43 xxx-hive kernel: [52115.058173][ T2856] Free swap = 0kB
Month 4 09:20:43 xxx-hive kernel: [52115.058173][ T2856] Total swap = 0kB
Month 4 09:20:43 xxx-hive kernel: [52115.058174][ T2856] 1037936 pages RAM
Month 4 09:20:43 xxx-hive kernel: [52115.058174][ T2856] 0 pages HighMem/MovableOnly
Month 4 09:20:43 xxx-hive kernel: [52115.058174][ T2856] 42851 pages reserved
Month 4 09:20:43 xxx-hive kernel: [52115.058175][ T2856] 0 pages cma reserved
Month 4 09:20:43 xxx-hive kernel: [52115.058175][ T2856] 0 pages hwpoisoned
Month 4 09:20:43 xxx-hive kernel: [52115.072203][ T2868] [TTM] Buffer eviction failed
Month 4 09:20:43 xxx-hive kernel: [52115.073248][ T2856] [TTM] Buffer eviction failed
Month 4 09:20:43 xxx-hive kernel: [52115.092429][ T2849] [TTM] Buffer eviction failed
Month 4 09:20:43 xxx-hive kernel: [52115.107886][ T2858] [TTM] Buffer eviction failed
Month 4 09:20:43 xxx-hive kernel: [52115.123254][ T2858] nanominer invoked oom-killer: gfp_mask=0x2dc2(GFP_KERNEL|__GFP_HIGHMEM|__GFP_NOWARN|__GFP_ZERO), order=0, oom_score_adj=500
Month 4 09:20:43 xxx-hive kernel: [52115.123257][ T2858] CPU: 0 PID: 2858 Comm: nanominer Tainted: G OE 5.4.80-hiveos #201206
Month 4 09:20:43 xxx-hive kernel: [52115.123258][ T2858] Hardware name: System manufacturer System Product Name/B250 MINING EXPERT, BIOS 1208 09/24/2019
Month 4 09:20:43 xxx-hive kernel: [52115.123259][ T2858] Call Trace:
Month 4 09:20:43 xxx-hive kernel: [52115.123265][ T2858] dump_stack+0x66/0x8b
Month 4 09:20:43 xxx-hive kernel: [52115.123267][ T2858] dump_header+0x4a/0x200
Month 4 09:20:43 xxx-hive kernel: [52115.123269][ T2858] oom_kill_process+0xd7/0x110
Month 4 09:20:43 xxx-hive kernel: [52115.123271][ T2858] out_of_memory+0x105/0x510
Month 4 09:20:43 xxx-hive kernel: [52115.123273][ T2858] __alloc_pages_slowpath+0x9e5/0xd40
Month 4 09:20:43 xxx-hive kernel: [52115.123276][ T2858] ? update_load_avg+0x171/0x650
Month 4 09:20:43 xxx-hive kernel: [52115.123277][ T2858] __alloc_pages_nodemask+0x2cf/0x320
Month 4 09:20:43 xxx-hive kernel: [52115.123280][ T2858] __vmalloc_node_range+0x159/0x290
Month 4 09:20:43 xxx-hive kernel: [52115.123282][ T2858] __vmalloc_node_flags_caller+0x3c/0x50
Month 4 09:20:43 xxx-hive kernel: [52115.123287][ T2858] ? ttm_dma_tt_alloc_page_directory+0x29/0x60 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.123289][ T2858] ttm_dma_tt_alloc_page_directory+0x29/0x60 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.123292][ T2858] amdttm_sg_tt_init+0x81/0xb0 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.123376][ T2858] amdgpu_ttm_tt_create+0x47/0x70 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123379][ T2858] ttm_tt_create+0x51/0x90 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.123382][ T2858] ttm_bo_handle_move_mem+0x5e0/0x620 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.123435][ T2858] ? amdgpu_bo_subtract_pin_size+0x60/0x60 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123438][ T2858] amdttm_bo_validate+0x145/0x170 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.123478][ T2858] ? amdgpu_bo_subtract_pin_size+0x60/0x60 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123497][ T2858] ? drm_add_display_info+0x61e/0x8a0 [drm]
Month 4 09:20:43 xxx-hive kernel: [52115.123500][ T2858] amdttm_bo_init_reserved+0x2d2/0x3c0 [amdttm]
Month 4 09:20:43 xxx-hive kernel: [52115.123542][ T2858] amdgpu_bo_do_create+0x205/0x570 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123597][ T2858] ? amdgpu_bo_subtract_pin_size+0x60/0x60 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123639][ T2858] amdgpu_bo_create+0x40/0x1f0 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123641][ T2858] ? newidle_balance+0xad/0x3b0
Month 4 09:20:43 xxx-hive kernel: [52115.123643][ T2858] ? dbs_update_util_handler+0x16/0x90
Month 4 09:20:43 xxx-hive kernel: [52115.123683][ T2858] amdgpu_gem_object_create+0xc5/0x1b0 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123723][ T2858] amdgpu_gem_create_ioctl+0xa4/0x2a0 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123763][ T2858] ? amdgpu_gem_object_close+0x240/0x240 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123770][ T2858] drm_ioctl_kernel+0xac/0xf0 [drm]
Month 4 09:20:43 xxx-hive kernel: [52115.123778][ T2858] drm_ioctl+0x2eb/0x3b0 [drm]
Month 4 09:20:43 xxx-hive kernel: [52115.123817][ T2858] ? amdgpu_gem_object_close+0x240/0x240 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123854][ T2858] amdgpu_drm_ioctl+0x49/0x80 [amdgpu]
Month 4 09:20:43 xxx-hive kernel: [52115.123856][ T2858] do_vfs_ioctl+0xa4/0x640
Month 4 09:20:43 xxx-hive kernel: [52115.123857][ T2858] ksys_ioctl+0x70/0x80
Month 4 09:20:43 xxx-hive kernel: [52115.123858][ T2858] __x64_sys_ioctl+0x16/0x20
Month 4 09:20:43 xxx-hive kernel: [52115.123860][ T2858] do_syscall_64+0x52/0x1a0
Month 4 09:20:43 xxx-hive kernel: [52115.123862][ T2858] entry_SYSCALL_64_after_hwframe+0x44/0xa9
Month 4 09:20:43 xxx-hive kernel: [52115.123863][ T2858] RIP: 0033:0x7f8e26006317
Month 4 09:20:43 xxx-hive kernel: [52115.123867][ T2858] Code: Bad RIP value.
Month 4 09:20:43 xxx-hive kernel: [52115.123867][ T2858] RSP: 002b:00007f8db1ff5e88 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
Month 4 09:20:43 xxx-hive kernel: [52115.123868][ T2858] RAX: ffffffffffffffda RBX: 00007f8db1ff6000 RCX: 00007f8e26006317
Month 4 09:20:43 xxx-hive kernel: [52115.123869][ T2858] RDX: 00007f8db1ff5ef0 RSI: 00000000c0206440 RDI: 0000000000000019
Month 4 09:20:43 xxx-hive kernel: [52115.123869][ T2858] RBP: 00007f8db1ff5ef0 R08: 0000000000000000 R09: 0000000000200000
Month 4 09:20:43 xxx-hive kernel: [52115.123870][ T2858] R10: 0000000000000000 R11: 0000000000000246 R12: 00000000c0206440
Month 4 09:20:43 xxx-hive kernel: [52115.123870][ T2858] R13: 0000000000000019 R14: 00007f8db1ff5fd0 R15: 00007f8d8467a7b0
Month 4 09:20:43 xxx-hive kernel: [52115.123871][ T2858] Mem-Info:
Month 4 09:20:43 xxx-hive kernel: [52115.123874][ T2858] active_anon:110596 inactive_anon:13929 isolated_anon:0
Month 4 09:20:43 xxx-hive kernel: [52115.123874][ T2858] active_file:23 inactive_file:32 isolated_file:0
Month 4 09:20:43 xxx-hive kernel: [52115.123874][ T2858] unevictable:0 dirty:0 writeback:0 unstable:0
Month 4 09:20:43 xxx-hive kernel: [52115.123874][ T2858] slab_reclaimable:5887 slab_unreclaimable:33137
Month 4 09:20:43 xxx-hive kernel: [52115.123874][ T2858] mapped:37 shmem:14167 pagetables:1720 bounce:0
Month 4 09:20:43 xxx-hive kernel: [52115.123874][ T2858] free:23000 free_pcp:105 free_cma:0
Month 4 09:20:43 xxx-hive kernel: [52115.123875][ T2858] Node 0 active_anon:442384kB inactive_anon:55716kB active_file:92kB inactive_file:128kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:148kB dirty:0kB writeback:0kB shmem:56668kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 268288kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
Month 4 09:20:43 xxx-hive kernel: [52115.123876][ T2858] Node 0 DMA free:15564kB min:272kB low:340kB high:408kB active_anon:0kB inactive_anon:20kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15892kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Month 4 09:20:43 xxx-hive kernel: [52115.123878][ T2858] lowmem_reserve[]: 0 1227 3827 3827 3827
Month 4 09:20:43 xxx-hive kernel: [52115.123879][ T2858] Node 0 DMA32 free:31656kB min:21576kB low:26968kB high:32360kB active_anon:548kB inactive_anon:2756kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:1399636kB managed:1301476kB mlocked:0kB kernel_stack:0kB pagetables:56kB bounce:0kB free_pcp:172kB local_pcp:172kB free_cma:0kB
Month 4 09:20:43 xxx-hive kernel: [52115.123881][ T2858] lowmem_reserve[]: 0 0 2600 2600 2600
Month 4 09:20:43 xxx-hive kernel: [52115.123881][ T2858] Node 0 Normal free:44780kB min:45732kB low:57164kB high:68596kB active_anon:441984kB inactive_anon:52704kB active_file:120kB inactive_file:0kB unevictable:0kB writepending:0kB present:2736128kB managed:2662972kB mlocked:0kB kernel_stack:7728kB pagetables:6824kB bounce:0kB free_pcp:248kB local_pcp:248kB free_cma:0kB
Month 4 09:20:43 xxx-hive kernel: [52115.123883][ T2858] lowmem_reserve[]: 0 0 0 0 0
Month 4 09:20:43 xxx-hive kernel: [52115.123884][ T2858] Node 0 DMA: 1*4kB (M) 2*8kB (UM) 1*16kB (U) 1*32kB (M) 2*64kB (UM) 2*128kB (UM) 1*256kB (M) 1*512kB (M) 2*1024kB (UM) 0*2048kB 3*4096kB (M) = 15556kB
Month 4 09:20:43 xxx-hive kernel: [52115.123888][ T2858] Node 0 DMA32: 295*4kB (UM) 239*8kB (UM) 149*16kB (UM) 70*32kB (UM) 32*64kB (UM) 15*128kB (UM) 10*256kB (M) 5*512kB (UM) 5*1024kB (UM) 5*2048kB (M) 0*4096kB = 32164kB
Month 4 09:20:43 xxx-hive kernel: [52115.123891][ T2858] Node 0 Normal: 2906*4kB (UME) 1734*8kB (UME) 758*16kB (UME) 222*32kB (UM) 5*64kB (UM) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 45048kB
Month 4 09:20:43 xxx-hive kernel: [52115.123895][ T2858] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Month 4 09:20:43 xxx-hive kernel: [52115.123896][ T2858] Node 0 hugepages_total=128 hugepages_free=128 hugepages_surp=0 hugepages_size=2048kB
Month 4 09:20:43 xxx-hive kernel: [52115.123896][ T2858] 14315 total pagecache pages
Month 4 09:20:43 xxx-hive kernel: [52115.123897][ T2858] 0 pages in swap cache
Month 4 09:20:43 xxx-hive kernel: [52115.123897][ T2858] Swap cache stats: add 0, delete 0, find 0/0
Month 4 09:20:43 xxx-hive kernel: [52115.123898][ T2858] Free swap = 0kB
Month 4 09:20:43 xxx-hive kernel: [52115.123898][ T2858] Total swap = 0kB
Month 4 09:20:43 xxx-hive kernel: [52115.123898][ T2858] 1037936 pages RAM
Month 4 09:20:43 xxx-hive kernel: [52115.123898][ T2858] 0 pages HighMem/MovableOnly
Month 4 09:20:43 xxx-hive kernel: [52115.123899][ T2858] 42851 pages reserved
Month 4 09:20:43 xxx-hive kernel: [52115.123899][ T2858] 0 pages cma reserved
Month 4 09:20:43 xxx-hive kernel: [52115.123899][ T2858] 0 pages hwpoisoned
Month 4 09:20:43 xxx-hive kernel: [52115.123900][ T2858] Tasks state (memory values in pages):
Month 4 09:20:43 xxx-hive kernel: [52115.123900][ T2858] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
Month 4 09:20:43 xxx-hive kernel: [52115.123906][ T2858] [ 281] 0 281 29050 1403 249856 0 0 systemd-journal
Month 4 09:20:43 xxx-hive kernel: [52115.123908][ T2858] [ 342] 0 342 11682 762 135168 0 -1000 systemd-udevd
Month 4 09:20:43 xxx-hive kernel: [52115.123909][ T2858] [ 483] 100 483 35490 133 180224 0 0 systemd-timesyn
Month 4 09:20:43 xxx-hive kernel: [52115.123910][ T2858] [ 484] 0 484 11901 100 139264 0 0 rpcbind
Month 4 09:20:43 xxx-hive kernel: [52115.123911][ T2858] [ 498] 0 498 3093 864 65536 0 0 haveged
Month 4 09:20:43 xxx-hive kernel: [52115.123912][ T2858] [ 499] 0 499 72642 217 208896 0 0 accounts-daemon
Month 4 09:20:43 xxx-hive kernel: [52115.123913][ T2858] [ 501] 104 501 65760 325 167936 0 0 rsyslogd
Month 4 09:20:43 xxx-hive kernel: [52115.123914][ T2858] [ 503] 0 503 8588 74 106496 0 0 cron
Month 4 09:20:43 xxx-hive kernel: [52115.123915][ T2858] [ 507] 0 507 7084 52 98304 0 0 atd
Month 4 09:20:43 xxx-hive kernel: [52115.123916][ T2858] [ 509] 0 509 15546 166 159744 0 0 systemd-logind
Month 4 09:20:43 xxx-hive kernel: [52115.123917][ T2858] [ 512] 0 512 43353 1942 241664 0 0 networkd-dispat
Month 4 09:20:43 xxx-hive kernel: [52115.123918][ T2858] [ 513] 106 513 12524 180 143360 0 -900 dbus-daemon
Month 4 09:20:43 xxx-hive kernel: [52115.123919][ T2858] [ 524] 0 524 11350 133 122880 0 0 wpa_supplicant
Month 4 09:20:43 xxx-hive kernel: [52115.123920][ T2858] [ 525] 0 525 2480 26 61440 0 0 rngd
Month 4 09:20:43 xxx-hive kernel: [52115.123921][ T2858] [ 527] 0 527 27622 80 118784 0 0 irqbalance
Month 4 09:20:43 xxx-hive kernel: [52115.123922][ T2858] [ 576] 0 576 72221 198 200704 0 0 polkitd
Month 4 09:20:43 xxx-hive kernel: [52115.123923][ T2858] [ 622] 0 622 4429 119 69632 0 0 mount.ntfs-3g
Month 4 09:20:43 xxx-hive kernel: [52115.123924][ T2858] [ 661] 101 661 20022 150 184320 0 0 systemd-network
Month 4 09:20:43 xxx-hive kernel: [52115.123925][ T2858] [ 685] 102 685 17700 190 176128 0 0 systemd-resolve
Month 4 09:20:43 xxx-hive kernel: [52115.123926][ T2858] [ 775] 0 775 18076 188 184320 0 -1000 sshd
Month 4 09:20:43 xxx-hive kernel: [52115.123928][ T2858] [ 806] 0 806 4803 34 81920 0 0 agetty
Month 4 09:20:43 xxx-hive kernel: [52115.123929][ T2858] [ 808] 0 808 4803 33 77824 0 0 agetty
Month 4 09:20:43 xxx-hive kernel: [52115.123929][ T2858] [ 810] 0 810 4803 32 77824 0 0 agetty
Month 4 09:20:43 xxx-hive kernel: [52115.123930][ T2858] [ 812] 0 812 4803 33 73728 0 0 agetty
Month 4 09:20:43 xxx-hive kernel: [52115.123931][ T2858] [ 813] 0 813 4803 32 77824 0 0 agetty
Month 4 09:20:43 xxx-hive kernel: [52115.123932][ T2858] [ 834] 109 834 9561 177 118784 0 0 shellinaboxd
Month 4 09:20:43 xxx-hive kernel: [52115.123933][ T2858] [ 835] 109 835 9527 167 110592 0 0 shellinaboxd
Month 4 09:20:43 xxx-hive kernel: [52115.123952][ T2858] [ 1361] 0 1361 6192 191 98304 0 -100 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123954][ T2858] [ 1824] 0 1824 6093 91 90112 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123955][ T2858] [ 1862] 0 1862 6093 90 77824 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123955][ T2858] [ 1866] 0 1866 2660 16 69632 0 0 cat
Month 4 09:20:43 xxx-hive kernel: [52115.123956][ T2858] [ 2154] 0 2154 8760 229 98304 0 0 screen
Month 4 09:20:43 xxx-hive kernel: [52115.123957][ T2858] [ 2169] 0 2169 3979 63 69632 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123958][ T2858] [ 2170] 0 2170 3979 74 77824 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123959][ T2858] [ 2335] 0 2335 3979 71 77824 0 -500 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123960][ T2858] [ 2342] 0 2342 4373 480 81920 0 -300 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123961][ T2858] [ 2945] 0 2945 6187 169 90112 0 -100 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123963][ T2858] [ 4605] 0 4605 8685 170 102400 0 0 screen
Month 4 09:20:43 xxx-hive kernel: [52115.123964][ T2858] [ 4624] 0 4624 4012 92 73728 0 500 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123965][ T2858] [ 4657] 0 4657 4042 113 65536 0 500 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123966][ T2858] [ 4714] 0 4714 205836 4149 245760 0 500 nanominer
Month 4 09:20:43 xxx-hive kernel: [52115.123967][ T2858] [ 4716] 0 4716 843397 93584 2056192 0 500 nanominer
Month 4 09:20:43 xxx-hive kernel: [52115.123968][ T2858] [ 4748] 0 4748 8681 126 102400 0 0 screen
Month 4 09:20:43 xxx-hive kernel: [52115.123969][ T2858] [ 4750] 0 4750 4078 163 81920 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123970][ T2858] [ 4758] 0 4758 4174 267 77824 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123971][ T2858] [ 4767] 0 4767 6093 64 86016 0 0 hive-console
Month 4 09:20:43 xxx-hive kernel: [52115.123972][ T2858] [ 4771] 0 4771 15860 120 167936 0 0 sudo
Month 4 09:20:43 xxx-hive kernel: [52115.123972][ T2858] [ 4831] 0 4831 3979 61 77824 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123974][ T2858] [ 4848] 0 4848 4139 211 69632 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123975][ T2858] [ 4902] 0 4902 4204 306 65536 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123976][ T2858] [ 13815] 0 13815 2625 15 69632 0 -100 sleep
Month 4 09:20:43 xxx-hive kernel: [52115.123977][ T2858] [ 16152] 0 16152 2625 16 65536 0 -100 sleep
Month 4 09:20:43 xxx-hive kernel: [52115.123978][ T2858] [ 16405] 0 16405 2625 15 65536 0 0 sleep
Month 4 09:20:43 xxx-hive kernel: [52115.123980][ T2858] [ 16416] 0 16416 4373 480 73728 0 -300 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123981][ T2858] [ 16417] 0 16417 4204 306 65536 0 0 bash
Month 4 09:20:43 xxx-hive kernel: [52115.123982][ T2858] [ 16418] 0 16418 54 1 20480 0 -300 stat
Month 4 09:20:43 xxx-hive kernel: [52115.123983][ T2858] [ 16419] 0 16419 54 1 20480 0 0 stat
Month 4 09:20:43 xxx-hive kernel: [52115.123983][ T2858] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/,task=nanominer,pid=4716,uid=0
Month 4 09:20:43 xxx-hive kernel: [52115.124050][ T2858] Out of memory: Killed process 4716 (nanominer) total-vm:3373588kB, anon-rss:374336kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:2008kB oom_score_adj:500
Month 4 09:20:43 xxx-hive kernel: [52115.138109][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
Month 4 09:20:43 xxx-hive kernel: [52115.138225][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
Month 4 09:20:43 xxx-hive kernel: [52115.138336][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
Month 4 09:20:43 xxx-hive kernel: [52115.138433][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
Month 4 09:20:43 xxx-hive kernel: [52115.138530][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
Month 4 09:20:43 xxx-hive kernel: [52115.138627][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
Month 4 09:20:43 xxx-hive kernel: [52115.138733][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
Month 4 09:20:43 xxx-hive kernel: [52115.138830][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
Month 4 09:20:43 xxx-hive kernel: [52115.138925][ T34] amdgpu_mn_invalidate_range_start_gfx+0x0/0x120 [amdgpu] callback failed with -11 in non-blockable context.
checked the errors and solved (maybe) some of them:
CRON[29902]: (CRON) info (No MTA installed, discarding output)
solved: sudo apt-get install postfix
they say its a kernel bug! ttm buffer eviction
I will appreciate you for your attention guys. 