OpenWrt Forum Archive

Topic: Netgear R8000 oom-killer

The content of this topic has been archived on 18 Apr 2018. There are no obvious gaps in this topic, but there may still be some posts missing at the end.

Post #1
jr_ttg
25 Oct 2017, 02:46

Hi,

I've just recently configured an R8000 with the default install, set up some vlans (some bridged to the wifi) and am having inconsistent oom-killer entries in the log.  I haven't tweaked any linux settings in sysctl but i have added a swap file.  I have the impression that my configuration is pretty vanilla so far.   I am posting an example oom section of the log file, along with the sysctl settings.  I have found a variety of resources online in regards to the oom-killer but I didn't see the correlation of my log entries and theirs.  TIA for anyone can offer any insight.


(I was going to paste some log entries and my sysctl settings but I seem to have an issue with links...)

I figured out that the web page doesn't like the string 'http'.  I ended up doing a bulk replace for inserting a space to make 'ht tp' instead.

(Last edited by jr_ttg on 25 Oct 2017, 23:12)

Post #2
jr_ttg
25 Oct 2017, 02:48

vm.admin_reserve_kbytes = 7920
vm.block_dump = 0
vm.dirty_background_bytes = 0
vm.dirty_background_ratio = 10
vm.dirty_bytes = 0
vm.dirty_expire_centisecs = 3000
vm.dirty_ratio = 20
vm.dirty_writeback_centisecs = 500
vm.drop_caches = 0
vm.highmem_is_dirtyable = 0
vm.laptop_mode = 0
vm.legacy_va_layout = 0
vm.lowmem_reserve_ratio = 32    32
vm.max_map_count = 65530
vm.min_free_kbytes = 1411
vm.mmap_min_addr = 4096
vm.nr_pdflush_threads = 0
vm.oom_dump_tasks = 1
vm.oom_kill_allocating_task = 0
vm.overcommit_kbytes = 0
vm.overcommit_memory = 0
vm.overcommit_ratio = 50
vm.page-cluster = 3
vm.panic_on_oom = 0
vm.percpu_pagelist_fraction = 0
vm.stat_interval = 1
vm.swappiness = 60
vm.user_reserve_kbytes = 7920
vm.vfs_cache_pressure = 100

Post #3
jr_ttg
25 Oct 2017, 02:50

Any advice on how to add the log section for oom-killer?  :-)

Post #4
mk24
25 Oct 2017, 03:10

Use code tags, the <> button at the top of the posting window.

Post #5
jr_ttg
25 Oct 2017, 22:58

Final consolidated post...

mac80211.sh invoked oom-killer: gfp_mask=0x4d0, order=2, oom_score_adj=0
 CPU: 1 PID: 10822 Comm: mac80211.sh Not tainted 3.18.23 #1
 Backtrace: 
 [<c0015414>] (dump_backtrace) from [<c0015620>] (show_stack+0x18/0x1c)
  r6:00000002 r5:00000000 r4:00000000 r3:00400040
 [<c0015608>] (show_stack) from [<c016787c>] (dump_stack+0x7c/0x98)
 [<c0167800>] (dump_stack) from [<c00786a8>] (dump_header+0x80/0x198)
  r4:c51ae000 r3:00000006
 [<c0078628>] (dump_header) from [<c00789f4>] (oom_kill_process+0x6c/0x3dc)
  r8:00000002 r7:000004d0 r6:00000002 r5:c796b480 r4:00000000
 [<c0078988>] (oom_kill_process) from [<c00791d0>] (out_of_memory+0x27c/0x310)
  r10:c03c885c r9:c03c8700 r8:00000002 r7:0004f9c8 r6:000000f7 r5:c61d671c
  r4:c796b480
 [<c0078f54>] (out_of_memory) from [<c007c410>] (__alloc_pages_nodemask+0x618/0x678)
  r10:00000000 r9:00000000 r8:c51ae000 r7:00000000 r6:c03c8080 r5:00000002
  r4:000004d0
 [<c007bdf8>] (__alloc_pages_nodemask) from [<c007c488>] (__get_free_pages+0x18/0x34)
  r10:00000000 r9:c721c000 r8:c51ae010 r7:0000000b r6:c7291200 r5:c7291200
  r4:00000000
 [<c007c470>] (__get_free_pages) from [<c001aa60>] (pgd_alloc+0x1c/0x100)
 [<c001aa44>] (pgd_alloc) from [<c001d3f4>] (mm_init+0xb8/0x118)
  r7:0000000b r6:c7291200 r5:c51ae000 r4:00000000
 [<c001d33c>] (mm_init) from [<c001d808>] (mm_alloc+0x44/0x54)
  r6:c6119ac0 r5:c51ae000 r4:c7291200 r3:c51ae000
 [<c001d7c4>] (mm_alloc) from [<c00afadc>] (do_execve+0x1a4/0x4ac)
  r4:c4a13200 r3:c721c010
 [<c00af938>] (do_execve) from [<c00affd8>] (SyS_execve+0x24/0x28)
  r10:00000000 r9:c51ae000 r8:c0008aa4 r7:0000000b r6:01d6366c r5:01d63644
  r4:01d6366c
 [<c00affb4>] (SyS_execve) from [<c0008900>] (ret_fast_syscall+0x0/0x38)
  r5:01d5c214 r4:01d63644
 Mem-info:
 Normal per-cpu:
 CPU    0: hi:   42, btch:   7 usd:   0
 CPU    1: hi:   42, btch:   7 usd:   0
 HighMem per-cpu:
 CPU    0: hi:   42, btch:   7 usd:   6
 CPU    1: hi:   42, btch:   7 usd:   0
 active_anon:266 inactive_anon:419 isolated_anon:0
  active_file:524 inactive_file:2741 isolated_file:0
  unevictable:0 dirty:7 writeback:0 unstable:0
  free:32105 slab_reclaimable:505 slab_unreclaimable:23896
  mapped:489 shmem:109 pagetables:94 bounce:0
  free_cma:0
 Normal free:14344kB min:1408kB low:1760kB high:2112kB active_anon:0kB inactive_anon:0kB active_file:156kB inactive_file:168kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:131072kB managed:124708kB mlocked:4kB dirty:28kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:2020kB slab_unreclaimable:95584kB kernel_stack:592kB pagetables:376kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:1948 all_unreclaimable? yMon Oct 23 19:44:39 2017 kern.warn kernel: [63096.075709] lowmem_reserve[]: 0 1024 1024
 HighMem free:114076kB min:128kB low:496kB high:868kB active_anon:1068kB inactive_anon:1676kB active_file:1940kB inactive_file:10796kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:131072kB managed:131072kB mlocked:0kB dirty:0kB writeback:0kB mapped:1956kB shmem:436kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
 lowmem_reserve[]: 0 0 0
 Normal: 3231*4kB (UEM) 132*8kB (M) 1*16kB (R) 1*32kB (R) 1*64kB (R) 0*128kB 1*256kB (R) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 14348kB
 HighMem: 59*4kB (UM) 40*8kB (M) 25*16kB (UM) 16*32kB (UM) 7*64kB (M) 4*128kB (M) 2*256kB (M) 1*512kB (U) 0*1024kB 2*2048kB (UM) 26*4096kB (MR) = 114044kB
 3457 total pagecache pages
 75 pages in swap cache
 Swap cache stats: add 3429, delete 3354, find 1964/2551
 Free swap  = 1047396kB
 Total swap = 1048572kB
 65536 pages of RAM
 32242 free pages
 1591 reserved pages
 24007 slab pages
 542271 pages shared
 75 pages swap cached
 [ pid ]   uid  tgid total_vm      rss nr_ptes swapents oom_score_adj name
 [  655]     0   655      198       89       4        1             0 ubusd
 [  679]     0   679      167        7       3        0             0 askfirst
 [  997]     0   997      361      154       4        0             0 rpcd
 [ 1031]     0  1031      372      164       4       29             0 netifd
 [ 1056]     0  1056      270      119       4       20             0 odhcpd
 [ 1140]     0  1140      235       72       4       28             0 logd
 [ 1141]     0  1141      272      103       4       23             0 logread
 [ 1268]     0  1268      327        0       4       12             0 udhcpc
 [ 1283]     0  1283      259       86       4        9             0 dropbear
 [ 1302]     0  1302      175       81       4        1             0 odhcp6c
 [ 1402]     0  1402      379      153       4       11             0 uht ttp
 [ 1442]     0  1442      328        0       4       18             0 ntpd
 [ 1552]     0  1552      407      157       4       19             0 hostapd
 [ 1723]     0  1723      282      117       4       10             0 dropbear
 [ 1734] 65534  1734      225      121       4        6             0 dnsmasq
 [ 1829]     0  1829      331      132       4        7             0 ash
 [ 2322]     0  2322      297      132       4       12             0 luci-bwc
 [ 8987]     0  8987      282      116       4        9             0 dropbear
 [ 9039]     0  9039      328        9       4        0             0 ash
 [ 9191]     0  9191      329      135       4        3             0 top
 [ 8875]     0  8875      407       34       4       12             0 hostapd
 [10768]     0 10768      365      240       4       10             0 mac80211.sh
 [10822]     0 10822      365       53       4       10             0 mac80211.sh
 [10825]     0 10825      379       36       4       11             0 uht ttp
 Out of memory: Kill process 10768 (mac80211.sh) score 0 or sacrifice child
 Killed process 10768 (mac80211.sh) total-vm:1460kB, anon-rss:176kB, file-rss:784kB
Post #6
jr_ttg
25 Oct 2017, 23:05

I ran vmstat -1 >> vmstat.txt overnight and I believe the router rebooted around 0230 this morning.  My impression is that the router was generally idle until the end where something was occurring which started using the swap file.

I have included the df output, a single vmstat today and the vmstat log file from last night.

root@OpenWrt:~# df -h
Filesystem                Size      Used Available Use% Mounted on
rootfs                   21.5M      2.7M     17.7M  13% /
/dev/root                 3.0M      3.0M         0 100% /rom
tmpfs                   124.9M    352.0K    124.5M   0% /tmp
/dev/ubi0_1              21.5M      2.7M     17.7M  13% /overlay
overlayfs:/overlay       21.5M      2.7M     17.7M  13% /
tmpfs                   512.0K         0    512.0K   0% /dev
/dev/sda1                15.0G      1.5G     13.5G  10% /mnt/usb_16gb
/dev/sdb4              1007.8G    583.3M    956.0G   0% /mnt/sdb4
root@OpenWrt:~# vmstat
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 0  0      0 165820  10508  51908    0    0     0     0  133   36  1  0 99  0
Started around 10pm yesterday...

procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 0  0      0 105592   2900  52468    0    0     0     0  138   54  1  0 99  0
 0  0      0 105592   2900  52468    0    0     0     0  223   38  0  0 100  0
 0  0      0 105408   2900  52472    0    0     0     0  399  466  7  0 92  0
 0  0      0 105408   2900  52472    0    0     0     0  251   56  0  0 100  0
 0  0      0 105440   2900  52472    0    0     0     0  228   53  0  0 100  0
 0  0      0 105408   2900  52472    0    0     0     0  232   36  0  0 100  0
 1  0      0 105304   2900  52472    0    0     0     0  219   53  1  0 99  0
 0  0      0 105400   2900  52472    0    0     0     0  339  433  4  3 93  0
 0  0      0 105380   2900  52472    0    0     0     0  219   19  0  0 100  0
 0  0      0 105412   2900  52472    0    0     0     0  236   39  0  0 100  0
 0  0      0 105412   2900  52472    0    0     0     0  225   30  0  0 100  0
 2  0      0 104620   2900  52472    0    0     0     0  233   89  2  1 96  0
 0  0      0 105352   2900  52472    0    0     0     0  377  404  3  2 95  0
 0  0      0 105352   2900  52472    0    0     0     0  235   34  0  0 100  0
 0  0      0 105352   2900  52472    0    0     0     0  215   30  0  0 100  0

-- delete a bunch of normalish stuff --- 

0  0   1076 101788    300  26640    0    0     0     0  221   48  0  0 100  0
 1  0   1076 101664    372  26652    0    0     0     0  923  813  0  2 96  2
 3  0   1076 100264    484  26972    0    0     0     0 4729 9429  4 48 40  8
 2  0   1076 101368    464  26768    0    0     0     0  659 1028  1 50 48  0
 1  0   1076 101392    464  26780    0    0     0     0  242  133  0 50 50  0
 1  0   1076 101492    352  26780    0    0     0     0  273   95  0 50 50  0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 2  1   1072 101420    452  26768    0    0     0     0  920 1555  0 33 65  2
 2  0   1072 101476    332  26768    0    0     0     0 3638 6658  6 39 49  5
 1  0   1072 101556    308  26776    0    0     0     0  231  101  0 50 50  0
 0  0   1072 101556    300  26784    0    0     0     0  354  143  0 18 82  0
 0  0   1072 101556    300  26776    0    0     0     0  259   43  0  0 100  0
 1  0   1068 101508    376  26788    0    0     0     0 1060 1834  0 10 87  3
 1  0   1068 101608    320  26640    0    0     0     0 4005 7432  4 45 45  5
 1  0   1068 101728    300  26636    0    0     0     0  258   71  0 50 50  0
 1  0   1068 101704    300  26644    0    0     0     0  241   99  0 50 50  0
 0  0   1068 101736    300  26644    0    0     0     0  226   84  0 42 58  0
 4  0   1068 101532    424  26788    0    0     0     0 1177 2159  0 13 82  5
 2  0   1068 101580    380  26700    0    0     0     0 7887 8634  7 44 43  6
 0  0   1068 101708    304  26652    0    0     0     0  241   77  0 12 88  0
 0  0   1068 101684    304  26652    0    0     0     0  219   62  0  0 100  0
 0  0   1068 101748    304  26652    0    0     0     0  241   20  0  0 100  0
 1  0   1068 101408    380  26868    0    0     0     0 2515 2695  1 16 80  3
 2  0   1068 101580    340  26644    0    0     0     0 6648 7026  5 50 41  4
 1  0   1064 101704    304  26664    0    0     0     0  223   29  2 11 86  0
 0  0   1064 101736    304  26652    0    0     0     0  241   45 20  0 80  0
 0  0   1064 101704    304  26652    0    0     0     0  216   46  0  0 100  0
 2  0   1064 101536    308  26804    0    0     0     0 1465 2812  0 14 81  4
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 2  0   1064 101656    308  26668    0    0     0     0 4915 7488  5 46 43  6
 0  0   1064 101700    308  26648    0    0     0     0  238   72  0 40 60  0
 0  0   1064 101716    308  26648    0    0     0     0  211   32  0  0 100  0
 0  0   1064 101684    308  26648    0    0     0     0  228   32  0  0 100  0
 1  1   1064 101512    400  26848    0    0     0     0 2514 3297  0 13 80  6
 1  0   1064 101524    380  26656    0    0     0     0 3175 6359  4 45 47  4
 1  0   1064 101612    380  26656    0    0     0     0  287  108  0 50 50  0
 1  0   1064 101684    304  26648    0    0     0     0  250   65  0 50 50  0
 1  0   1064 101652    304  26648    0    0     0     0  213   40  0 50 50  0
 2  0   1064 100984    388  26916    0    0     0     0 2691 3871  3 50 43  5
 1  0   1064 101292    472  26808    0    0     0     0 3456 6258  4 55 39  2
 1  0   1064 101352    472  26780    0    0     0     0  218   96  0 50 50  0
 1  0   1064 101352    472  26780    0    0     0     0  229   89  0 50 50  0
 1  0   1064 101352    472  26780    0    0     0     0  227   75  0 50 50  0
 3  1   1064 100900    328  26940    0    0     0     0 2684 4934  2 56 36  6
 1  0   1064 101300    484  26776    0    0     0     0 3651 7150  4 59 33  4
 1  0   1064 101324    484  26780    0    0     0     0  222   70  0 50 50  0
 1  0   1064 101324    484  26780    0    0     0     0  214   77  0 50 50  0
 1  0   1064 101324    484  26780    0    0     0     0  269  147  0 50 50  0
 3  0   1064 100440    620  26916    0    0     0     0 2563 4971  2 62 30  5
 1  0   1064 101316    536  26780    0    0     0     0 3163 6203  4 56 38  2
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 1  0   1064 101364    528  26784    0    0     0     0  240   76  0 50 50  0
 1  0   1064 101584    304  26780    0    0     0     0  237  135  0 50 50  0
 1  0   1064 101580    304  26780    0    0     0     0  215   69  0 50 50  0
 2  0   1064 100336    316  26872    0    0     0     0 2602 5281  2 46 46  6
 1  0   1064 101612    308  26652    0    0     0     0 2287 4212  3 55 40  2
 1  0   1064 101676    308  26652    0    0     0     0  244   59  0 50 50  0
 1  0   1064 101676    308  26652    0    0     0     0  220   50  0 50 50  0
 1  0   1064 101676    308  26652    0    0     0     0  278   83  0 50 50  0
 2  0   1064 100396    316  26912    0    0     0     0 2668 5059  2 41 49  8
 1  0   1064 101552    384  26648    0    0     0     0 2901 5565  2 58 37  2
 1  0   1064 101584    384  26648    0    0     0     0  272   98  0 50 50  0
 1  0   1064 101584    384  26648    0    0     0     0  231   69  0 50 50  0
 1  0   1064 101584    384  26648    0    0     0     0  222   80  0 50 50  0
 3  0   1064 100220    392  26936    0    0     0     0 2964 6086  3 54 35  8
 1  0   1064 101340    552  26660    0    0     0     0 2611 4986  3 56 39  2
 1  0   1064 101388    552  26660    0    0     0     0  231   42  0 50 50  0
 1  0   1064 101372    552  26660    0    0     0     0  232   55  0 50 50  0
 1  0   1064 101356    552  26660    0    0     0     0  228   42  0 50 50  0
 2  1   1064 100292    404  26964    0    0     0     0 3706 7443  2 55 35  7
 1  0   1064 101680    300  26648    0    0     0     0 1182 1593  2 48 49  2
 1  0   1064 101680    300  26648    0    0     0     0  224   97  0 50 50  0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 1  0   1064 101680    300  26648    0    0     0     0  245  115  0 50 50  0
 1  0   1064 101700    300  26648    0    0     0     0  275  170  0 50 50  0
 3  0   1064 100256    324  26884    0    0     0     0 3673 7501  4 56 32  8
 1  0   1064 101276    468  26784    0    0     0     0 2013 3749  3 56 39  2
 1  0   1064 101308    468  26784    0    0     0     0  251   71  0 50 50  0
 1  0   1064 101328    468  26784    0    0     0     0  225   67  0 50 50  0
 1  0   1064 101336    468  26784    0    0     0     0  220   26  0 50 50  0
 3  0   1064 100280    428  26964    0    0     0     0 5240 8615  3 51 38  7
 2  0   1064 101308    500  26784    0    0     0     0 1138 1972  2 52 45  1
 1  0   1064 101308    500  26784    0    0     0     0  218   53  0 50 50  0
 1  0   1064 101308    500  26784    0    0     0     0  291  166  0 50 50  0
 1  0   1064 101340    500  26784    0    0     0     0  318   98  0 50 50  0
 2  0   1064 100172    480  26964    0    0     0     0 4574 9276  4 66 24  6
 1  0   1064 101360    552  26676    0    0     0     0 1264 2150  2 53 44  1
 1  0   1064 101360    552  26676    0    0     0     0  221   43  0 50 50  0
 1  0   1064 101360    552  26676    0    0     0     0  253   38  0 50 50  0
 1  0   1064 101360    552  26676    0    0     0     0  225   42  0 50 50  0
 2  0   1064 100168    544  26984    0    0     0     0 4726 9661  2 68 21  8
 1  0   1064 101280    544  26800    0    0     0     0  865 1324  1 51 48  0
 1  0   1064 101296    544  26800    0    0     0     0  243   41  0 50 50  0
 1  0   1064 101264    544  26800    0    0     0     0  212   51  0 50 50  0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 2  1   1064 101252    588  26784    0    0     0     0  336  279  0 51 48  1
 2  0   1064 100120    476  26940    0    0     0     0 4600 9500  5 48 39  8
 1  0   1064 101268    476  26784    0    0     0     0  528  717  1 51 48  0
 1  0   1064 101236    476  26784    0    0     0     0  247   59  0 50 50  0
 1  0   1064 101236    476  26784    0    0     0     0  262   78  0 50 50  0
 2  0   1064 101188    580  26792    0    0     0     0  701 1069  0 54 45  1
 2  0   1064 100076    484  27016    0    0     0     0 5026 10193  7 69 18  5
 1  0   1064 101240    484  26784    0    0     0     0  232   49  0 50 50  0
 1  0   1064 101264    484  26784    0    0     0     0  276   57  0 50 50  0
 1  0   1064 101264    484  26788    0    0     0     0  224   33  0 50 50  0
 2  1   1064 101076    688  26780    0    0     0     0 1038 1735  0 53 44  3
 1  0   1064 101144    460  26760    0    0     0     0 4760 9604  8 69 19  4
 1  0   1064 101236    460  26788    0    0     0     0  217   44  0 50 50  0
 1  0   1060 101208    460  26792    0    0     0     0  286  159  0 50 50  0
 1  0   1060 101272    460  26792    0    0     0     0  298  123  0 50 50  0
 2  0   1060 101464    420  26800    0    0     0     0 1222 2119  0 57 40  3
 3  0   1060 101420    364  26640    0    0     0     0 4980 9618  3 69 24  4
 1  0   1060 101452    364  26664    0    0     0     0  261  123  0 50 50  0
 1  0   1060 101484    364  26664    0    0     0     0  230   87  0 50 50  0
 1  0   1060 101460    364  26664    0    0     0     0  236   85  0 50 50  0
 5  0   1060 101328    516  26888    0    0     0     0 1393 2526  0 58 38  3
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 2  0   1060 101252    460  26764    0    0     0     0 4386 8589  4 61 32  2
 1  0   1060 101272    460  26788    0    0     0     0  233   76  0 50 50  0
 1  0   1060 101304    460  26788    0    0     0     0  246  108  0 50 50  0
 1  0   1060 101280    460  26788    0    0     0     0  235  125  0 50 50  0
 3  0   1060 101016    520  26940    0    0     0     0 1542 2881  1 59 36  4
 2  0   1060 101328    460  26632    0    0     0     0 4174 8280  6 60 30  3
 1  0   1060 101360    460  26664    0    0     0     0  229  124  0 50 50  0
 1  0   1060 101368    460  26664    0    0     0     0  255  122  0 50 50  0
 1  0   1060 101368    460  26664    0    0     0     0  266  143  0 50 50  0
 3  0   1060 100732    556  26860    0    0     0     0 1937 3477  2 63 32  3
 2  0   1060 101244    460  26820    0    0     0     0 3854 7624  4 60 32  3
 1  0   1060 101260    460  26788    0    0     0     0  222   92  0 50 50  0
 1  0   1060 101228    460  26788    0    0     0     0  267  106  0 50 50  0
 1  0   1060 101260    460  26788    0    0     0     0  232   48  0 50 50  0
 3  0   1060 100448    508  26900    0    0     0     0 2125 4096  2 62 34  2
 1  0   1060 101180    464  26808    0    0     0     0 3469 6879  2 59 36  3
 1  0   1060 101236    464  26788    0    0     0     0  214   42  0 50 50  0
 1  0   1060 101204    464  26788    0    0     0     0  223  106  0 50 50  0
 1  0   1060 101236    464  26788    0    0     0     0  226   97  0 50 50  0
 4  0   1060 100480    620  26876    0    0     0     0 2414 4642  0 61 32  6
 1  0   1060 101216    460  26788    0    0     0     0 3349 6579  5 56 38  2
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 1  0   1060 101184    460  26788    0    0     0     0  327  145  0 50 50  0
 1  0   1060 101216    460  26788    0    0     0     0  279   54  0 50 50  0
 1  0   1060 101216    460  26788    0    0     0     0  241   84  0 50 50  0
 3  0   1060 100916    424  26900    0    0     0     0 2764 5422  2 64 28  6
 1  0   1060 101164    460  26788    0    0     0     0 3668 7296  7 61 29  3
 1  0   1060 101304    460  26660    0    0     0     0  283  226  0 50 50  0
 1  0   1060 101336    460  26660    0    0     0     0  235   98  0 50 50  0
 1  0   1060 101304    460  26660    0    0     0     0  273  203  0 50 50  0
 4  1   1060 100520    496  26932    0    0     0     0 2956 5884  2 62 27  8
 1  0   1060 101208    380  26788    0    0     0     0 3439 6727  3 63 33  1
 1  0   1060 101236    380  26788    0    0     0     0  282  154  0 50 50  0
 1  0   1060 101392    380  26640    0    0     0     0  295  266  0 50 49  0
 1  0   1060 101392    380  26656    0    0     0     0  243  118  0 50 50  0
 3  0   1060 100384    576  26920    0    0     0     0 3031 6013  5 67 21  6
 1  0   1060 101196    388  26788    0    0     0     0 3113 6098  3 61 33  2
 1  0   1060 101196    388  26788    0    0     0     0  245   76  0 50 50  0
 1  0   1060 101196    388  26792    0    0     0     0  252   47  0 50 50  0
 1  0   1060 101204    388  26792    0    0     0     0  226   79  0 50 50  0
 3  0   1060 100228    304  26940    0    0     0     0 3626 7247  3 64 29  4
 1  0   1060 101332    336  26656    0    0     0     0 2345 4462  1 55 41  2
 1  0   1060 101268    336  26656    0    0     0     0  290  108  0 50 50  0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 1  0   1060 101728    312  26656    0    0     0     0  339  145  0 50 50  0
 1  0   1060 101728    312  26656    0    0     0     0  261   88  0 50 50  0
 3  0   1060 100236    308  26924    0    0     0     0 3787 7563  3 70 19  8
 1  0   1060 101316    312  26656    0    0     0     0 3190 6186  2 60 36  1
 1  0   1060 101316    312  26656    0    0     0     0  211   90  0 50 50  0
 1  0   1060 101316    312  26656    0    0     0     0  226   84  0 50 50  0
 1  0   1060 101332    312  26656    0    0     0     0  247   61  0 50 50  0
 4  0   1060 100252    304  26912    0    0     0     0 4079 8298  4 66 22  8
 2  0   1060 100192    348  26960    0    0     0     0 2338 4097  2 87 11  1
 1  0   1056 101484    320  26664    0    0     0     0 2120 3763  1 54 22 23
 1  0   1052 101484    320  26672    0    0     0     0  569 1212  0 52 40  7
 1  0   1052 101488    320  26672    0    0     0     0  222   47  0 50 50  0
 6  1   1000 101536    324  26672    0    0     0     0  749 1228  1 58 18 23
12  1    904 101320    368  26888    0    0     0     0 1722 3631  0 99  1  0
 6  1    844 102308    360  26240    0    0     0     0 1255 2601  0 90  7  2
 9  1    792 102008    404  26224    0    0     0     0 1857 2915  0 85  5 10
 7  0    784 101936    356  26232    0    0     0     0 1623 2556  0 98  1  1
 8  1    784 101892    364  26272    0    0     0     0 22575 60355  0 99  1  0
11  2    784 101720    392  26368    0    0     0     0 3030 6264  1 70 11 18
 8  0    784 101316    400  26368    0    0     0     0 1402 2367  2 96  1  2
11  1    784 101028    352  26376    0    0     0     0 1044 2167  3 97  0  0
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 9  1    784 101412    316  26384    0    0     0     0  979 1685  0 60  5 35
 3  0    784 101176    344  26360    0    0     0     0 1254 1730  1 97  1  1
 6  1    784 100892    360  26440    0    0     0     0 1932 3921  2 97  2  0
 5  1    784 101528    304  26272    0    0     0     0 1120 1606  0 100  0  0
 1  0    784 100848    308  26188    0    0     0     0 2575 4339  3 78 12  6
 7  0    784 101008    316  26232    0    0     0     0 1123 1334  1 76 14  8
 2  0    784 101160    312  26244    0    0     0     0 1783 2291  1 93  3  4
 3  4    784 101012    304  26352    0    0     0     0 1443 2345  0 90  9  1
12  0    784 100876    356  26388    0    0     0     0 1391 2561  1 95  2  3
10  1    784 100896    392  26364    0    0     0     0  400  694  0 100  0  0
 5  0    784 101076    432  26380    0    0     0     0 1195 2514  1 95  0  4
 4  4    784 100588    308  26400    0    0     0     0 1951 4117  3 87  4  7
10  0    784 100528    316  26388    0    0     0     0 1471 3548  1 97  1  1
 5  2    784 100756    332  26364    0    0     0     0 1093 2467  1 97  0  2
 7  1    772 100788    368  26428    0    0     0     0 3652 6577  2 86  4  8
 7  1    772 100860    340  26536    0    0     0     0 2070 3989  2 93  2  2
 9  2    772 101556    380  26312    0    0     0     0 1399 3122  1 99  1  0
 4  0    772 101724    400  26320    0    0     0     0 2023 3702  1 93  3  3
 4  0    772 101696    428  26516    0    0     0     0 4686 9952  2 71 15 12
 4  0    772 100752    572  26612    0    0     0     0 5589 11836  4 75  9 11
 3  0    772 100604    416  26624    0    0     0     0 6838 13909  4 71 15  9
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
 2  1    768 101660    464  26492    0    0     0     0 5768 12241  3 75  9 13
 5  0    768 101316    332  26560    0    0     0     0 1727 3179  0 81  8 11
 3  1    768 101408    340  26552    0    0     0     0  552 1055  0 100  0  0
 4  0    588 102144    348  26116    0    0     0     0 7896 14398  3 87  8  2
 2  1    552 102668    440  26108    0    0     0     0 4430 7864  0 62 22 16
 1  0    552 102668    440  26112    0    0     0     0  287  129  0 50 50  0
 1  0    552 102668    440  26112    0    0     0     0  255   86  0 50 50  0
 6  0    552 102408    416  26232    0    0     0     0 2897 5889  0 69 21  9
 2  0    552 101920    316  26312    0    0     0     0 4083 8595  6 74  9 12
 6  1    456 102060    320  26312    0    0     0     0  299  334  0 48 52  0
 6  1    452 102280    368  26296    0    0     0     0 1832 3299 15 71 12  2
 4  0    452 102412    312  26176    0    0     0     0  646 1082  0 79 21  1
 6  1    316 102520    312  26152    0    0     0     0  796 1702  0 66 33  0
 5  0    308 102740    364  26108    0    0     0     0  793 1086  0 94  6  0

-- reboot here --
Post #7
jr_ttg
25 Oct 2017, 23:07 
root@OpenWrt:~# free -m
             total         used         free       shared      buffers
Mem:        255780        89904       165876          352        10508
-/+ buffers:              79396       176384
Swap:      1048572            0      1048572

The discussion might have continued from here.