Adze wrote:dinman wrote:I have 6 WAN everything is working fine for few hours and then most of the WAN are going OFFLINE "tracking down".
Something kills the mwan3track process and removes interface configuration. Could you post "iptables -L -t mangle -v -n" please, before and after an interface is offline. Could you also paste your logs please?
Hello,
WAN5 is disabled from few hours.
BEFORE : iptables -L -t mangle -v -n
Chain PREROUTING (policy ACCEPT 1590K packets, 1127M bytes)
pkts bytes target prot opt in out source destination
37M 27G mwan3_hook all -- * * 0.0.0.0/0 0.0.0.0/0
1590K 1127M fwmark all -- * * 0.0.0.0/0 0.0.0.0/0
Chain INPUT (policy ACCEPT 21714 packets, 2047K bytes)
pkts bytes target prot opt in out source destination
Chain FORWARD (policy ACCEPT 1564K packets, 1124M bytes)
pkts bytes target prot opt in out source destination
1564K 1124M mssfix all -- * * 0.0.0.0/0 0.0.0.0/0
Chain OUTPUT (policy ACCEPT 20981 packets, 4390K bytes)
pkts bytes target prot opt in out source destination
233K 31M mwan3_hook all -- * * 0.0.0.0/0 0.0.0.0/0
Chain POSTROUTING (policy ACCEPT 1585K packets, 1128M bytes)
pkts bytes target prot opt in out source destination
Chain fwmark (1 references)
pkts bytes target prot opt in out source destination
Chain mssfix (1 references)
pkts bytes target prot opt in out source destination
2992 186K TCPMSS tcp -- * eth0.20 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
3089 192K TCPMSS tcp -- * eth0.30 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
2807 175K TCPMSS tcp -- * eth0.40 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
6745 400K TCPMSS tcp -- * eth0.50 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
2925 182K TCPMSS tcp -- * eth1.60 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
0 0 TCPMSS tcp -- * eth1.70 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
0 0 TCPMSS tcp -- * eth1.80 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
2669 166K TCPMSS tcp -- * eth0.10 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
Chain mwan3_connected (2 references)
pkts bytes target prot opt in out source destination
21M 24G MARK all -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected dst MARK or 0xff00
Chain mwan3_hook (2 references)
pkts bytes target prot opt in out source destination
37M 27G CONNMARK all -- * * 0.0.0.0/0 0.0.0.0/0 CONNMARK restore mask 0xff00
1081K 121M mwan3_ifaces all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
835K 68M mwan3_connected all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
823K 66M mwan3_track all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
772K 64M mwan3_rules all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
37M 27G CONNMARK all -- * * 0.0.0.0/0 0.0.0.0/0 CONNMARK save mask 0xff00
37M 27G mwan3_connected all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xff00/0xff00
Chain mwan3_iface_WAN1 (1 references)
pkts bytes target prot opt in out source destination
2266 791K MARK all -- eth0.10 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
130 9793 MARK all -- eth0.10 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN1 */ MARK xset 0x100/0xff00
Chain mwan3_iface_WAN2 (1 references)
pkts bytes target prot opt in out source destination
1026 358K MARK all -- eth0.20 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
21 1173 MARK all -- eth0.20 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN2 */ MARK xset 0x200/0xff00
Chain mwan3_iface_WAN3 (1 references)
pkts bytes target prot opt in out source destination
1027 358K MARK all -- eth0.30 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
4 254 MARK all -- eth0.30 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN3 */ MARK xset 0x300/0xff00
Chain mwan3_iface_WAN4 (1 references)
pkts bytes target prot opt in out source destination
22512 7857K MARK all -- eth0.40 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
308 19676 MARK all -- eth0.40 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN4 */ MARK xset 0x400/0xff00
Chain mwan3_iface_WAN5 (1 references)
pkts bytes target prot opt in out source destination
4714 1645K MARK all -- eth0.50 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
385 24781 MARK all -- eth0.50 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN5 */ MARK xset 0x500/0xff00
Chain mwan3_iface_WAN6 (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- eth1.60 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
3778 406K MARK all -- eth1.60 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN6 */ MARK xset 0x600/0xff00
Chain mwan3_ifaces (1 references)
pkts bytes target prot opt in out source destination
1071K 118M mwan3_iface_WAN4 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
167K 18M mwan3_iface_WAN5 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
71166 6795K mwan3_iface_WAN1 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
51643 4546K mwan3_iface_WAN6 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
33023 2960K mwan3_iface_WAN3 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
31771 2583K mwan3_iface_WAN2 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
Chain mwan3_policy_balanced (3 references)
pkts bytes target prot opt in out source destination
3374 270K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.16600000020 /* WAN6 8 48 */ MARK xset 0x600/0xff00
3286 270K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.20000000019 /* WAN5 8 40 */ MARK xset 0x500/0xff00
3266 277K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.25000000000 /* WAN4 8 32 */ MARK xset 0x400/0xff00
3243 257K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.33300000010 /* WAN3 8 24 */ MARK xset 0x300/0xff00
3228 283K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.50000000000 /* WAN2 8 16 */ MARK xset 0x200/0xff00
3237 272K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN1 8 8 */ MARK xset 0x100/0xff00
Chain mwan3_policy_wan1_only (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN1 8 8 */ MARK xset 0x100/0xff00
Chain mwan3_policy_wan2_only (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN2 8 8 */ MARK xset 0x200/0xff00
Chain mwan3_rule_https (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x600/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x500/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x400/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x300/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x200/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x100/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 mwan3_policy_balanced all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
0 0 SET all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xfc00/0xfc00 del-set mwan3_sticky_https src,src
0 0 SET all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xfc00/0xfc00 add-set mwan3_sticky_https src,src
Chain mwan3_rule_youtube (1 references)
pkts bytes target prot opt in out source destination
5475 296K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x600/0xff00
5328 287K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
5328 287K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x500/0xff00
1507 61744 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
1507 61744 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x400/0xff00
108 4713 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
108 4713 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x300/0xff00
95 4115 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
95 4115 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x200/0xff00
51 2355 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
51 2355 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x100/0xff00
10 463 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
10 463 mwan3_policy_balanced all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
5475 296K SET all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xfc00/0xfc00 del-set mwan3_sticky_youtube src,src
5475 296K SET all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xfc00/0xfc00 add-set mwan3_sticky_youtube src,src
Chain mwan3_rules (1 references)
pkts bytes target prot opt in out source destination
0 0 mwan3_policy_wan1_only all -- * * 0.0.0.0/0 192.168.1.0/24 mark match 0x0/0xff00 /* wan1_network */
0 0 mwan3_policy_wan2_only all -- * * 0.0.0.0/0 192.168.2.0/24 mark match 0x0/0xff00 /* wan2_network */
5475 296K mwan3_rule_youtube tcp -- * * 0.0.0.0/0 0.0.0.0/0 multiport sports 0:65535 multiport dports 80,443 mark match 0x0/0xff00 /* youtube */
0 0 mwan3_rule_https tcp -- * * 0.0.0.0/0 0.0.0.0/0 multiport sports 0:65535 multiport dports 443 mark match 0x0/0xff00 /* https */
19624 1628K mwan3_policy_balanced all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* default_rule */
Chain mwan3_track (1 references)
pkts bytes target prot opt in out source destination
25556 818K MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN4 dst icmptype 8 length 32 MARK or 0xff00
5143 165K MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN5 dst icmptype 8 length 32 MARK or 0xff00
1722 55104 MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN1 dst icmptype 8 length 32 MARK or 0xff00
1186 37952 MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN6 dst icmptype 8 length 32 MARK or 0xff00
1180 37760 MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN3 dst icmptype 8 length 32 MARK or 0xff00
392 12544 MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN2 dst icmptype 8 length 32 MARK or 0xff00
Chain qos_Default_ct (0 references)
pkts bytes target prot opt in out source destination
0 0 MARK udp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf udp multiport ports 22,53 /* ssh, dns */ MARK xset 0x11/0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 20,21,25,80,110,443,993,995 /* ftp, smtp, http(s), imap */ MARK xset 0x33/0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 5190 /* AOL, iChat, ICQ */ MARK xset 0x22/0xff
0 0 MARK udp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf udp multiport ports 5190 /* AOL, iChat, ICQ */ MARK xset 0x22/0xff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf MARK xset 0x44/0xff
0 0 CONNMARK all -- * * 0.0.0.0/0 0.0.0.0/0 CONNMARK save mask 0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 22,53 /* ssh, dns */ MARK xset 0x11/0xff
0 0 MARK udp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf udp multiport ports 22,53 /* ssh, dns */ MARK xset 0x11/0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 20,21,25,80,110,443,993,995 /* ftp, smtp, http(s), imap */ MARK xset 0x33/0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 5190 /* AOL, iChat, ICQ */ MARK xset 0x22/0xff
0 0 MARK udp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf udp multiport ports 5190 /* AOL, iChat, ICQ */ MARK xset 0x22/0xff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf MARK xset 0x44/0xff
AFTER : iptables -L -t mangle -v -n
Chain PREROUTING (policy ACCEPT 1917K packets, 1321M bytes)
pkts bytes target prot opt in out source destination
260M 177G mwan3_hook all -- * * 0.0.0.0/0 0.0.0.0/0
1917K 1321M fwmark all -- * * 0.0.0.0/0 0.0.0.0/0
Chain INPUT (policy ACCEPT 19671 packets, 2378K bytes)
pkts bytes target prot opt in out source destination
Chain FORWARD (policy ACCEPT 1893K packets, 1317M bytes)
pkts bytes target prot opt in out source destination
1893K 1317M mssfix all -- * * 0.0.0.0/0 0.0.0.0/0
Chain OUTPUT (policy ACCEPT 19704 packets, 4461K bytes)
pkts bytes target prot opt in out source destination
2504K 425M mwan3_hook all -- * * 0.0.0.0/0 0.0.0.0/0
Chain POSTROUTING (policy ACCEPT 1913K packets, 1322M bytes)
pkts bytes target prot opt in out source destination
Chain fwmark (1 references)
pkts bytes target prot opt in out source destination
Chain mssfix (1 references)
pkts bytes target prot opt in out source destination
2012 105K TCPMSS tcp -- * eth0.20 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
1986 102K TCPMSS tcp -- * eth0.30 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
6774 382K TCPMSS tcp -- * eth0.40 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
0 0 TCPMSS tcp -- * eth0.50 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
1855 95344 TCPMSS tcp -- * eth1.60 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
0 0 TCPMSS tcp -- * eth1.70 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
0 0 TCPMSS tcp -- * eth1.80 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
1719 88640 TCPMSS tcp -- * eth0.10 0.0.0.0/0 0.0.0.0/0 tcp flags:0x06/0x02 /* wan (mtu_fix) */ TCPMSS clamp to PMTU
Chain mwan3_connected (2 references)
pkts bytes target prot opt in out source destination
145M 158G MARK all -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected dst MARK or 0xff00
Chain mwan3_hook (2 references)
pkts bytes target prot opt in out source destination
263M 178G CONNMARK all -- * * 0.0.0.0/0 0.0.0.0/0 CONNMARK restore mask 0xff00
7716K 834M mwan3_ifaces all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
6128K 549M mwan3_connected all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
5785K 492M mwan3_track all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
5531K 484M mwan3_rules all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
263M 178G CONNMARK all -- * * 0.0.0.0/0 0.0.0.0/0 CONNMARK save mask 0xff00
260M 177G mwan3_connected all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xff00/0xff00
Chain mwan3_iface_WAN1 (1 references)
pkts bytes target prot opt in out source destination
833 291K MARK all -- eth0.10 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
45 4622 MARK all -- eth0.10 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN1 */ MARK xset 0x100/0xff00
Chain mwan3_iface_WAN2 (1 references)
pkts bytes target prot opt in out source destination
11744 4099K MARK all -- eth0.20 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
1036 71422 MARK all -- eth0.20 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN2 */ MARK xset 0x200/0xff00
Chain mwan3_iface_WAN3 (1 references)
pkts bytes target prot opt in out source destination
23426 8176K MARK all -- eth0.30 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
2169 144K MARK all -- eth0.30 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN3 */ MARK xset 0x300/0xff00
Chain mwan3_iface_WAN4 (1 references)
pkts bytes target prot opt in out source destination
27419 9569K MARK all -- eth0.40 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
2068 122K MARK all -- eth0.40 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN4 */ MARK xset 0x400/0xff00
Chain mwan3_iface_WAN6 (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- eth1.60 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
40467 3978K MARK all -- eth1.60 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN6 */ MARK xset 0x600/0xff00
Chain mwan3_ifaces (1 references)
pkts bytes target prot opt in out source destination
1128K 128M mwan3_iface_WAN4 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
852K 88M mwan3_iface_WAN3 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
455K 49M mwan3_iface_WAN2 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
347K 33M mwan3_iface_WAN6 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
36343 4012K mwan3_iface_WAN1 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
Chain mwan3_policy_balanced (3 references)
pkts bytes target prot opt in out source destination
5518 594K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.20000000019 /* WAN6 8 40 */ MARK xset 0x600/0xff00
5582 609K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.25000000000 /* WAN4 8 32 */ MARK xset 0x400/0xff00
5652 615K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.33300000010 /* WAN3 8 24 */ MARK xset 0x300/0xff00
5541 588K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.50000000000 /* WAN2 8 16 */ MARK xset 0x200/0xff00
5537 590K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN1 8 8 */ MARK xset 0x100/0xff00
Chain mwan3_policy_wan1_only (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN1 8 8 */ MARK xset 0x100/0xff00
Chain mwan3_policy_wan2_only (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN2 8 8 */ MARK xset 0x200/0xff00
Chain mwan3_rule_https (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x600/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x400/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x300/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x200/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x100/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
0 0 mwan3_policy_balanced all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
0 0 SET all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xfc00/0xfc00 del-set mwan3_sticky_https src,src
0 0 SET all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xfc00/0xfc00 add-set mwan3_sticky_https src,src
Chain mwan3_rule_youtube (1 references)
pkts bytes target prot opt in out source destination
5077 369K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x600/0xff00
4991 361K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
4991 361K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x400/0xff00
404 23313 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
404 23313 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x300/0xff00
342 20437 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
342 20437 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x200/0xff00
57 6389 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
57 6389 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x100/0xff00
19 991 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
19 991 mwan3_policy_balanced all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
5077 369K SET all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xfc00/0xfc00 del-set mwan3_sticky_youtube src,src
5077 369K SET all -- * * 0.0.0.0/0 0.0.0.0/0 mark match ! 0xfc00/0xfc00 add-set mwan3_sticky_youtube src,src
Chain mwan3_rules (1 references)
pkts bytes target prot opt in out source destination
0 0 mwan3_policy_wan1_only all -- * * 0.0.0.0/0 192.168.1.0/24 mark match 0x0/0xff00 /* wan1_network */
0 0 mwan3_policy_wan2_only all -- * * 0.0.0.0/0 192.168.2.0/24 mark match 0x0/0xff00 /* wan2_network */
5077 369K mwan3_rule_youtube tcp -- * * 0.0.0.0/0 0.0.0.0/0 multiport sports 0:65535 multiport dports 80,443 mark match 0x0/0xff00 /* youtube */
0 0 mwan3_rule_https tcp -- * * 0.0.0.0/0 0.0.0.0/0 multiport sports 0:65535 multiport dports 443 mark match 0x0/0xff00 /* https */
27811 2994K mwan3_policy_balanced all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* default_rule */
Chain mwan3_track (1 references)
pkts bytes target prot opt in out source destination
38277 1225K MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN5 dst icmptype 8 length 32 MARK or 0xff00
21156 677K MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN4 dst icmptype 8 length 32 MARK or 0xff00
18126 580K MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN3 dst icmptype 8 length 32 MARK or 0xff00
4532 145K MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN2 dst icmptype 8 length 32 MARK or 0xff00
6625 212K MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN6 dst icmptype 8 length 32 MARK or 0xff00
646 20672 MARK icmp -- * * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_track_WAN1 dst icmptype 8 length 32 MARK or 0xff00
Chain qos_Default_ct (0 references)
pkts bytes target prot opt in out source destination
0 0 MARK udp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf udp multiport ports 22,53 /* ssh, dns */ MARK xset 0x11/0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 20,21,25,80,110,443,993,995 /* ftp, smtp, http(s), imap */ MARK xset 0x33/0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 5190 /* AOL, iChat, ICQ */ MARK xset 0x22/0xff
0 0 MARK udp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf udp multiport ports 5190 /* AOL, iChat, ICQ */ MARK xset 0x22/0xff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf MARK xset 0x44/0xff
0 0 CONNMARK all -- * * 0.0.0.0/0 0.0.0.0/0 CONNMARK save mask 0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 22,53 /* ssh, dns */ MARK xset 0x11/0xff
0 0 MARK udp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf udp multiport ports 22,53 /* ssh, dns */ MARK xset 0x11/0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 20,21,25,80,110,443,993,995 /* ftp, smtp, http(s), imap */ MARK xset 0x33/0xff
0 0 MARK tcp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf tcp multiport ports 5190 /* AOL, iChat, ICQ */ MARK xset 0x22/0xff
0 0 MARK udp -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf udp multiport ports 5190 /* AOL, iChat, ICQ */ MARK xset 0x22/0xff
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xf MARK xset 0x44/0xff
DIFF : iptables -L -t mangle -v -n
Chain mwan3_iface_WAN5 (1 references)
pkts bytes target prot opt in out source destination
4714 1645K MARK all -- eth0.50 * 0.0.0.0/0 0.0.0.0/0 match-set mwan3_connected src mark match 0x0/0xff00 /* default */ MARK or 0xff00
385 24781 MARK all -- eth0.50 * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 /* WAN5 */ MARK xset 0x500/0xff00
Chain mwan3_ifaces (1 references)
167K 18M mwan3_iface_WAN5 all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00
Chain mwan3_policy_balanced (3 references)
pkts bytes target prot opt in out source destination
3374 270K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 statistic mode random probability 0.16600000020 /* WAN6 8 48 */ MARK xset 0x600/0xff00
Chain mwan3_rule_https (1 references)
pkts bytes target prot opt in out source destination
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x500/0xff00
0 0 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_https src,src MARK and 0xffff00ff
Chain mwan3_rule_youtube (1 references)
pkts bytes target prot opt in out source destination
5328 287K MARK all -- * * 0.0.0.0/0 0.0.0.0/0 mark match 0x0/0xff00 MARK xset 0x500/0xff00
1507 61744 MARK all -- * * 0.0.0.0/0 0.0.0.0/0 ! match-set mwan3_sticky_youtube src,src MARK and 0xffff00ff
logread ( nothing about WAN5)
Wed May 20 16:03:48 2015 daemon.err uhttpd[4295]: /usr/lib/lua/luci/controller/mwan3.lua:229: attempt to index field 'version' (a nil value)
Wed May 20 16:04:49 2015 user.info mwan3track: Lost 1 ping(s) on interface WAN3 (eth0.30)
Wed May 20 16:04:49 2015 user.info mwan3track: Lost 1 ping(s) on interface WAN6 (eth1.60)
Wed May 20 16:05:36 2015 user.info mwan3track: Lost 1 ping(s) on interface WAN3 (eth0.30)
Wed May 20 16:05:38 2015 user.info mwan3track: Lost 2 ping(s) on interface WAN6 (eth1.60)
Wed May 20 16:05:55 2015 user.info mwan3track: Lost 1 ping(s) on interface WAN6 (eth1.60)
Wed May 20 16:06:14 2015 user.info mwan3track: Lost 1 ping(s) on interface WAN3 (eth0.30)
Wed May 20 16:06:38 2015 user.info mwan3track: Lost 1 ping(s) on interface WAN6 (eth1.60)
Wed May 20 16:07:09 2015 user.info mwan3track: Lost 2 ping(s) on interface WAN3 (eth0.30)
Wed May 20 16:07:15 2015 user.info mwan3track: Lost 1 ping(s) on interface WAN6 (eth1.60)
ps -w
PID USER VSZ STAT COMMAND
1 root 1408 S /sbin/procd
2 root 0 SW [kthreadd]
3 root 0 SW [ksoftirqd/0]
4 root 0 SW [kworker/0:0]
5 root 0 SW< [kworker/0:0H]
7 root 0 SW< [khelper]
8 root 0 SW [kworker/u2:1]
31 root 0 SW< [writeback]
55 root 0 SW< [bioset]
56 root 0 SW< [kblockd]
57 root 0 SW [kswapd0]
58 root 0 SW [kworker/0:1]
59 root 0 SW [fsnotify_mark]
153 root 0 SW [spi0]
313 root 0 SW< [deferwq]
314 root 0 SW [kworker/u2:2]
424 root 900 S /sbin/ubusd
425 root 772 S /sbin/askfirst /bin/ash --login
574 root 0 SW< [ipv6_addrconf]
722 root 0 SW< [cfg80211]
837 root 1156 S /sbin/logd -S 16
846 root 1532 S /sbin/rpcd
881 root 1532 S /sbin/netifd
901 root 1172 S /usr/sbin/odhcpd
1103 root 1364 S /usr/sbin/crond -f -c /etc/crontabs -l 8
1141 root 1152 S /usr/sbin/dropbear -F -P /var/run/dropbear.1.pid -p 2222 -K 300
1640 nobody 940 S /usr/sbin/dnsmasq -C /var/etc/dnsmasq.conf -k -x /var/run/dnsmasq/dnsmasq.pid
3345 root 1364 S {mwan3track} /bin/sh /usr/sbin/mwan3track WAN6 eth1.60 1 1 2 5 3 3 8.8.8.8
4295 root 1580 S /usr/sbin/uhttpd -f -h /www -r SRM -x /cgi-bin -u /ubus -t 60 -T 30 -k 20 -A 1 -n 3 -N 100 -R -p 0.0.0.0:
4384 root 1364 S /usr/sbin/ntpd -n -S /usr/sbin/ntpd-hotplug -p 0.openwrt.pool.ntp.org -p 1.openwrt.pool.ntp.org -p 2.open
8499 root 1364 S {mwan3track} /bin/sh /usr/sbin/mwan3track WAN4 eth0.40 1 1 2 5 3 3 176.31.81.4
11138 root 1364 S {mwan3track} /bin/sh /usr/sbin/mwan3track WAN2 eth0.20 1 1 2 5 3 3 8.8.4.4
18951 root 1364 S {mwan3track} /bin/sh /usr/sbin/mwan3track WAN1 eth0.10 1 1 2 5 3 3 8.8.8.8
21665 root 1196 S /usr/sbin/dropbear -F -P /var/run/dropbear.1.pid -p 2222 -K 300
21682 root 1376 S -ash
28399 root 1364 S {mwan3track} /bin/sh /usr/sbin/mwan3track WAN3 eth0.30 1 1 2 5 3 3 176.31.81.4
28844 root 1352 S sleep 5
28845 root 1352 S sleep 5
28849 root 1352 S sleep 5
28852 root 1352 S sleep 5
28853 root 1352 S sleep 5
ping -I eth0.50 8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: seq=0 ttl=59 time=35.382 ms
64 bytes from 8.8.8.8: seq=1 ttl=59 time=36.161 ms
64 bytes from 8.8.8.8: seq=2 ttl=59 time=39.658 ms
64 bytes from 8.8.8.8: seq=3 ttl=59 time=33.872 ms
64 bytes from 8.8.8.8: seq=4 ttl=59 time=34.907 ms
64 bytes from 8.8.8.8: seq=5 ttl=59 time=36.479 ms
^C
--- 8.8.8.8 ping statistics ---
6 packets transmitted, 6 packets received, 0% packet loss
round-trip min/avg/max = 33.872/36.076/39.658 ms
Luci Interface indicate that "IP Rules" and "routing tables" are not OK for WAN5.
Any idea ?