Direct Link Between nodes with high latency (+200ms)

Hello!

I use zerotier for a long time and it always worked flawlessy with a great variety of networks, even double-nat configurations.

But in the last weeks, i’m facing some problems and need help…

The latency between my house and every node outside it became unstable.
Sometimes it’s very good (less than 20ms), but sometimes it’s above 200ms.
What i do in the case of high latency is restart the zerotier service in the nodes / restart the computers. (And it worked until yesterday).

i’m sitting now in the 200ms and can’t reduce it. But what’s is really strange, is that i’m not relaying to the zerotier servers. (or i think i’m not).

root@arturlinux:~# zerotier-cli peers
200 peers
<ztaddr>   <ver>  <role> <lat> <link>   <lastTX> <lastRX> <path>
3efa5cb78a 1.12.2 LEAF     176 DIRECT   1933     21803    35.208.251.87/21027
62f865ae71 -      PLANET   340 DIRECT   1933     46633    50.7.252.138/9993
778cde7190 -      PLANET   124 DIRECT   1933     46850    103.195.103.66/9993
cafe04eba9 -      PLANET   217 DIRECT   1933     46756    84.17.53.155/9993
cafe9efeb9 -      PLANET   169 DIRECT   1933     46804    104.194.8.134/9993
e6cbfe19c9 1.12.2 LEAF     276 DIRECT   6        6620     186.203.170.232/47597
root@arturlinux:~#

This is an output from a server in my house (i’m in my sister house now), and the node that i’m using is the “e6cbfe19c9”.

Some tests:

Server → Node

root@arturlinux:~# ping -i 0.2 -c 10 10.147.19.201
PING 10.147.19.201 (10.147.19.201) 56(84) bytes of data.
64 bytes from 10.147.19.201: icmp_seq=1 ttl=128 time=235 ms
64 bytes from 10.147.19.201: icmp_seq=2 ttl=128 time=230 ms
64 bytes from 10.147.19.201: icmp_seq=3 ttl=128 time=238 ms
64 bytes from 10.147.19.201: icmp_seq=4 ttl=128 time=231 ms
64 bytes from 10.147.19.201: icmp_seq=5 ttl=128 time=244 ms
64 bytes from 10.147.19.201: icmp_seq=6 ttl=128 time=237 ms
64 bytes from 10.147.19.201: icmp_seq=7 ttl=128 time=237 ms
64 bytes from 10.147.19.201: icmp_seq=8 ttl=128 time=235 ms
64 bytes from 10.147.19.201: icmp_seq=9 ttl=128 time=277 ms
64 bytes from 10.147.19.201: icmp_seq=10 ttl=128 time=320 ms

--- 10.147.19.201 ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 1808ms
rtt min/avg/max/mdev = 230.416/248.465/320.233/27.189 ms, pipe 2
root@arturlinux:~#

Server → Cloudflare DNS

root@arturlinux:~# ping -i 0.2 -c 10 1.1.1.1
PING 1.1.1.1 (1.1.1.1) 56(84) bytes of data.
64 bytes from 1.1.1.1: icmp_seq=1 ttl=57 time=4.76 ms
64 bytes from 1.1.1.1: icmp_seq=2 ttl=57 time=9.17 ms
64 bytes from 1.1.1.1: icmp_seq=3 ttl=57 time=9.35 ms
64 bytes from 1.1.1.1: icmp_seq=4 ttl=57 time=9.58 ms
64 bytes from 1.1.1.1: icmp_seq=5 ttl=57 time=8.99 ms
64 bytes from 1.1.1.1: icmp_seq=6 ttl=57 time=8.78 ms
64 bytes from 1.1.1.1: icmp_seq=7 ttl=57 time=9.81 ms
64 bytes from 1.1.1.1: icmp_seq=8 ttl=57 time=5.61 ms
64 bytes from 1.1.1.1: icmp_seq=9 ttl=57 time=5.15 ms
64 bytes from 1.1.1.1: icmp_seq=10 ttl=57 time=4.81 ms

--- 1.1.1.1 ping statistics ---
10 packets transmitted, 10 received, 0% packet loss, time 1806ms
rtt min/avg/max/mdev = 4.759/7.601/9.811/2.084 ms
root@arturlinux:~#

Node → Cloudflare

PS C:\Users\artur> ping -t 1.1.1.1

Pinging 1.1.1.1 with 32 bytes of data:
Reply from 1.1.1.1: bytes=32 time=15ms TTL=57
Reply from 1.1.1.1: bytes=32 time=15ms TTL=57
Reply from 1.1.1.1: bytes=32 time=17ms TTL=57
Reply from 1.1.1.1: bytes=32 time=16ms TTL=57
Reply from 1.1.1.1: bytes=32 time=27ms TTL=57
Reply from 1.1.1.1: bytes=32 time=20ms TTL=57
Reply from 1.1.1.1: bytes=32 time=45ms TTL=57
Reply from 1.1.1.1: bytes=32 time=15ms TTL=57
Reply from 1.1.1.1: bytes=32 time=15ms TTL=57
Reply from 1.1.1.1: bytes=32 time=69ms TTL=57

Ping statistics for 1.1.1.1:
    Packets: Sent = 10, Received = 10, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
    Minimum = 15ms, Maximum = 69ms, Average = 25ms
Control-C
PS C:\Users\artur>

OBS: My house don’t have public ipv4 (it’s CGNAT) and don’t have ipv6 too (i know, it’s bad, but my ISP is a local one and i don’t have much options).

If you guys can help me, i’ll be really grateful!! :smiley:

I enabled UPnP in both routers, verified and the zerotier service configured the ports in both.
But there’s no diference in the performance.

I’ve looked in the modem WAN configuration of my house, and there’s an option to enable Fullcone NAT. But i’m scaried that it fucks the internet connection, because the ISP uses CGNAT.

I’ll continue my research to better understand this part of networking, and update the thread if there’s some change.

After some more tests, i discovered that the problem is my ISP.

More specifically in the route.
Basically, my ISP probably use some shitty cheap line where my packets have to traverse longer paths to reach the destination.

Today my latency lowered, but stays high. (+100ms)

Here’s the traceroute test:

root@arturlinux:~# traceroute 186.203.170.232
traceroute to 186.203.170.232 (186.203.170.232), 30 hops max, 60 byte packets
 1  192.168.10.1 (192.168.10.1)  3.371 ms  3.753 ms  3.739 ms
 2  10.200.0.1 (10.200.0.1)  47.187 ms  47.175 ms  47.163 ms
 3  45.169.27.9 (45.169.27.9)  46.737 ms  47.132 ms  47.120 ms
 4  45.169.27.1 (45.169.27.1)  47.112 ms  47.100 ms  47.086 ms
 5  10.245.128.61 (10.245.128.61)  47.067 ms  47.055 ms  47.044 ms
 6  10.200.2.1 (10.200.2.1)  47.031 ms  4.951 ms  6.835 ms
 7  10.200.100.61 (10.200.100.61)  7.233 ms  7.221 ms  7.204 ms
 8  ae1-3012.edge-gig-cr1.fortetelecom.com.br (186.237.48.201)  7.192 ms  7.180 ms  7.166 ms
 9  irb-854.edge-a.spo-piac.algartelecom.com.br (201.48.84.226)  7.156 ms  7.144 ms  7.132 ms
10  100.127.9.45 (100.127.9.45)  16.238 ms  16.632 ms  16.620 ms
11  et-0-0-0-0.border-a.rjo511.algartelecom.com.br (170.84.34.58)  8.601 ms  7.065 ms  8.150 ms
12  186-230-194-232.ded.intelignet.com.br (186.230.194.232)  111.434 ms  111.547 ms  111.941 ms
13  * * *
14  * * *
15  186-203-170-232.ded.intelignet.com.br (186.203.170.232)  150.291 ms  149.871 ms  149.837 ms
root@arturlinux:~#

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.