ZeroTier MultiPath Balance_aware not using both interface when downloading

Hello,
I am using ZeroTier in linux. I am trying to use the MultiPath Balance-aware policy in my configuration. I do have 2 laptops with a Wifi and Ethernet connected interfaces.
My local.conf file contains the following:

{
  "settings":
  {
    "defaultBondingPolicy": "custom-balance-aware",
    "policies":
    {
      "custom-balance-aware":
      {
        "basePolicy": "balance-aware",
        "links": {
          "enp0s31f6": { "capacity": 1000 },
          "wlp2s0": { "capacity": 250  }
        }
      }
    }
  }
}

So, as mentioned in the documentation, the balance-aware algorithm will use both interface at the same time to communicate to the laptops inside the network. but whenever I try to download a file from a laptop to another using scp and my ZeroTier interface IP address I can see that I am using just 1 interface. The Ethernet interface and the speed is too slow regardless to my both real interfaces speed.
So my first question is: Why I can’t see that ZeroTier is using both interface at the same time.
And the second: Why the speed is very slow, beyond all measurement.

Thank you.

**sudo zerotier-cli bond 2761aa58f2 show** 
Peer                   : 2761aa58f2
Bond                   : balance-aware
Link Select Method     : 0
Links                  : 36/36
Failover Interval (ms) : 5000
Up Delay (ms)          : 0
Down Delay (ms)        : 0
Packets Per Link       : 64

idx                  interface                                  path               socket
----------------------------------------------------------------------------------------------------
 0:                  enp0s31f6                                  192.168.48.72/9994 00005653d9ee1eb0
 1:                  enp0s31f6                                  192.168.48.72/9994 00005653d9ee22d0
 2:                  enp0s31f6                                  192.168.48.72/9994 00005653d9ee26f0
 3:                     wlp2s0                                  192.168.48.72/9994 00005653d9ee2010
 4:                     wlp2s0                                  192.168.48.72/9994 00005653d9ee2430
 5:                     wlp2s0                                  192.168.48.72/9994 00005653d9ee2850
 6:                  enp0s31f6                                    10.22.16.38/9994 00005653d9ee1eb0
 7:                  enp0s31f6                                    10.22.16.38/9994 00005653d9ee22d0
 8:                  enp0s31f6                                    10.22.16.38/9994 00005653d9ee26f0
 9:                     wlp2s0                                    10.22.16.38/9994 00005653d9ee2010
10:                     wlp2s0                                    10.22.16.38/9994 00005653d9ee2430
11:                     wlp2s0                                    10.22.16.38/9994 00005653d9ee2850
12:                  enp0s31f6                                 192.168.48.72/27788 00005653d9ee1eb0
13:                  enp0s31f6                                 192.168.48.72/27788 00005653d9ee22d0
14:                  enp0s31f6                                 192.168.48.72/27788 00005653d9ee26f0
15:                  enp0s31f6                                 192.168.48.72/32462 00005653d9ee1eb0
16:                  enp0s31f6                                 192.168.48.72/32462 00005653d9ee22d0
17:                  enp0s31f6                                 192.168.48.72/32462 00005653d9ee26f0
18:                  enp0s31f6                                   10.22.16.38/27788 00005653d9ee1eb0
19:                  enp0s31f6                                   10.22.16.38/27788 00005653d9ee22d0
20:                  enp0s31f6                                   10.22.16.38/27788 00005653d9ee26f0
21:                     wlp2s0                                 192.168.48.72/27788 00005653d9ee2430
22:                     wlp2s0                                 192.168.48.72/32462 00005653d9ee2430
23:                     wlp2s0                                   10.22.16.38/27788 00005653d9ee2430
24:                     wlp2s0                                 192.168.48.72/27788 00005653d9ee2850
25:                     wlp2s0                                 192.168.48.72/32462 00005653d9ee2850
26:                     wlp2s0                                   10.22.16.38/27788 00005653d9ee2850
27:                  enp0s31f6                                   10.22.16.38/32462 00005653d9ee1eb0
28:                     wlp2s0                                 192.168.48.72/27788 00005653d9ee2010
29:                     wlp2s0                                 192.168.48.72/32462 00005653d9ee2010
30:                     wlp2s0                                   10.22.16.38/27788 00005653d9ee2010
31:                  enp0s31f6                                   10.22.16.38/32462 00005653d9ee22d0
32:                  enp0s31f6                                   10.22.16.38/32462 00005653d9ee26f0
33:                     wlp2s0                                   10.22.16.38/32462 00005653d9ee2010
34:                     wlp2s0                                   10.22.16.38/32462 00005653d9ee2430
35:                     wlp2s0                                   10.22.16.38/32462 00005653d9ee2850

idx     lat      pdv     plr     per    capacity    qual      rx_age      tx_age  eligible  bonded
----------------------------------------------------------------------------------------------------
 0:     0.00     0.00  0.0000  0.0000          0  0.0000         785         785         1       1
 1:     0.00     0.00  0.0000  0.0000          0  0.0000        1284        1284         1       1
 2:     0.00     0.00  0.0000  0.0000          0  0.0000         784         785         1       1
 3:    15.00    17.00  0.0000  0.0000          0  0.0000        1281        1282         1       1
 4:     5.00     6.00  0.0000  0.0000          0  0.0000        1281        1282         1       1
 5:    23.00    16.00  0.0000  0.0000          0  0.0000         281         282         1       1
 6:     1.00     0.00  0.0000  0.0000          0  0.0000        1280        1282         1       1
 7:     1.00     0.00  0.0000  0.0000          0  0.0000        1280        1282         1       1
 8:     1.00     0.00  0.0000  0.0000          0  0.0000         783        1282         1       1
 9:    16.00    18.00  0.0000  0.0000          0  0.0000         780         781         1       1
10:    16.00    16.00  0.0000  0.0000          0  0.0000         780         781         1       1
11:    26.00    15.00  0.0000  0.0000          0  0.0000         780         781         1       1
12:     0.00     0.00  0.0000  0.0000          0  0.0000        1284        1285         1       1
13:     0.00     0.00  0.0000  0.0000          0  0.0000        1284        1284         1       1
14:     0.00     0.00  0.0000  0.0000          0  0.0000        1284        1284         1       1
15:     0.00     0.00  0.0000  0.0000          0  0.0000        1284        1284         1       1
16:     0.00     0.00  0.0000  0.0000          0  0.0000        1284        1284         1       1
17:     0.00     0.00  0.0000  0.0000          0  0.0000        1785        1785         1       1
18:     2.00     3.00  0.0000  0.0000          0  0.0000        1280        1282         1       1
19:     1.00     0.00  0.0000  0.0000          0  0.0000         781         783         1       1
20:     1.00     0.00  0.0000  0.0000          0  0.0000        1280        1285         1       1
21:     3.00     7.00  0.0000  0.0000          0  0.0000         781         782         1       1
22:    13.00    16.00  0.0000  0.0000          0  0.0000        1281        1285         1       1
23:    10.00    15.00  0.0000  0.0000          0  0.0000         780         781         1       1
24:    12.00    14.00  0.0000  0.0000          0  0.0000        1281        1282         1       1
25:    24.00    15.00  0.0000  0.0000          0  0.0000        1281        1282         1       1
26:     5.00     6.00  0.0000  0.0000          0  0.0000         780         781         1       1
27:     2.00     0.00  0.0000  0.0000          0  0.0000        1280        1282         1       1
28:     8.00    11.00  0.0000  0.0000          0  0.0000        1281        1282         1       1
29:    15.00    18.00  0.0000  0.0000          0  0.0000        1281        1282         1       1
30:    11.00    14.00  0.0000  0.0000          0  0.0000         781        1281         1       1
31:     1.00     0.00  0.0000  0.0000          0  0.0000        1280        1282         1       1
32:     1.00     0.00  0.0000  0.0000          0  0.0000        1280        1282         1       1
33:    17.00    16.00  0.0000  0.0000          0  0.0000        1278        1281         1       1
34:    24.00    16.00  0.0000  0.0000          0  0.0000         780         781         1       1
35:    24.00    16.00  0.0000  0.0000          0  0.0000         779         781         1       1

If you use multiple streams, how does it behave? SCP will not do this, I suggest you try something like iperf for speed testing as there are many tuneables in there.

Hello,
What do you mean about using multiple streams?
Also the same issue with iperf3.

iperf3 -P n
Specify number of parallel streams.

1 Like

Hello,
Yes I am getting way better Bitrate now. It was like 5 Mbits/sec Max. and with -P 46 I reached 80 Mbits/s Max. The average was like 40 Mbits/s. I am using bmon tool to supervise my interfaces speed, but now I can see that I am only using my Wireless interface.
Is the Balance_aware policy uses both interfaces at the same time?
How can I supervise that ?

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.