Only getting an IP on join

Community Support
1

Hi,

I’m having a curious problem. I was initially using a self host zt, but in trying to find the problem, I ended up using a zerotier.com network too and the problem persists, so I’m guessing the issue is not the controller.

In an armbian install (12, bookworm) on an orange pi, I joined a network, and right after joining everything went well, but, if I restart zerotier-one, it’ll never get an ipv4 address anymore, only an ipc6 address, although I have ipv6 disabled in zt network.

I then disabled ipv6 on armbian, but the problem remains, gets an ipv4 address on join, if I restart zerotier-one (or reboot) it’ll never get an ipv4, nor an ipv6 now since I disabled it.

Here’s netplan

network:
  version: 2
  renderer: networkd
  ethernets:
    all-eth-interfaces:
      link-local: []
      match:
        name: "*"
      dhcp4: yes
      dhcp6: no

2024-08-29T00:48:41.483517+00:00 orangepipc systemd[1]: Started zerotier-one.service - ZeroTier One.
2024-08-29T00:48:41.777932+00:00 orangepipc zerotier-one[1294]: Starting Control Plane...
2024-08-29T00:48:41.778612+00:00 orangepipc zerotier-one[1294]: Starting V6 Control Plane...
2024-08-29T00:48:41.853756+00:00 orangepipc systemd-networkd[354]: zts7j24div: Configuring with /run/systemd/network/10-netplan-all-eth-interfaces.network.
2024-08-29T00:48:41.860878+00:00 orangepipc systemd-networkd[354]: zts7j24div: Link UP
2024-08-29T00:48:41.861429+00:00 orangepipc systemd-networkd[354]: zts7j24div: Gained carrier
2024-08-29T00:49:26.350459+00:00 orangepipc systemd-networkd[354]: zts7j24div: Link DOWN
2024-08-29T00:49:26.351445+00:00 orangepipc systemd-networkd[354]: zts7j24div: Lost carrier
2024-08-29T00:49:38.379899+00:00 orangepipc systemd-networkd[354]: zts7j24div: Link UP
2024-08-29T00:49:38.380421+00:00 orangepipc systemd-networkd[354]: zts7j24div: Gained carrier
2024-08-29T00:49:38.390704+00:00 orangepipc systemd-networkd[354]: zts7j24div: Configuring with /run/systemd/network/10-netplan-all-eth-interfaces.network.
2024-08-29T00:49:41.923284+00:00 orangepipc avahi-daemon[564]: Joining mDNS multicast group on interface zts7j24div.IPv4 with address 10.121.15.185.
2024-08-29T00:49:41.924365+00:00 orangepipc avahi-daemon[564]: New relevant interface zts7j24div.IPv4 for mDNS.
2024-08-29T00:49:41.925225+00:00 orangepipc avahi-daemon[564]: Registering new address record for 10.121.15.185 on zts7j24div.IPv4.
2024-08-29T00:50:14.334535+00:00 orangepipc avahi-daemon[564]: Interface zts7j24div.IPv4 no longer relevant for mDNS.
2024-08-29T00:50:14.337612+00:00 orangepipc systemd-networkd[354]: zts7j24div: Link DOWN
2024-08-29T00:50:14.340954+00:00 orangepipc avahi-daemon[564]: Leaving mDNS multicast group on interface zts7j24div.IPv4 with address 10.121.15.185.
2024-08-29T00:50:14.342020+00:00 orangepipc systemd-networkd[354]: zts7j24div: Lost carrier
2024-08-29T00:50:14.342769+00:00 orangepipc avahi-daemon[564]: Withdrawing address record for 10.121.15.185 on zts7j24div.
2024-08-29T00:50:14.344358+00:00 orangepipc systemd[1]: Stopping zerotier-one.service - ZeroTier One...
2024-08-29T00:50:16.213390+00:00 orangepipc zerotier-one[1294]: Control Plane Stopped
2024-08-29T00:50:16.214391+00:00 orangepipc zerotier-one[1294]: V6 Control Plane Stopped
2024-08-29T00:50:16.899868+00:00 orangepipc systemd[1]: zerotier-one.service: Deactivated successfully.
2024-08-29T00:50:16.900977+00:00 orangepipc systemd[1]: Stopped zerotier-one.service - ZeroTier One.
2024-08-29T00:50:16.905458+00:00 orangepipc systemd[1]: zerotier-one.service: Consumed 1.182s CPU time.
2024-08-29T00:50:27.903180+00:00 orangepipc systemd[1]: Started zerotier-one.service - ZeroTier One.
2024-08-29T00:50:28.196793+00:00 orangepipc zerotier-one[1369]: Starting Control Plane...
2024-08-29T00:50:28.197379+00:00 orangepipc zerotier-one[1369]: Starting V6 Control Plane...
2024-08-29T00:50:28.274017+00:00 orangepipc systemd-networkd[354]: zts7j24div: Configuring with /run/systemd/network/10-netplan-all-eth-interfaces.network.
2024-08-29T00:50:28.276774+00:00 orangepipc systemd-networkd[354]: zts7j24div: Link UP
2024-08-29T00:50:28.277323+00:00 orangepipc systemd-networkd[354]: zts7j24div: Gained carrier
2024-08-29T00:51:33.883036+00:00 orangepipc systemd[1]: Starting systemd-tmpfiles-clean.service - Cleanup of Temporary Directories...
2024-08-29T00:51:34.672171+00:00 orangepipc systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully.
2024-08-29T00:51:34.673364+00:00 orangepipc systemd[1]: Finished systemd-tmpfiles-clean.service - Cleanup of Temporary Directories.
2024-08-29T00:51:34.682581+00:00 orangepipc systemd[1]: run-credentials-systemd\x2dtmpfiles\x2dclean.service.mount: Deactivated successfully.
2024-08-29T00:54:34.431626+00:00 orangepipc systemd-networkd[354]: ztt6jqztpl: Configuring with /run/systemd/network/10-netplan-all-eth-interfaces.network.
2024-08-29T00:54:34.433711+00:00 orangepipc systemd-networkd[354]: ztt6jqztpl: Link UP
2024-08-29T00:54:34.434306+00:00 orangepipc systemd-networkd[354]: ztt6jqztpl: Gained carrier
2024-08-29T00:54:58.427219+00:00 orangepipc avahi-daemon[564]: Joining mDNS multicast group on interface ztt6jqztpl.IPv4 with address 172.24.197.121.
2024-08-29T00:54:58.428274+00:00 orangepipc avahi-daemon[564]: New relevant interface ztt6jqztpl.IPv4 for mDNS.
2024-08-29T00:54:58.429015+00:00 orangepipc avahi-daemon[564]: Registering new address record for 172.24.197.121 on ztt6jqztpl.IPv4.
2024-08-29T00:55:31.557518+00:00 orangepipc avahi-daemon[564]: Interface ztt6jqztpl.IPv4 no longer relevant for mDNS.
2024-08-29T00:55:31.558061+00:00 orangepipc avahi-daemon[564]: Leaving mDNS multicast group on interface ztt6jqztpl.IPv4 with address 172.24.197.121.
2024-08-29T00:55:31.560618+00:00 orangepipc systemd[1]: Stopping zerotier-one.service - ZeroTier One...
2024-08-29T00:55:31.563825+00:00 orangepipc systemd-networkd[354]: ztt6jqztpl: Link DOWN
2024-08-29T00:55:31.564312+00:00 orangepipc systemd-networkd[354]: ztt6jqztpl: Lost carrier
2024-08-29T00:55:31.566842+00:00 orangepipc avahi-daemon[564]: Withdrawing address record for 172.24.197.121 on ztt6jqztpl.
2024-08-29T00:55:31.588033+00:00 orangepipc systemd-networkd[354]: zts7j24div: Link DOWN
2024-08-29T00:55:31.588540+00:00 orangepipc systemd-networkd[354]: zts7j24div: Lost carrier
2024-08-29T00:55:31.636059+00:00 orangepipc zerotier-one[1369]: Control Plane Stopped
2024-08-29T00:55:31.636448+00:00 orangepipc zerotier-one[1369]: V6 Control Plane Stopped
2024-08-29T00:55:33.007351+00:00 orangepipc systemd[1]: zerotier-one.service: Deactivated successfully.
2024-08-29T00:55:33.007894+00:00 orangepipc systemd[1]: Stopped zerotier-one.service - ZeroTier One.
2024-08-29T00:55:33.009864+00:00 orangepipc systemd[1]: zerotier-one.service: Consumed 2.543s CPU time.
2024-08-29T00:55:40.067482+00:00 orangepipc systemd[1]: Started zerotier-one.service - ZeroTier One.
2024-08-29T00:55:40.361232+00:00 orangepipc zerotier-one[1432]: Starting Control Plane...
2024-08-29T00:55:40.361814+00:00 orangepipc zerotier-one[1432]: Starting V6 Control Plane...
2024-08-29T00:55:40.450940+00:00 orangepipc systemd-networkd[354]: ztt6jqztpl: Configuring with /run/systemd/network/10-netplan-all-eth-interfaces.network.
2024-08-29T00:55:40.461720+00:00 orangepipc systemd-networkd[354]: zts7j24div: Configuring with /run/systemd/network/10-netplan-all-eth-interfaces.network.
2024-08-29T00:55:40.467057+00:00 orangepipc systemd-networkd[354]: ztt6jqztpl: Link UP
2024-08-29T00:55:40.467659+00:00 orangepipc systemd-networkd[354]: ztt6jqztpl: Gained carrier
2024-08-29T00:55:40.492623+00:00 orangepipc systemd-networkd[354]: zts7j24div: Link UP
2024-08-29T00:55:40.493343+00:00 orangepipc systemd-networkd[354]: zts7j24div: Gained carrier
2024-08-29T01:00:01.278588+00:00 orangepipc CRON[1467]: (root) CMD (/usr/lib/armbian/armbian-truncate-logs)

It joined two networks, one self hosted and another in zerotier.com, 10.121.15.185 is the self hosted.

200 listnetworks <nwid> <name> <mac> <status> <type> <dev> <ZT assigned ips>
200 listnetworks redacted rb-home 06:b0:7f:1d:ff:52 OK PRIVATE zts7j24div 10.121.15.185/24
200 listnetworks redacted thirsty_metcalfe 4e:18:8b:a8:97:04 OK PRIVATE ztt6jqztpl 172.24.197.121/16

Host is configured to route between zertotier and physical network, following the guide route-between-phys-and-virt

Chain INPUT (policy ACCEPT)
target     prot opt source               destination

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination
ACCEPT     all  --  anywhere             anywhere             state RELATED,ESTABLISHED
ACCEPT     all  --  anywhere             anywhere

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination


Chain PREROUTING (policy ACCEPT)
target     prot opt source               destination

Chain INPUT (policy ACCEPT)
target     prot opt source               destination

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination

Chain POSTROUTING (policy ACCEPT)
target     prot opt source               destination
MASQUERADE  all  --  anywhere             anywhere


rbarreiros@orangepipc:~$ sudo sysctl -p
net.ipv4.ip_forward = 1
vm.swappiness = 100
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1


end0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.1.24  netmask 255.255.255.0  broadcast 192.168.1.255
        ether 02:81:68:3e:d8:a9  txqueuelen 1000  (Ethernet)
        RX packets 16187  bytes 2827844 (2.6 MiB)
        RX errors 0  dropped 1  overruns 0  frame 0
        TX packets 14957  bytes 1612967 (1.5 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device interrupt 35

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 246  bytes 22894 (22.3 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 246  bytes 22894 (22.3 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

zts7j24div: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 2800
        ether 06:b0:7f:1d:ff:52  txqueuelen 1000  (Ethernet)
        RX packets 20  bytes 1733 (1.6 KiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 25  bytes 8375 (8.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

ztt6jqztpl: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 2800
        ether 4e:18:8b:a8:97:04  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 25  bytes 8375 (8.1 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

Any idea on how to proceed to figure out why it isn’t getting an IP ?

Thanks.

2

Anyone ? No idea ? :frowning:

3

My guess is zerotier and your system network manager thing are fighting. Please tell the distribution to ignore zerotier’s interfaces. Maybe you can ignore “zt*” or something like that.

4

Damn!! It was exactly that, changed the match on netplan to just match the ethernet interface and ignore all rest, and it’s working!!

Just a head up for anyone searching,

network:
  version: 2
  renderer: networkd
  ethernets:
    all-eth-interfaces:
      link-local: []
      match:
        name: "end*"
      dhcp4: yes
      dhcp6: yes
      ipv6-privacy: yes

change name match to the ethernet iface specifically (mine is end0) instead of the default “*”

Thanks!!