Newt between Yukari CA1 and Minato is constantly flapping and has very high latency.
Start time: 10/4/2025, 6:27:17 PM
Severity: medium
Service: Identity, Velvet Hangout Forms
Hosts: Yukari CA1, Minato
Description: Newt between Yukari CA1 and Minato is constantly flapping and has very high latency. See the below logs.
INFO: 2025/10/04 08:26:16 Ping latency: 1.993999488s
INFO: 2025/10/04 08:26:42 Pinging 100.89.128.1
INFO: 2025/10/04 08:26:47 Ping latency: 5.372072892s
INFO: 2025/10/04 08:27:12 Pinging 100.89.128.1
INFO: 2025/10/04 08:27:15 Ping latency: 2.863228986s
INFO: 2025/10/04 08:27:42 Pinging 100.89.128.1
INFO: 2025/10/04 08:27:42 Ping latency: 150.360209ms
INFO: 2025/10/04 08:28:12 Pinging 100.89.128.1
WARN: 2025/10/04 08:28:22 Connection to server lost. Continuous reconnection attempts will be made.
WARN: 2025/10/04 08:28:22 Please check your internet connection and ensure the Pangolin server is online.
WARN: 2025/10/04 08:28:22 Newt will continue reconnection attempts automatically when connectivity is restored.
INFO: 2025/10/04 08:28:42 Pinging 100.89.128.1
INFO: 2025/10/04 08:28:42 Ping latency: 492.87126ms
INFO: 2025/10/04 08:28:42 Connection to server restored!
INFO: 2025/10/04 08:28:42 Successfully re-registered with server after reconnection
INFO: 2025/10/04 08:28:42 Received registration message
INFO: 2025/10/04 08:28:42 Already connected! But I will send a ping anyway...
INFO: 2025/10/04 08:28:42 Ping attempt 1
INFO: 2025/10/04 08:28:42 Pinging 100.89.128.1
WARN: 2025/10/04 08:28:52 Ping attempt 1 failed: failed to read ICMP packet: i/o timeout
INFO: 2025/10/04 08:28:52 Ping attempt 2
INFO: 2025/10/04 08:28:52 Pinging 100.89.128.1
WARN: 2025/10/04 08:29:02 Ping attempt 2 failed: failed to read ICMP packet: i/o timeout
INFO: 2025/10/04 08:29:04 Ping attempt 3
INFO: 2025/10/04 08:29:04 Pinging 100.89.128.1
INFO: 2025/10/04 08:29:12 Pinging 100.89.128.1
yukari@minato:~$
Bidirectional MTRs show no issue.
Vendors engaged: Pangolin for sanity checking. HostHatch will be next to engage.
HostHatch has been engaged at 22:04 NZDT #892074 is our ticket.
Edited by Max