LON1 on X4B Network Status

[Resolved] London GTT packet loss

Tue, 09 Dec 2025 02:28:00 +0000

Update Looks to be clearing. Routes are being restored.

Packet loss has been detected on routes ingressing via GTT. We are temporarily removing london from the mix while we await GTT resolution.

[Resolved] Software Upgrades: Anycast

Mon, 17 Nov 2025 22:30:00 +0000

Update as of 11:39AM all done.

Update as of 11:15AM

All servers other than LON are complete pending final review.

Hopefully will be done before lunch.

Update as of 10:15AM

SYD, SG, LAX are complete pending final review
JP, MIA, DAL are currently in progress

Update As a reminder this is starting tomorrow at 9:30 AM AEDT. We expect it will take approximately 1 hour per server (for all 11 servers)

It is expected that maintenance will take approximately 1 hour per server. No interruption is expected however risk does exist. We will be updating a couple servers at a time.

There is the chance that we will need to do the update of some servers the following day. However the plan is to get all the servers done in one day if possible.

This is the same update that has already been performed on the budget line.

We will update this announcment when maintenance for each region is complete. Thank you for your patience.

[Resolved] Maintenance

Fri, 07 Nov 2025 00:30:00 +0000

Update complete

We will be performing upgrades of our BGP software. During this upgrade we will restart all sessions. No interruption is expected however a short routing blip is possible.

We will do PoPs in sequence

[Resolved] Reduced quality of EU routes

Wed, 27 Aug 2025 02:02:17 +0000

Update issue was found upstream and resolved. Upstream will update their internal documentation to prevent recurrance.

Update Appears to be a GTT fault. Fault ticket has been opened.

Update Investigation continues upstream. This issue only appears to affect Premium Anycast customers. Standard Anycast routes seem unaffected.

Investigating - We are investigating a potential issue that might affect the uptime of one our of services. It appears to be a bug in the upstream providers routing configuration. We are sorry for any inconvenience this may cause you. This incident post will be updated once we have more information.

[Resolved] Software Updates (Anycast)

Tue, 22 Jul 2025 23:00:00 +0000

Update Complete

We will be performing system upgrades on Wednesday. No interruption is expected.

Systems will be done in parallel in groups with an estimated total risk of interruption period per server of 30 minutes.

This is the same upgrade that was carried out on the budget line last week without interruption.

If any interruption or unexpected event occurs we will update this incident.

[Resolved] UK Migration 04/06 - 05/06

Tue, 04 Jun 2024 10:10:22 +0000

Update Routes are live. Migration is complete.

Update Server has been installed in the new DC. Just waiting on some network updates to be made before routes can be made live.

Update Server de-racking has begun. Due to the risk of reboots as fibers are moved we have decided that we will be removing routes until the hazard is cleared. Routes have already been removed in advance of our sever being de-racked.

Our server will be getting physically moved to a new datacenter between these dates. This will help us combat issues observed over the past few months including:

- Increased temperature within the cage our server is in

- Replacement of a failing switch (this has been responsible for a few 5-10s per week interruptions over the past month)

Expected interuption is likely just a couple hours, however depending on when we get scheduled we may restrict routes before / after depending on the availability of our technicians to verify / prepare. We are relying on remote hands and a significant number of servers are being moved during this time so we do not at this stage know our exact time.

We will aim to revise the scheduled time however to reduce the range closer to the event.

[Resolved] UK / LON removal (temporary)

Sat, 13 Apr 2024 12:28:14 +0000

Update** LON1 is being restored to the mix. Upstream techs have been able to repair the existing switch (replaced fan). We have monitored the switch for the past 48-hours after fan replacement and has been reliable.

“We observed that the onsite fans were ineffective, but the replacement fan we dispatched has proven successful. At present, the switch seems to be operating reliably, and we’ve been actively monitoring its performance. "

-—

We are temporarily removing LON1 from the anycast mix due to recurring issues with a failing switch.

Upstream techs have assured us the replacement switch is on its way however to prevent further short disruptions we are removing the location temporarily.

Routes to LON will be restored once the new switch is installed.

[Resolved] London Core Router Software Update

Fri, 02 Feb 2024 14:00:05 +0000

Maintenance Details:

Activity: Core Router Software Update
Impact: Temporary Service Interruptions
Duration: Up to 30 to 60 minutes
Date: Feb 03 2024
Maintenance Window: 1:00 PM GMT to 9:00 PM GMT

Details: During the specified maintenance window, our team will be performing a critical update to the Juniper code on our core router. This update is essential to enhance network performance, security, and overall stability.

Expected Impact: While we strive to minimize disruptions, it is anticipated that your services will experience interruptions during this maintenance window. The expected downtime is estimated to be within the range of 30 to 60 minutes. We understand the importance of your services and will work diligently to complete the update as quickly as possible.

Action Required: To minimize any inconvenience, we recommend scheduling critical tasks outside the maintenance window or notifying relevant parties within your organization.

[Resolved] Network Maintenance

Thu, 01 Feb 2024 08:08:16 +0000

There will be network maintenance carried out affecting US & EU PoPs of the Standard and Premium anycast networks within the next 24-hours.

Our upstream is making changes to their transit mix. We will be adjusting our network profile accordingly.

Some degree of interruption is inevatable. Please feel free to report any problematic routes if we fall behind on resolving them during the maintenance period.

[Resolved] Hazard Notice

Wed, 26 Jul 2023 03:00:00 +0000

We will be performing maintenance tomorrow. No interruption is expected however risk exists for iterruptions over this time window.

[Resolved] Premium Anycast: Lumen Transit

Tue, 04 Oct 2022 01:55:08 +0000

Update It finally happened, it was a saga, but london Lumen has finally been lit.

We are currently in the process of onboarding our new (replacement) transit provider Lumen (formerly Level3). Originally lit only for APAC and South America Lumen transit has now been lit for US and EU PoPs with one exception.

We are currently waiting on transit availability in London (Globalswitch). Due to the close pysical location and significant advantage in lighting Lumen accross EU and US at this time we have opted to proceed before London is ready.

The current ETA for London’s lumen transit is “a few weeks”.

[Resolved] Observed issues with GTT routes

Thu, 14 Oct 2021 03:23:50 +0000

We are aware of issues with GTT routes at the transit level. These occur primarily from EU<->US however some issues have been observed with other routes. We have contacted them for a comment however have not (as of yet) received one.

Observed Resolved We are not longer observing GTT related packet loss.

[Resolved] Packet Loss in London

Sun, 23 May 2021 21:17:00 +0000

Investigating - We are investigating some observed uptream packet loss in London.

Update - London network vendor has confirmed the issue

Update - We have not observed packet loss in half an hour. We await network vendor update.

Update - Confirmed fixed upstream

[Resolved] UK & Amsterdam Maintenance

Sat, 03 Apr 2021 02:00:00 +0000

We will be conducting maintenance during regional off-peak in Europe tomorrow. No interruption is expected however a low risk of packet loss or latency does exist. This is the same maintenance conducted without interuption in Miami and L.A today.

Update Maintenance is complete in both regions. Unfortunately not as smooth as yesterday with both regions experiencing short interruptions. Appologies for the inconvenience.

Everything should now be at 100%. Please feel free to contact us if you are experiencing any issues.

[Resolved] London: Hardware Crash

Sat, 27 Feb 2021 17:40:50 +0000

The filtering server in London experienced hard failure resulting in server crash. The server has rebooted and is now online.

We are investigating the cause.

[Resolved] London: Minor Maintenance

Fri, 12 Feb 2021 19:00:00 +0000

At some point between the 7AM and 9:30 AM AEDT tomorrow we will be performing minor maintenance in London. Expected interruption is 1-5 minutes as we apply changes from todays preperation session.

Update Rescheduled due to upstream scheduling conflict.

Update complete

[Resolved] UK: Hazard Warning

Wed, 10 Feb 2021 03:00:00 +0000

We will be conducting some minor maintenance in London this afternoon. No interruption is expected however as always when work is being carried out there is a small chance of issue. Due to this we are conducting this maintenance outside of UK peak hours.

Update Maintenance is proceeding well. End time has been revised to reflect some expected delays.

Update Maintenance complete. Minor interruption did occur towards the end. Procedure has been updated to prevent this in future executions of this plan.

[Resolved] London: Investigating

Tue, 05 Jan 2021 04:31:15 +0000

Investigating - We are investigating a potential issue that might affect the uptime of one our of services. As such we have pulled routes from the London region while we investigate.

Update - Attempted to restore routes however we are seeing a problem with that. Please hold while the issue is identified.

[Resolved] Packet Loss (multiple locations)

Sun, 13 Dec 2020 05:53:02 +0000

Investigating - We are investigating a potential issue that might affect the uptime of one our of services. We are sorry for any inconvenience this may cause you. This incident post will be updated once we have more information.

Cause - We are seeing intermittent issues caused by an upstream system not working as it should or being delayed in operation. We have tickets waiting response upstream.

Update 1 - We have some mitigations in place and await full diagnosis and fix upstream.

Update 2 - We continue to await confirmation of permanent fix. Tempory fix means no issues have been observed for >24-hours.

Update 3 - We continue to await confirmation of permanent fix. However as there has been no impact on customer services for days we will close this issue.