Tamaki Data Centre is overheating, all nodes potentially being shutdown
Identified - Tamaki Data Centre has identified issues affecting two of the site's three chillers, resulting in reduced cooling capacity.
Teams are actively investigating the root cause and monitoring site temperatures and cooling performance. Our priority is the safe restoration of cooling services and maintaining the integrity of the platform.
Once temperatures have stabilised and cooling capacity has been validated, we will commence our recovery and startup plan. Further updates will be provided as the investigation progresses, this will likely be from tomorrow morning
Jul 29, 2026 - 17:22 NZST
Update - We are continuing to investigate this issue.
Jul 29, 2026 - 17:02 NZST
Update - Cooling at the Tamaki Data Centre has not yet been restored. All services and hardware remains down. We currently don't have any ETA.
Jul 29, 2026 - 16:24 NZST
Update - Contractors are onsite at the TDC but have not yet confirmed the chiller issue
Jul 29, 2026 - 15:21 NZST
Update - The data centre has chiller issues - Tamaki Data Centre (TDC) and all nodes are in danger of overheating. Consequently all nodes are being shutdown to protect the hardware
Jul 29, 2026 - 14:59 NZST
Investigating - We are currently investigating this issue.
Jul 29, 2026 - 14:57 NZST

About This Site

Bioeconomy Science Institute - AgResearch eRI status

Uptime over the past 90 days. View historical uptime.
Identity Broker Service Operational
90 days ago
100.0 % uptime
Today
Managed Storage Service Major Outage
90 days ago
99.32 % uptime
Today
General Flexi HPC Platform Operational
90 days ago
100.0 % uptime
Today
Network connectivity Operational
90 days ago
100.0 % uptime
Today
Compute cluster Major Outage
90 days ago
99.3 % uptime
Today
Login nodes Major Outage
90 days ago
99.32 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Jul 30, 2026

No incidents reported today.

Jul 29, 2026

Restart NFS and SMB services, all access to M: and S: drives will be disrupted
Completed - Maintenance cancelled due to data centre issues
Jul 29, 17:01 NZST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 29, 17:00 NZST
Update - This maintenance is cancelled due to the TDC outage. File locks should be released anyway once we have recovered
Jul 29, 15:57 NZST
Scheduled - We will be clearing the current locked files on Wednesday July 29th at 1700hrs. All access to the M: and S: drives from Windows systems will be disrupted for a short time.
Jul 29, 11:35 NZST
Hypervisor a01co02 maintenance 29 July 2026 from 9AM-3PM.
Completed - The scheduled maintenance has been completed.
Jul 29, 15:00 NZST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 29, 09:00 NZST
Scheduled - Description: Hypervisor a01co02 will undergo maintenance to apply OS, firmware and OpenStack configuration updates.

Why: Ensure server and OS stability, security and up to date configuration is applied.

Impact: node will be unusable for 4-6 hours

Running VMs will be live-migrated off this host and there should be no noticeable impact.
Jul 28, 16:15 NZST

Jul 28, 2026

No incidents reported.

Jul 27, 2026

No incidents reported.

Jul 26, 2026

No incidents reported.

Jul 25, 2026

No incidents reported.

Jul 24, 2026

No incidents reported.

Jul 23, 2026

No incidents reported.

Jul 22, 2026

Restart NFS and SMB services, all access to M: and S: drives will be disrupted
Completed - The scheduled maintenance has been completed.
Jul 22, 10:11 NZST
Verifying - The SMB and NFS services have been restarted, all file locks have been cleared. Access to the M: and S: drives is now available
Jul 20, 17:09 NZST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jul 20, 17:00 NZST
Scheduled - We will be clearing the current locked files on Monday July 6th at 1700hrs. All access to the M: and S: drives from Windows systems will be disrupted for a short time.
Jul 17, 16:53 NZST

Jul 21, 2026

No incidents reported.

Jul 20, 2026

Jul 19, 2026

No incidents reported.

Jul 18, 2026

No incidents reported.

Jul 17, 2026

No incidents reported.

Jul 16, 2026

Compute node critical f/w upgrades
Completed - This maintenance is now postponed. There are a number of pending kernel patches to address the recent spate of security CVEs. In an effort to reduce disruption we will combine the f/w upgrades and the kernel patching into one maintenance window, per node.
We will post the new schedule when all the patches are available and appropriate testing has been completed.
Jul 16, 09:45 NZST
Scheduled - We will be applying critical firmware upgrades to the Slurm compute nodes over the next two to three weeks. These will be done in a rolling fashion, one node at a time, so the cluster will remain available throughout. Slurm reservations will be applied per node to ensure they become available in a reasonable timeframe. Running jobs will not be affected.
Jul 15, 14:57 NZST
← Incident History Powered by Atlassian Statuspage