Server and System Status

NC031: Server back online

18 August 2018 01:28:10 +0000

Server NC031 is back online, although we are waiting for word from the data centre that the issue is definitely completely resolved.

Tags: connection issues, database, network, networking, web server
Categories: Incidents, NC031
Comments Off

NC031: Networking issues at data centre

18 August 2018 01:11:02 +0000

At 00:09 UTC on 18 August we became aware of a networking issue at the data centre where NC031 — the primary web server — is located. This is affecting almost all web hosting clients, including the primary NinerNet website. The web server itself is up and running, as far as we know, but the problem is that traffic to and from the data centre is down.

This issue does not affect any email services.

Data centre staff are working on restoring connectivity, and we will post an update as soon as we are aware that the web server is once gain accessible. We apologise for this issue.

Tags: connection issues, database, network, networking, web server
Categories: Incidents, NC031
Comments Off

NC031: Data centre power failure

19 July 2018 05:09:49 +0000

At 23:04 UTC on 18 July connectivity issues were reported at the New York, US, data centre. The cause of this problem was later identified as a power outage. The data centre is currently reporting that power was restored to the data centre at 00:38 UTC on 19 July, but our own logs on the server itself indicate that it was only down between 22:55 and 23:50 UTC on 18 July. We are expecting a full report from the data centre and will post further details here when we receive that.

This affected our primary web server, hosting most clients’ websites, including our own primary website (www.niner.net).

We later soft-rebooted the server at 04:07 UTC on 19 July, and it was back online at 04:08.

This outage affected automated daily back-ups on the server. These have been restored and will run as scheduled at the next scheduled time, which is at midnight UTC on 20 July.

We apologise for this outage. The data centres we select are supposed to have redundant power systems to ensure that this kind of event never happens. However, clearly it did in this case and, as mentioned above, we are expecting a follow-up report from the data centre to explain this failure.

If you have any questions or concerns, please contact us to let us know. Thank-you, and we again apologise for this incident.

Tags: back-up, connection issues, down time, power failure, reboot, web server
Categories: Incidents, NC031
Comments Off

NC031: Maintenance complete

3 June 2018 02:49:41 +0000

Scheduled maintenance on server NC031 is complete. The server was down between 01:54 and 02:36 UTC.

We anticipate that the intermittent back-up issue should be resolved, but we’ll be monitoring it more closely than usual for the next few days at least.

In addition to the database work, we have installed more memory and hard drive space on the server.

Thanks again for your patience.

Tags: back-up, database, down time, web server
Categories: Maintenance, NC031
Comments Off

NC031: Maintenance now

3 June 2018 01:53:28 +0000

Server NC031 is going down for scheduled maintenance shortly. This will mean that nearly all websites (including ours, excepting this status blog) will be unavailable for up to approximately one hour. (That’s a revision of our previous estimate, as we’re taking the opportunity to do some other pending maintenance at the same time.)

Thank-you for your patience.

Tags: back-up, database, down time, web server
Categories: Maintenance, NC031
Comments Off

NC031: Scheduled maintenance

2 June 2018 07:09:55 +0000

During this weekend’s maintenance window we will be taking server NC031 (the primary web server) offline for a few minutes to do some database maintenance to address the intermittent back-up issues. The server will be down for, at most, 30 minutes, between 01:00 and 02:00 UTC on Sunday 3 June 2018.

Tags: back-up, database, down time, web server
Categories: Maintenance, NC031
Comments Off

NC031: Reboot

1 June 2018 04:59:41 +0000

As we work on diagnosing the back-up issue, server NC031 was rebooted at 04:24 UTC. It was back online at 04:25.

Tags: back-up, reboot, web server
Categories: Incidents, NC031
Comments Off

NC031: Intermittent back-up issues

30 May 2018 11:33:20 +0000

A few scheduled back-ups have been failing over the last ten days or so on NC031 (the web server). We have brought this issue to the attention of the control panel developers, and we are working with them to resolve the issue.

In the meantime, only a small number of back-ups have been failing, not all of them. However, if you are concerned, please contact support and we will look at if or how your domain is affected. Thank-you.

Tags: back-up, web server
Categories: Incidents, NC031
3 Comments »

NC031: Maintenance complete

2 May 2018 06:08:55 +0000

Server NC031 was down between 05:03 and 05:17 UTC while a patch for the Spectre vulnerability was applied.

Tags: down time, hardware, reboot, web server
Categories: Maintenance, NC031
Comments Off

NC023, NC027 and NC031: Spectre maintenance

25 April 2018 11:41:21 +0000

Per our previous blog post, three of our servers will be updated to address variants 1 and 2 of the Spectre vulnerability per the following schedule (start times) in chronological order:

NC027: 23:00 UTC on Tuesday 1 May 2018 (DONE)
NC031: 05:00 UTC on Wednesday 2 May 2018
NC023: 20:00 UTC on Wednesday 2 May 2018

As with the previous upgrades for the Meltdown vulnerability, the maintenance windows for each are two hours long, but we expect that each server will be down for much less than that. During the Meltdown maintenance the servers were down for between 13 and 19 minutes, and we expect much the same this time around.

Please click the links above to determine when this will be in your time zone.

During the maintenance of servers NC023 and NC027 you will not be able to send or receive email. Incoming email to your domain will be held on the sending servers until our mail server is back online, and will then be delivered to your accounts. No email will be lost. Please note that email to NinerNet will also be down during the maintenance on server NC027.

During the maintenance of server NC031 your website will be inaccessible, both to you and the public.

Tags: down time, email delivery, hardware, mail relay, reboot, smtp, web server
Categories: Maintenance, NC023, NC027, NC031
2 Comments »

System	Status	Ping
NC023	Internal	Up?
NC028	Internal	Up?
NC031	Internal	Up?
NC033	Operational	Up?
NC034	Internal	Up?
NC035	Operational	Up?
NC036	Operational	Up?
NC040	Internal	Up?
NC041	Operational	Up?
NC042	Operational	Up?