NinerNet Communications™
System Status

Server and System Status

NC031: Maintenance now

3 June 2018 01:53:28 +0000

Server NC031 is going down for scheduled maintenance shortly. This will mean that nearly all websites (including ours, excepting this status blog) will be unavailable for up to approximately one hour. (That’s a revision of our previous estimate, as we’re taking the opportunity to do some other pending maintenance at the same time.)

Thank-you for your patience.

NC031: Scheduled maintenance

2 June 2018 07:09:55 +0000

During this weekend’s maintenance window we will be taking server NC031 (the primary web server) offline for a few minutes to do some database maintenance to address the intermittent back-up issues. The server will be down for, at most, 30 minutes, between 01:00 and 02:00 UTC on Sunday 3 June 2018.

NC020: Reboot

2 June 2018 07:02:10 +0000

Server NC020 was rebooted at 06:19 UTC, and was back online again at 06:22.

NC031: Reboot

1 June 2018 04:59:41 +0000

As we work on diagnosing the back-up issue, server NC031 was rebooted at 04:24 UTC. It was back online at 04:25.

NC031: Intermittent back-up issues

30 May 2018 11:33:20 +0000

A few scheduled back-ups have been failing over the last ten days or so on NC031 (the web server). We have brought this issue to the attention of the control panel developers, and we are working with them to resolve the issue.

In the meantime, only a small number of back-ups have been failing, not all of them. However, if you are concerned, please contact support and we will look at if or how your domain is affected. Thank-you.

NC027: Migration update 3 — postponed again

21 May 2018 01:19:39 +0000

We have, unfortunately, decided to postpone this migration yet again. For this we sincerely apologise.

The good news is that both of the issues identified last weekend were resolved. The bad news is that, while this migration will be quicker (once it gets going) with fewer complications than past migrations because of the fact that the new mail server runs newer versions of the same software, doing the migration this way actually introduces it’s own quirks and set of challenges. We really hope to address those over the coming week.

In the meantime, your email is operating as normal.

If you have any questions or concerns, please do let us know. Thank-you again for your patience.

NC027: Migration update 2 — postponed

13 May 2018 11:03:30 +0000

We have decided to postpone the migration of server NC027 to NC036 until our regular maintenance window next weekend, 19:00 UTC Saturday (19 May) to 19:00 UTC Sunday. Of course, the move won’t take 24 hours, but that is the full length of the weekend maintenance window. Through testing of the migration process a few times on a test server and optimising the process of getting millions of email messages safely from one server to another, intact — this much data required a re-evaluation of our normal procedures — we have managed to shave at least six hours off of the planned migration time.

We therefore estimate that the migration will take about four hours.

There are a couple of reasons for the delay:

  • One thing we haven’t got working properly yet is an anti-spam feature known as DKIM (DomainKeys Identified Mail). Because this technique involves use of the DNS (domain name system), it takes time for the authentication information published in the DNS to propagate, and if the wrong information is present (as is currently the case) all of your outbound email will be stopped in its tracks. This is, shall we say, undesirable.
  • Secondly, we have found out that the IP address of the new mail server is in the blacklist of a major email provider. Good thing we checked before going live! We’re at the mercy of said big corporation as far as the timing of the removal, and it’s optimistic to think that it will be removed in the next few hours. However, it’s reasonable to assume that they will remove the block of our new IP address, and that they will do so by next weekend.

For now, everything stays and keeps working exactly the same. Do not adjust your television sets … or your email programs, for that matter.

Having worked with the new mail system all week, we are pretty excited about getting it online due to some new features and some excellent spam-fighting tools. We know you’ll love it too; thanks for your patience.

NC027: Migration update 1

12 May 2018 12:47:05 +0000

The migration later today of all mail from server NC027 to NC036 should take at least six hours, possibly more. For this reason we will try to start it a bit later than previously stated.

NC020: Reboot

8 May 2018 00:38:35 +0000

Due to an issue with the FTP server on NC020 we rebooted it at 00:27 UTC. It was back online at 00:28.

NC027: Migration of mail server

4 May 2018 17:17:14 +0000

Server NC027 is being replaced by new mail server NC036. We will be migrating all email accounts to the new server during our regular weekly maintenance window next weekend, starting at 21:00 UTC on Saturday 12 May 2018.

We will be conducting tests over the next week to determine how long this should take, and will post an update here by the middle of next week with an estimate for how long your mail will be unavailable. Because this is a migration between servers running the same software, it’s much more straightforward that most migrations and should take less time than usual. Additionally, the configuration settings for your email will not change, making the process much smoother.

As mentioned last week, this is part of a two-phase plan — this is phase two — to significantly reduce downtime during migrations. Future migrations should be done in almost minutes rather than hours.

If you have any questions or concerns, please feel free to contact support. Thank-you for your patience.

NinerNet home page

Systems at a Glance:


Loc.SystemStatusPing
Server NC023, London, United Kingdom (Relay server), INTERNAL.NC023InternalUp?
Server NC028, Vancouver, Canada (Monitoring server), INTERNAL.NC028InternalUp?
Server NC031, New York, United States of America (Web server), INTERNAL.NC031InternalUp?
Server NC033, Toronto, Canada (Primary nameserver), OPERATIONAL.NC033OperationalUp?
Server NC034, Lusaka, Zambia (Phone server), INTERNAL.NC034InternalUp?
Server NC035, Sydney, Australia (Secondary nameserver), OPERATIONAL.NC035OperationalUp?
Server NC036, Amsterdam, Netherlands (Mail server), OPERATIONAL.NC036OperationalUp?
Server NC040, Toronto, Canada (Web server), INTERNAL.NC040InternalUp?
Server NC041, New York, United States of America (Web server), OPERATIONAL.NC041OperationalUp?
Server NC042, Seattle, United States of America (Status website), OPERATIONAL.NC042OperationalUp?

Subscriptions:

RSS icon. RSS

Twitter icon. Twitter

Search:

 

Recent Posts:

Archives:

Categories:

Links

Tags:

.co.zm domains .com.zm domains .zam.co domains back-up bounce messages browser warnings connection issues control panel database dns dos attack dot-zm domains down time email email delivery error messages ftp hardware imap mail mailing lists mail relay mail server microsoft migration nameservers network networking performance php phplist pop reboot shaw shaw communications inc. smtp spam spamassassin ssl ssl certificate tls tls certificate viruses webmail web server

Resources:

On NinerNet: