NinerNet Communications™
System Status

Server and System Status

Capacity issues on server NC031

7 April 2016 07:42:20 +0000

We are experiencing problems with server NC031. These are caused by a very busy website that we transferred to this server about 48 hours ago.

We are assessing the situation and will post updates here. We apologise for the problem.

London network restored

27 December 2015 10:17:45 +0000

The data centre informs us that connectivity on their network was restored at 09:24 UTC.

We have been able to confirm this by accessing all of our servers in this data centre:

  • Incoming mail is once again being processed immediately by server NC027, although any incoming mail sent during the disruption may be delayed a little longer until the sending mail servers try again. This is not under our control.
  • Server NC023 is also processing email immediately.

We apologise for this interruption. Denial of service attacks (especially distributed denial of service attacks) are extremely difficult and expensive to fight. We have confidence that the data centre did everything they could as quickly as they could to combat this attack.

London data centre DDoS update

27 December 2015 08:30:17 +0000

We have been updated that the denial of service attack against the London data centre is actually a large distributed denial of service (DDoS) attack, and it is still underway. Efforts are being made at multiple levels on the network to combat this attack, and we are seeing some movement of email through server NC027, although it took an hour and forty-seven minutes for a test message to get through. This indicates, as mentioned earlier, that the server is up and processing email, but that other servers (and our clients, obviously) are having problems connecting to the server.

We apologise for these problems, but this is affecting a wide range and large number of companies hosted at this data centre, not just NinerNet.

Updates will continue to be posted here as we learn more.

Connectivity issue at London data centre

27 December 2015 06:52:18 +0000

The London data centre has been suffering from the effects of a couple of denial of service (DoS) attacks over the last 12 or so hours. The attack late yesterday (26 December) lasted about an hour and a half. Today’s attack started at 05:37 UTC and is currently ongoing. The data centre staff assure us that they have identified the problem and are implementing a fix for it.

This affects server NC023 (the relay server) and server NC027 (the main mail server), as well as virtual private servers hosted in London. As far as we know, the servers themselves are up and connected to the network, but the attack is causing them to be inaccessible.

We’ll update here as soon as we know more.

NC020: Earlier server reboot

21 November 2015 02:16:43 +0000

We have determined from monitoring logs that server NC020 was only offline for a few minutes, and was rebooted at 09:46 UTC on 20 November within a few minutes of the problem being discovered.

We apologise to those few clients still using server NC020 who may have been inconvenienced at that time.

If you have any questions about this, please let us know. Thanks.

NC020: Server rebooted

20 November 2015 10:07:39 +0000

We have rebooted server NC020 after it was overwhelmed. We’re looking into it right now and will post details here as soon as we have them.

NC027: Mail server queue clearing

2 November 2015 10:05:03 +0000

A configuration change on server NC027 (the mail server) over the weekend to once again introduce virus scanning has, as on previous occasions, overloaded the server. We made this change over the weekend after earlier doubling the capacity of the server and making other changes recently that should have seen a significant increase in server performance. Indeed, testing over the weekend showed a significant improvement over previous attempts to introduce virus scanning.

The result of this is that incoming emails have been delayed this morning, including messages between accounts on the same server. Therefore we have again reversed this configuration change and the mail queue has begun clearing. We hope that it will be clear within the next hour.

We apologise for this inconvenience.

NC027: Access issue update

18 September 2015 19:43:54 +0000

After spending some time on this issue yesterday and today — and receiving a complaint from only one client who later informed us that the issue no longer existed — we’re closing this matter and considering it a transient network issue, probably closer to the client’s ISP than to server NC027.

Apologies for the false alarm, but we do take your complaints seriously.

If you have any questions or concerns, please let us know by contacting NinerNet support. Thank-you.

NC027: Access issues

17 September 2015 20:49:50 +0000

We are aware of an issue with server NC027, where most client email is hosted. However, we have not yet determined exactly what the problem is. Some services on the server are accessible, while some are not.

We are currently working with the data centre to determine the issue, and will post further updates here.

NC020: Credits for outage

11 September 2015 19:16:40 +0000

Further to our previous posts, we will be processing credits to the accounts of all affected clients for the outage on NC020.

NinerNet home page

Systems at a Glance:


Loc.SystemStatusPing
Server NC023, London, United Kingdom (Relay server), INTERNAL.NC023InternalUp?
Server NC028, Vancouver, Canada (Monitoring server), INTERNAL.NC028InternalUp?
Server NC031, New York, United States of America (Web server), INTERNAL.NC031InternalUp?
Server NC033, Toronto, Canada (Primary nameserver), OPERATIONAL.NC033OperationalUp?
Server NC034, Lusaka, Zambia (Phone server), INTERNAL.NC034InternalUp?
Server NC035, Sydney, Australia (Secondary nameserver), OPERATIONAL.NC035OperationalUp?
Server NC036, Amsterdam, Netherlands (Mail server), OPERATIONAL.NC036OperationalUp?
Server NC040, Toronto, Canada (Web server), INTERNAL.NC040InternalUp?
Server NC041, New York, United States of America (Web server), OPERATIONAL.NC041OperationalUp?
Server NC042, Seattle, United States of America (Status website), OPERATIONAL.NC042OperationalUp?

Subscriptions:

RSS icon. RSS

Twitter icon. Twitter

Search:

 

Recent Posts:

Archives:

Categories:

Links

Tags:

.co.zm domains .com.zm domains .zam.co domains back-up bounce messages browser warnings connection issues control panel database dns dos attack dot-zm domains down time email email delivery error messages ftp hardware imap mail mailing lists mail relay mail server microsoft migration nameservers network networking performance php phplist pop reboot shaw shaw communications inc. smtp spam spamassassin ssl ssl certificate tls tls certificate viruses webmail web server

Resources:

On NinerNet: