NinerNet Communications™
System Status

Server and System Status

NC020 outage report

25 August 2014 00:05:53 +0000

The problem with server NC020 actually started before the outage on Friday, about midday UTC. A client’s website was compromised, and the cracker downloaded scripts to cause the sending of spam. This took place over the course of a day or so, and eventually the spammer consumed all of the resources of the server. Although the server was still up, it was unresponsive.

Most websites are authorised to use the mail server on a hosting server, so we can’t block that ability completely. However, we will make a concerted effort to improve the monitoring of abuse (intended by the client or not) of this function.

In this case, we cleaned up all of the generated spam, removed the offending scripts, and will work with the client on the issues with their website security.

For the record, there are two levels of compromises: at the root level or the user level. At the root level is very bad, and requires a brand new server to be provisioned. This was a user-level compromise which, while bad, is easier to fix and recover from.

We again apologise for the downtime. We will be contacting and crediting affected accounts. We are always working to prevent security issues like this, but it’s an ongoing task. Thank-you for your patience and continued business. If you have any questions, please feel free to contact support.

NC020 back online

23 August 2014 10:22:32 +0000

Server NC020 experienced a significant outage over Friday and Saturday. The problem has been resolved and the server and all websites on it are back online.

We sincerely apologise for the problems caused by this outage to some website owners. We will provide a full report on what happened, when, and why by 01:00 UTC on Monday, 25 August.

NinerNet SSL certificate fully installed

21 July 2014 12:10:11 +0000

We have solved the issue with the new NinerNet SSL certificate not fully propagating to all servers. All SSL web and email connections should now be using the new SSL certificate, which expires in 2015.

If you are having any issues, please restart your computer to ensure that all software on the computer uses the new SSL certificate. If you still have problems, please contact NinerNet support with a full description of the error message you are seeing.

Thank-you for your patience.

NinerNet SSL certificate

21 July 2014 07:41:35 +0000

We are aware that the new NinerNet SSL certificate has not properly propagated to all servers. We are working to fix this and will post an update here as soon as we believe the issue has been resolved.

In the meantime it is usually possible to override any warnings and continue with whatever you are doing.

Server NC020 maintenance complete

29 September 2012 22:50:09 +0000

Maintenance to upgrade server NC020 was successfully completed at 20:51 UTC. The server was down for a total of four minutes during two reboots between 20:27 and 20:30, and 20:50 and 20:51.

If you have any questions or concerns, please contact NinerNet support. Thanks.

Server NC020 maintenance

28 September 2012 17:36:34 +0000

We will be performing maintenance on server NC020 during our normal weekend maintenance window this weekend to increase its capacity. This window opens at 19:00 UTC on Saturday, 29 September. (Please see theĀ World Time Server to convert this to your time zone.)

We expect fewer than five minutes of downtime during this window, and this should occur between 19:00 and 20:00 UTC. However, we expect it is most likely happen within a few minutes after 19:00.

Server NC020 is more commonly known as the PHP 5 server, and for the most part runs websites (WordPress, Joomla, etc.) that require PHP 5. It also processes mail for parked and aliased domains. No email will be lost during the maintenance, but it may be delayed for a few minutes.

If you have any questions or concerns about this maintenance, pleaseĀ contact NinerNet support. Thank-you.

Connectivity issues from Vancouver

30 September 2011 11:43:40 +0000

For a couple of hours early in the morning (Pacific time) today, server NC020 was inaccessible from Vancouver. (This also applied to some of our clients with virtual private servers in the same data centre.) Through monitoring tools and other techniques we were able to determine that the server was indeed up and fully operational, so we can only conclude that there must have been some connectivity issue in the Vancouver area that affected all or most ISPs.

Ping results for server NC020, 2011-09-30.

Ping results for server NC020, 2011-09-30.

Problem with server NC020

30 August 2011 19:46:08 +0000

Server NC020 was down within the last couple of hours and was rebooted as a result. We’re investigating both the duration and cause right now, and will post further updates here.

Server NC020 rebooted

17 May 2011 14:24:16 +0000

We have rebooted server NC020 and everything is fine now. We suspect one of the websites hosted on this server received a lot of traffic within the last hour or so — more than the server could handle. We’re still looking at all of the logs and will determine whether or not that was the case and post more here when we have all of the information.

Server NC020 overloaded

17 May 2011 14:01:19 +0000

Server NC020 is overloaded and responding very slowly. We have our suspicions as to why, and are looking into the issue. We will post updates here.

NinerNet home page

Systems at a Glance:


Loc.SystemStatusPing
Server NC023, London, United Kingdom (Relay server), INTERNAL.NC023InternalUp?
Server NC028, Vancouver, Canada (Monitoring server), INTERNAL.NC028InternalUp?
Server NC031, New York, United States of America (Web server), INTERNAL.NC031InternalUp?
Server NC033, Toronto, Canada (Primary nameserver), OPERATIONAL.NC033OperationalUp?
Server NC034, Lusaka, Zambia (Phone server), INTERNAL.NC034InternalUp?
Server NC035, Sydney, Australia (Secondary nameserver), OPERATIONAL.NC035OperationalUp?
Server NC036, Amsterdam, Netherlands (Mail server), OPERATIONAL.NC036OperationalUp?
Server NC040, Toronto, Canada (Web server), INTERNAL.NC040InternalUp?
Server NC041, New York, United States of America (Web server), OPERATIONAL.NC041OperationalUp?
Server NC042, Seattle, United States of America (Status website), OPERATIONAL.NC042OperationalUp?

Subscriptions:

RSS icon. RSS

Twitter icon. Twitter

Search:

 

Recent Posts:

Archives:

Categories:

Links

Tags:

.co.zm domains .com.zm domains .zam.co domains back-up bounce messages browser warnings connection issues control panel database dns dos attack dot-zm domains down time email email delivery error messages ftp hardware imap mail mailing lists mail relay mail server microsoft migration nameservers network networking performance php phplist pop reboot shaw shaw communications inc. smtp spam spamassassin ssl ssl certificate tls tls certificate viruses webmail web server

Resources:

On NinerNet: