NinerNet Communications™
System Status

Server and System Status

NC018 web server stopped

24 August 2013 07:24:12 +0000

We have temporarily stopped the NC018 web server in an attempt to fight this attack.

Server NC018 under attack again

24 August 2013 07:08:51 +0000

As the title says, it appears that server NC018 is again the target of an attack. We are working to address the issue as quickly as possible.

Server NC018 denial of service attack

23 August 2013 20:55:10 +0000

Server NC018 suffered a denial of service attack beginning at approximately 07:40 on 23 August, UTC. This continued until the server succumbed under the load at about 12:40. This affected all functions of the server: websites, sending and receiving emails, databases, etc.

Unfortunately we did not respond to this situation in a timely manner. This was partially because automated monitoring of server functions had been turned off due to an increasing number of false alarms from the system.

Once the server was rebooted at 13:47 and the attack mitigated, the server then still had a backlog of several thousand emails to process. This took several hours, with the queue being cleared by about 18:35. While emails were “missing” for several hours, no emails should have been lost; they were just delivered several hours late.

We sincerely apologise for the disruption caused by this event. We will reinstate monitoring and the associated actions that are taken when monitoring alarms go off.

We will shortly be responding to all emails and phone messages regarding this incident. If you have any further questions about this event, please contact us.

Server NC023 maintenance complete

4 May 2013 19:38:02 +0000

Server NC023 went down for maintenance at 19:22 UTC and was back online at 19:32 after successful completion of its maintenance.

Thanks for your patience.

Server NC023 maintenance

3 May 2013 06:37:17 +0000

We will be performing maintenance on server NC023 (commonly known as the relay server) on Saturday, 4 May at 19:00 UTC. This maintenance will take approximately 10-15 minutes, during which time the server will not be accessible.

Server NC023 maintenance completed

14 April 2013 08:11:59 +0000

The maintenance on server NC023 took place between 07:08 and 07:14 UTC, and was completed successfully.

Server NC023 down for maintenance

14 April 2013 07:13:41 +0000

Server NC023 (more commonly known as the relay server) is currently undergoing an upgrade, and will be back up again by approximately 07:25 UTC.

Update on server NC018

19 March 2013 12:58:28 +0000

As we informed you on 6 March, we had intended to increase the memory (RAM) on server NC018 on 9 March. (Server NC018 hosts the majority of websites, and all email except specialised email services.) This maintenance would have solved performance issues that were happening with more regularity. However, the maintenance failed due to hardware compatibility issues.

When the maintenance failed, we immediately began preparing to acquire new hardware to replace this server. During the week of 11-15 March we obtained a number of proposals and advice on a plan we had begun developing some months ago.

However, on 18 March the mail server was overwhelmed. The most obvious result of this was that email delivery was delayed during peak periods by as many as several hours. While it was not clear exactly why the mail server was overwhelmed, there was an obvious way to deal with the problem. We implemented this, and the mail queue was cleared in a short amount of time. We believed that this approach should have worked to prevent the mail server from being overwhelmed if the mail server again experienced heavy volume, but it did not when the same thing happened on 19 March.

We are therefore urgently preparing to set up new hardware. I don’t have an exact time line for you at the moment, but it is our goal to have the hardware in place and online by the weekend, and we will endeavour to transfer everything as quickly as we can over the weekend.

We will update you on major events by email, but please check our status page once or twice a day at status.niner.net or status.ninernet.net for progress reports.

We apologise for the inconvenience that this transition is causing, and ask for your patience as we go through this upgrade.

Web server on NC018 back online

19 March 2013 12:25:06 +0000

We have cleared the mail queue on server NC018, and the web server has been brought back online.

Web server on NC018 currently shut down

19 March 2013 11:54:00 +0000

We have shut down the web server on server NC018 temporarily in order to facilitate the processing of email on the same physical machine. We will restore web hosting as soon as the emails have been processed.

We apologise for the inconvenience.

NinerNet home page

Systems at a Glance:


Loc.SystemStatusPing
Server NC023, London, United Kingdom (Relay server), INTERNAL.NC023InternalUp?
Server NC028, Vancouver, Canada (Monitoring server), INTERNAL.NC028InternalUp?
Server NC031, New York, United States of America (Web server), INTERNAL.NC031InternalUp?
Server NC033, Toronto, Canada (Primary nameserver), OPERATIONAL.NC033OperationalUp?
Server NC034, Lusaka, Zambia (Phone server), INTERNAL.NC034InternalUp?
Server NC035, Sydney, Australia (Secondary nameserver), OPERATIONAL.NC035OperationalUp?
Server NC036, Amsterdam, Netherlands (Mail server), OPERATIONAL.NC036OperationalUp?
Server NC040, Toronto, Canada (Web server), INTERNAL.NC040InternalUp?
Server NC041, New York, United States of America (Web server), OPERATIONAL.NC041OperationalUp?
Server NC042, Seattle, United States of America (Status website), OPERATIONAL.NC042OperationalUp?

Subscriptions:

RSS icon. RSS

Twitter icon. Twitter

Search:

 

Recent Posts:

Archives:

Categories:

Links

Tags:

.co.zm domains .com.zm domains .zam.co domains back-up bounce messages browser warnings connection issues control panel database dns dos attack dot-zm domains down time email email delivery error messages ftp hardware imap mail mailing lists mail relay mail server microsoft migration nameservers network networking performance php phplist pop reboot shaw shaw communications inc. smtp spam spamassassin ssl ssl certificate tls tls certificate viruses webmail web server

Resources:

On NinerNet: