NinerNet Communications™
System Status

Server and System Status

NC031: Database overload incident

14 December 2018 05:51:47 +0000

On 13 December (UTC) the database server on server NC031 (the primary web server) failed twice, the second time resulting in our deciding to reboot the server. We believe this to be the result of a marked increase in denial of service and hacking attempts against this server over the last few days.

The database server went down at 01:55. We immediately logged into the server to determine the cause, and restarted it at 02:37. Shortly after that the problem manifested itself again, we did a full reboot of the machine at 03:03, and the server was again online and fully functional at 03:06.

The database failure resulted in database-based websites — e.g., WordPress websites — generating “error connecting to database” errors.

This issue highlights an issue on this server that we intend to address very early in the New Year, that being a necessary upgrade of our firewall system to better handle such attacks in the future.

We apologise that this issue occurred. If you have any questions, please contact NinerNet support. Thank-you.

NC031: Server back online

18 August 2018 01:28:10 +0000

Server NC031 is back online, although we are waiting for word from the data centre that the issue is definitely completely resolved.

NC031: Networking issues at data centre

18 August 2018 01:11:02 +0000

At 00:09 UTC on 18 August we became aware of a networking issue at the data centre where NC031 — the primary web server — is located. This is affecting almost all web hosting clients, including the primary NinerNet website. The web server itself is up and running, as far as we know, but the problem is that traffic to and from the data centre is down.

This issue does not affect any email services.

Data centre staff are working on restoring connectivity, and we will post an update as soon as we are aware that the web server is once gain accessible. We apologise for this issue.

NC031: Maintenance complete

3 June 2018 02:49:41 +0000

Scheduled maintenance on server NC031 is complete. The server was down between 01:54 and 02:36 UTC.

We anticipate that the intermittent back-up issue should be resolved, but we’ll be monitoring it more closely than usual for the next few days at least.

In addition to the database work, we have installed more memory and hard drive space on the server.

Thanks again for your patience.

NC031: Maintenance now

3 June 2018 01:53:28 +0000

Server NC031 is going down for scheduled maintenance shortly. This will mean that nearly all websites (including ours, excepting this status blog) will be unavailable for up to approximately one hour. (That’s a revision of our previous estimate, as we’re taking the opportunity to do some other pending maintenance at the same time.)

Thank-you for your patience.

NC031: Scheduled maintenance

2 June 2018 07:09:55 +0000

During this weekend’s maintenance window we will be taking server NC031 (the primary web server) offline for a few minutes to do some database maintenance to address the intermittent back-up issues. The server will be down for, at most, 30 minutes, between 01:00 and 02:00 UTC on Sunday 3 June 2018.

NC031: Database restarted

16 October 2017 21:30:51 +0000

The database on server NC031 was restarted at 21:25 UTC and is online and working again. We are investigating the cause of this issue.

NC031: Database issues

16 October 2017 21:03:09 +0000

We are investigating a database issue on server NC031 that is affecting database-driven websites. We will report details here.

NinerNet home page

Systems at a Glance:


Loc.SystemStatusPing
Server NC020, Chicago, United States of America, OPERATIONAL.NC020OperationalUp?
Server NC023, London, United Kingdom, OPERATIONAL.NC023OperationalUp?
Server NC028, Vancouver, Canada, INTERNAL.NC028InternalUp?
Server NC031, New York, United States of America, OPERATIONAL.NC031OperationalUp?
Server NC033, Toronto, Canada, OPERATIONAL.NC033OperationalUp?
Server NC034, Lusaka, Zambia, INTERNAL.NC034InternalUp?
Server NC035, Sydney, Australia, TESTING.NC035TestingUp?
Server NC036, Amsterdam, Netherlands, OPERATIONAL.NC036OperationalUp?
Server NC037, Seattle, United States of America, INTERNAL.NC037InternalUp?

Subscriptions:

RSS icon. RSS

Twitter icon. Twitter

General Information:

This blog provides information about the status of NinerNet Communications systems. Dates and times of posts to this blog are in the UTC time zone, and dates and times given for events are also in the UTC time zone, although conversions may be offered for some time zones common to our clients. Please use the World Time Server to ensure accurate conversion of dates and times to your own time zone.

Search:

 

Recent Posts:

Archives:

Categories:

Links

Tags:

.co.zm domains .com.zm domains .zam.co domains back-up bounce messages browser warnings configuration connection issues control panel database dns dos attack dot-zm domains down time email delivery error messages ftp hardware imap mailing lists mail relay mail server microsoft migration nameservers network networking outlook performance phplist pop power failure reboot smtp spam spamassassin ssl ssl certificate tls tls certificate viruses webmail web server wordpress

Resources:

On NinerNet: