NinerNet Communications™
System Status

Server and System Status

NC041: Web server rebooted

19 June 2023 18:53:54 +0000

Server NC041 has been rebooted. This appears to have dealt with the database server issue. We will continue to look for the root cause to ensure this doesn’t happen again.

NC041: Web server having some database issues

19 June 2023 17:35:03 +0000

The database server on server NC041 appears to be having some issues. We are looking into it and will post an update about what we find shortly.

NC031: Web server downtime

14 March 2019 21:34:49 +0000

The database on our primary web server (NC031) went down at 20:20 UTC, and was not brought back up until 21:00 UTC. This means that all database-driven websites were down during this 40-minute period, and would have displayed the message, “Error establishing a database connection”. We are still trying to determine why this happened and why the service was not automatically restarted, as should have been the case. Coincidentally — or perhaps not — at the same time the server was under a heavy load from hundred of thousands of requests on a single website, and we have now blocked the source of that traffic.

We sincerely apologise for this inconvenience. If you have any questions, please do contact support.

NC031: Database overload incident

14 December 2018 05:51:47 +0000

On 13 December (UTC) the database server on server NC031 (the primary web server) failed twice, the second time resulting in our deciding to reboot the server. We believe this to be the result of a marked increase in denial of service and hacking attempts against this server over the last few days.

The database server went down at 01:55. We immediately logged into the server to determine the cause, and restarted it at 02:37. Shortly after that the problem manifested itself again, we did a full reboot of the machine at 03:03, and the server was again online and fully functional at 03:06.

The database failure resulted in database-based websites — e.g., WordPress websites — generating “error connecting to database” errors.

This issue highlights an issue on this server that we intend to address very early in the New Year, that being a necessary upgrade of our firewall system to better handle such attacks in the future.

We apologise that this issue occurred. If you have any questions, please contact NinerNet support. Thank-you.

NC031: Server back online

18 August 2018 01:28:10 +0000

Server NC031 is back online, although we are waiting for word from the data centre that the issue is definitely completely resolved.

NC031: Networking issues at data centre

18 August 2018 01:11:02 +0000

At 00:09 UTC on 18 August we became aware of a networking issue at the data centre where NC031 — the primary web server — is located. This is affecting almost all web hosting clients, including the primary NinerNet website. The web server itself is up and running, as far as we know, but the problem is that traffic to and from the data centre is down.

This issue does not affect any email services.

Data centre staff are working on restoring connectivity, and we will post an update as soon as we are aware that the web server is once gain accessible. We apologise for this issue.

NC031: Maintenance complete

3 June 2018 02:49:41 +0000

Scheduled maintenance on server NC031 is complete. The server was down between 01:54 and 02:36 UTC.

We anticipate that the intermittent back-up issue should be resolved, but we’ll be monitoring it more closely than usual for the next few days at least.

In addition to the database work, we have installed more memory and hard drive space on the server.

Thanks again for your patience.

NC031: Maintenance now

3 June 2018 01:53:28 +0000

Server NC031 is going down for scheduled maintenance shortly. This will mean that nearly all websites (including ours, excepting this status blog) will be unavailable for up to approximately one hour. (That’s a revision of our previous estimate, as we’re taking the opportunity to do some other pending maintenance at the same time.)

Thank-you for your patience.

NC031: Scheduled maintenance

2 June 2018 07:09:55 +0000

During this weekend’s maintenance window we will be taking server NC031 (the primary web server) offline for a few minutes to do some database maintenance to address the intermittent back-up issues. The server will be down for, at most, 30 minutes, between 01:00 and 02:00 UTC on Sunday 3 June 2018.

NC031: Database restarted

16 October 2017 21:30:51 +0000

The database on server NC031 was restarted at 21:25 UTC and is online and working again. We are investigating the cause of this issue.

NinerNet home page

Systems at a Glance:


Loc.SystemStatusPing
Server NC023, London, United Kingdom (Relay server), INTERNAL.NC023InternalUp?
Server NC028, Vancouver, Canada (Monitoring server), INTERNAL.NC028InternalUp?
Server NC031, New York, United States of America (Web server), INTERNAL.NC031InternalUp?
Server NC033, Toronto, Canada (Primary nameserver), OPERATIONAL.NC033OperationalUp?
Server NC034, Lusaka, Zambia (Phone server), INTERNAL.NC034InternalUp?
Server NC035, Sydney, Australia (Secondary nameserver), OPERATIONAL.NC035OperationalUp?
Server NC036, Amsterdam, Netherlands (Mail server), OPERATIONAL.NC036OperationalUp?
Server NC040, Toronto, Canada (Web server), INTERNAL.NC040InternalUp?
Server NC041, New York, United States of America (Web server), OPERATIONAL.NC041OperationalUp?
Server NC042, Seattle, United States of America (Status website), OPERATIONAL.NC042OperationalUp?

Subscriptions:

RSS icon. RSS

Twitter icon. Twitter

Search:

 

Recent Posts:

Archives:

Categories:

Links

Tags:

.co.zm domains .com.zm domains .zam.co domains back-up bounce messages browser warnings connection issues control panel database dns dos attack dot-zm domains down time email email delivery error messages ftp hardware imap mail mailing lists mail relay mail server microsoft migration nameservers network networking performance php phplist pop reboot shaw shaw communications inc. smtp spam spamassassin ssl ssl certificate tls tls certificate viruses webmail web server

Resources:

On NinerNet: