NinerNet Communications™
System Status

Server and System Status

NC023: Emergency maintenance complete

22 October 2015 21:20:45 +0000

The emergency maintenance on server NC023 started at precisely 20:00 UTC and was completed successfully by 20:23 UTC.

There is actually a third server that needs the same work as the two that have already been attended to. We will post our plan for that later today.

NC027: Emergency maintenance complete

21 October 2015 02:35:50 +0000

The emergency maintenance on server NC027 started at 01:16 UTC and was completed successfully at 02:14 UTC.

Our apologies for the early start! We miscalculated the time zone difference and unintentionally started the maintenance before we should have.

We have run some tests and everything appears to be operating normally. If you have any questions or concerns, please let us know.

Please note that the maintenance on server NC023 is still to be done tomorrow (22 October) at 20:00 UTC.

Thank-you for your patience.

NC027: Maintenance underway

21 October 2015 01:18:51 +0000

The emergency maintenance on server NC027 has started. All services on this server will be unavailable for the duration of the work.

We will post progress updates here. Thank-you for your patience.

Upcoming emergency server maintenance

19 October 2015 13:04:30 +0000

We have scheduled emergency maintenance this week for two of our servers to address a yet-to-be-published security vulnerability in the underlying virtualisation software these servers use.

The schedule is as follows:

Please click on the dates and times to convert the time of the maintenance into your local time zone. Server NC023 is commonly referred to by those that use it as the “relay server”, and server NC027 is our primary mail server.

The maintenance window will be approximately two hours long, but often ends up being much shorter. During the maintenance window the servers and everything hosted on them will be inaccessible. Any incoming mail for domains hosted on the mail server will be queued on the sending mail servers until our mail server is back online; email will be delayed during this time, but not lost. You will be unable to send email or access the webmail during the maintenance window. No websites will be affected.

While we are aware that this maintenance is scheduled during part of the work day for some of our clients, we are unable to change that due to the demands of this effort. We sincerely apologise for that.

We will post updates here and in alerts on our website before, during and after the maintenance.

We appreciate your patience with our efforts to keep our infrastructure and yours secure. If you have any questions, please let us know. Thank-you.

NC020: Credits for outage

11 September 2015 19:16:40 +0000

Further to our previous posts, we will be processing credits to the accounts of all affected clients for the outage on NC020.

NC020: Web server stoppage update

11 September 2015 18:59:36 +0000

After some research, combing of the logs on the server, and reading of documentation, we believe we found a reason that the web server stopped working, but we believe the cause evaporated when, in our desire to get everything working again as quickly as possible, we just rebooted the machine after other options to restart the web server failed. However, even the suspected cause does not fully jibe with the observed symptoms.

The good news is that we have recently commissioned a new server (NC030) to take on the websites hosted on NC020. We are still working on setting up the control panel on that, but we hope to have it in production as soon as possible.

We apologise for this incident, and thank you for your patience and understanding.

NC020: Server rebooted

11 September 2015 14:20:56 +0000

The web server on NC020 was found to be unresponsive today, but would also not respond to commands to restart. As a result we rebooted the machine and this seems to have fixed the problem.

We’re busy analysing the logs to determine the cause, and will post an update here if we find anything.

Migration of remaining email accounts on server NC018

14 August 2015 14:20:09 +0000

Over the weekend of 22-23 August 2015 we will be migrating all email accounts still on server NC018 to server NC027. Server NC027 has been our “new” mail server for the last two years, and all new domains have been hosted on it since it was set up in 2013. Server NC018 has outlived its useful life and needs to be replaced. The new server is an improvement over the old server in every respect.

We will be posting additional details here over the next week before the migration. However, you should be aware of the following initial details:

  • From the start of the migration, which we anticipate will take several hours, existing email accounts on server NC018 will no longer be accessible.
  • All new incoming email will be directed to the new server. Accounts on the old server will no longer be accessible after the start of the migration.
  • No incoming email will be lost during the migration, although it may be delayed briefly.
  • We will attempt to migrate the contents of mail boxes to the new server, with the exception of any accounts that are already over quota. However, we strongly recommend that you use your email program to create “local” folders (i.e., folders on your own computer) and drag and drop any messages stored on the server into your local folders, from where you can easily create back-ups.
  • As has always been our webmail policy, any data stored in the webmail other than email will not be migrated. This includes address books, notes, calendars and any other features of the Horde suite that you may be using. Please ensure that you save on your own computer copies of any data you have saved in the webmail application.
  • Except in rare cases, passwords will remain the same. However, there will be a requirement to make a small change to the configuration of your email program for sending email. We will be providing those details.
  • If you are downloading your email using POP, there will be no changes required for your incoming settings. If you are using IMAP, you may need to adjust your setting for folder structure. We will provide details if necessary closer to the migration date.
  • We ask that you do not make any changes through the control panel to email accounts as of the close of business on Friday 21 August. If you do, those changes — e.g., the addition or removal of email accounts or password changes — may not be reflected on the new server.

If you have any questions, please reply to the email you will receive from us with details. Thanks for your patience as we work to improve the service that we provide to you.

NC020: Reboot required

21 April 2015 19:47:58 +0000

There were some file consistency issues on server NC020 that started at 17:47 UTC today.

Websites on the server remained online during the problem, but no logging would have happened during that time. Incoming email to aliased domains was delayed during the issue as well.

A file system consistency check was done and the server was rebooted 30 minutes later at 18:17. This solved the issue.

Xen security updates

8 March 2015 12:27:53 +0000

Some of our servers use a technology called Xen. Like all software, it is subject to the discovery of bugs and security vulnerabilities.

Over the last week, all of our servers that use Xen have undergone “patching” to address some newly-discovered — but not yet publicised — security vulnerabilities. This patching required servers to be rebooted, and finished this morning.

We thank you for your patience this week during these upgrades.

NinerNet home page

Systems at a Glance:


Loc.SystemStatusPing
Server NC023, London, United Kingdom (Relay server), INTERNAL.NC023InternalUp?
Server NC028, Vancouver, Canada (Monitoring server), INTERNAL.NC028InternalUp?
Server NC031, New York, United States of America (Web server), INTERNAL.NC031InternalUp?
Server NC033, Toronto, Canada (Primary nameserver), OPERATIONAL.NC033OperationalUp?
Server NC034, Lusaka, Zambia (Phone server), INTERNAL.NC034InternalUp?
Server NC035, Sydney, Australia (Secondary nameserver), OPERATIONAL.NC035OperationalUp?
Server NC036, Amsterdam, Netherlands (Mail server), OPERATIONAL.NC036OperationalUp?
Server NC040, Toronto, Canada (Web server), INTERNAL.NC040InternalUp?
Server NC041, New York, United States of America (Web server), OPERATIONAL.NC041OperationalUp?
Server NC042, Seattle, United States of America (Status website), OPERATIONAL.NC042OperationalUp?

Subscriptions:

RSS icon. RSS

Twitter icon. Twitter

Search:

 

Recent Posts:

Archives:

Categories:

Links

Tags:

.co.zm domains .com.zm domains .zam.co domains back-up bounce messages browser warnings connection issues control panel database dns dos attack dot-zm domains down time email email delivery error messages ftp hardware imap mail mailing lists mail relay mail server microsoft migration nameservers network networking performance php phplist pop reboot shaw shaw communications inc. smtp spam spamassassin ssl ssl certificate tls tls certificate viruses webmail web server

Resources:

On NinerNet: