We should note that currently, once your email is transferred, you won’t be able to communicate with us via email, because we ourselves haven’t done what we need to do, which is transfer and properly host email on our domain.
We should note that currently, once your email is transferred, you won’t be able to communicate with us via email, because we ourselves haven’t done what we need to do, which is transfer and properly host email on our domain.
Now that I have had a little time to breathe and respond to the many emails we’ve received, let me take a moment to review things and make a few statements.
First of all, the only service that has suffered and is suffering is the email. Of course, that’s the primary and biggest service that we provide. The DNS and web hosting is completely unaffected, so your websites and the DNS on which they rely are safe. That’s little solace, I get it, but it’s one less thing to worry about for now during this time of turmoil. You don’t need to rush to take care of those yet.
We will provide all the assistance you need for the services we provide and support, but if you are transferring to XYZ Stack ‘Em Deep And Sell ‘Em Cheap Hosting Company (or Fastmail), you need to follow the instruction they give you. You have all the passwords for your email accounts, and if you don’t have one for some reason, you can log into the mail server control panel and reset any you don’t have.
On the note in the second paragraph, as their name suggests, Fastmail does not host websites. They will host small, static websites, but not full dynamic ones using PHP (such as WordPress). We have no recommendation for a new web hosting company.
We also need to note that you don’t have to host everything in the same place with the same company. That’s not always obvious to all people.
We caution you not to transfer your domain registration right away. This can be a time-consuming process that will delay your ability to manage what’s important, your email. Better to change your DNS records at NinerNet first, and worry about transferring the domain registration later.
We will have more comments to make, but we wanted to make those for now.
After spending all weekend trying to get the existing mail server working, we have decided to face the facts and give up.
That means we have essentially been forced to choose option two, much against our wishes. We can’t address demands for our time and give the necessary time and attention to those who feel they are more important than all the rest of our clients, and demand something nobody can have right now. And, to be honest, we can’t hold everyone hostage while we amuse ourselves doing something of little value.
The server and your saved email are online and accessible. What you need to do now is find a new host.
I wish I could say that I have spent lots of time thinking about this and I just need to copy and paste my suggested plan of action, but I can’t because I haven’t. I can only recommend that you don’t feed the growing empire of the oligopoly of Google and Microsoft, but I realise I’m tilting at windmills. The only company we might recommend is Fastmail (commission link|clean link).
As I said, the server and your email are accessible, and your email can be transferred as any new host would do, or as you do using your email program as you use it every day.
We are available to assist through normal email support channels (email to us works only from a domain we host), subject to ensuring we are communicating with the authorised representative(s) of each domain we manage.
We are exploring ways to get the current mail server working, before giving up and starting an all-new server, because we know that a week of downtime is far from ideal. External mail servers are connecting to our mail server, but our mail server is immediately shutting down the connection, meaning the external mail server cannot deliver its message.
Our mail server is working, but it’s basically as good as the computer on your desktop right now, which is not very good at processing email because it’s not configured to.
Some clients have taken matters into their own hands, which is to be expected, and we have always consciously given you that ability: You have access to the DNS for your domain, which means you can point the DNS for your domain to another mail server. If what is happening right now is not to your liking, understandably, you can do this. We don’t have the time right now to go looking for and provide auth codes so that you can rush off and do the wrong thing.
Speaking of which, the current situation has absolutely no effect on any websites we host, also by design.
Updates will now be sequentially numbered.
We’ve marked server NC036 as “degraded”, because that’s what it is. Email within the group of clients for which we are responsible works. With the outside world, it doesn’t.
Our live monitoring indicates that our uptime is 99.998%, but as we’ve indicated before, this is not 100% accurate. Even AI is “accurately inaccurate”.
You still have access to your account(s) on the server. Please do with that information what you consider to be best for your business.
We implemented the permanent fix yesterday. However, the result seems to be the same: NO EMAIL.
I half expected that this would reveal to me that I had made a stupid mistake, and all this palaver was for nothing. That would have been supremely uncomfortable, but at least we’d all be online. But we’re not.
I know you, our clients, have struggled for the last two days. So have we, there is no doubt. I literally feel your pain.
We have two options at this point, but I want to make clear at the outset that your data — your 5.1 million emails, 2.9 terabytes — are safe. Additionally, I am still alive, which could be a positive or a negative for you, depending on how you view the situation.
Option one, and the option I’d prefer under normal circumstances, is to start fresh with a new mail server, and even just verbalising that fills me with that feeling you get at the beginning of a footrace. You don’t know if you’ll come first, or 101st, but goddam, you’re going to race your heart out.
Option two, to put it succinctly, is to know when to quit. It’s not the end I envisioned when I was supposed to hand over the business and our name in May last year, but nothing lasts forever.
Already I hear most of you leaning towards option two. I don’t blame you. Just get out of the way, Craig, and let me get my email and entrust it to someone with a bigger marketing budget.
If I choose option one, it’s going to take at least a week … and that’s being optimistic. So you will not be able to send or receive email for all of next week, and if everything works, you’ll be online by Monday, 30 March 2026 … I hope.
If I choose option two, that would be like giving the order to “abandon ship”; you don’t want to be in the cold water, but the only other option is even less palatable.
I’ve decided, after much soul searching and personal conversations today, to take option one.
Who knows what NinerNet will look like in a week or a month. However, I know what’s most important for me, and that is that you have your access to the 5.1 million emails you have entrusted to us. You will have access to them, and what you do with them will be up to you.
We will, as always, be communicative, and post updates here. We’re not ignoring your emails — which we ironically continue to receive — but our focus must be and is on keeping everyone as informed as possible.
We continue to receive reports of continued problems from a very few clients.
We essentially addressed the problem on the evening (UTC) of 19 March. We have yet to put in place a permanent fix. The permanent fix is to attach a secondary volume, and move some back-ups onto the secondary volume, to free up space on the primary hard drive to store and process email. We have not done this yet.
However, we have freed up a huge amount of space, so the server is comfortably handling all the email thrown at it. This is the temporary fix.
The reported problems seem to focus on two areas:
We have been working on the mail server non-stop for about 21 hour now. We have rebooted the server once (in the morning UTC) and restarted applications a few times. During that time foreign mail servers may have been disconnected in the middle of trying to deliver an email, resulting in their bouncing the email with an error that refers to “losing the connection while receiving the initial server greeting”. Given how often this would have happened (not very much) we’re surprised to see this bounce, but it’s obviously happened. We can only expect these events to lessen as things return to normal.
We ourselves have noticed that emails from external/foreign sources have not been arriving lately. We can only expect that these emails are delayed, and we expect to receive them again in the next 24 hours. Please be patient.
If you check your domain at mxtoolbox.com you will find that it should comply with all or most requirement to have your email delivered. Not complying with every requirement is not necessarily a bad thing.
We expect to have the permanent fix in place within the next 12 hours, but the temporary fix is more than enough to keep the email flowing. Thank-you.
It seems, from monitoring our own company email, that email is flowing normally. However, tests I have done to my personal email address are still delayed. This doesn’t really make sense, as our server is not blocking any inbound email. We’re still working on the permanent fix, but in the meantime there is plenty of disk space to take in the biggest of emails.
We have rebooted the mail server, so the webmail is working again. We don’t know how long that was generating an error, but it wasn’t reported by anyone until a few minutes ago.
This seems to be a disk space issue. We have freed up enough space that backlogged email has been released. There should be no problems sending and receiving email now, but we are still working to implement a permanent fix. Apologies for the interruption.
We will have further updates as we implement the permanent fix.
Systems at a Glance:
| Loc. | System | Status | Ping |
|---|---|---|---|
| NC023 | Internal | Up? | |
| NC028 | Internal | Up? | |
| NC031 | Internal | Up? | |
| NC033 | Operational | Up? | |
| NC034 | Internal | Up? | |
| NC035 | Operational | Up? | |
| NC036 | Degraded | Up? | |
| NC040 | Internal | Up? | |
| NC041 | Operational | Up? | |
| NC042 | Operational | Up? |
Subscriptions:
Search:
Recent Posts:
Archives:
Categories:
Links
Tags:
Resources:
On NinerNet: