Magnus Box - Defiant Cluster / US-South to Vegas migration / Going to production status – Maintenance details

Defiant Update - 1/27/22

A lot has happened in the last 24 hours. The one thing that I cannot stress enough is how thankful I am to all of our partners who worked with us regarding the issues that we had regarding the Defiant migration.

After much troubleshooting and diagnosing, as of 11 PM EST (1/27/2022), Our management team made the difficult decision to perform a rollback to the US-South datacenter. I am happy to say that data is flowing again, and initial reports look promising. Your backups should complete without any issue during their next scheduled backup. They might be just a little bit slower for the next day or so since the Gig circuit on Defiant is getting hit pretty hard at the moment. However, backups should complete without any issue at all.

Now to the big question of was there any data loss? Unfortunately, any data from Monday until Thursday no longer exists. However, any data from before the migration on Sunday is still fully accessible and available for restoration. So, what are we going to do moving forward? We will perform a Root Cause Analysis (RCA) internally along with our vendors to determine what happened with the backups and why we experienced so many issues. We should have that completed in the next few weeks, and we will be testing the Vegas cluster thoroughly before attempting to move partners and backups over again.

In the meantime, we are offering any affected partners an SLA credit on their accounts. If you would like to take advantage of that, please email the words "SLA Credit" to support@magnusbox.com.

Finally, if you see any errors with your backups, please reach out to us immediately by emailing support@magnusbox.com.

Again, thank you for your patience.

-Mike Slodowski Founder Magnus Box LLC,

Magnus Box Partners,

Over the last few days, we have been aware of some unfortunate issues following our migration from US-South to Vegas. Problems so far include A) the inability to access the storage vault, B) backup speeds much slower than our standards would allow, and C) partners being unable to complete their backups. As you can all expect, Magnus Box will not tolerate allowing these challenges to continue for our partners.

We are currently working with our application support team and our data center partners to determine the cause and the best solution going forward.

I would like to assure our partners that at this time, there has been no data loss. A version of the data is currently still being safely kept at US-South. Right now, we are determining if we are going to attempt to patch up the data that has been transferred to Vegas or if we are going to perform a rollback to US-South. As always, opinions and feedback from our community will always be welcomed and considered.

We also want to apologize for all of the stress and uncertainty this has caused. When we planned this transfer to Vegas initially, our goal was to offer more reliable and trustworthy service to our US-South partners. We see now that we have not reached this goal with Vegas. Going forward, our biggest priority is to make a decision that will do the most good for our affected partners. Right now, 45 Magnus Box partners are affected, and that is certainly 45 too many.

We should have more information available in the next few hours. We thank you all for your patience and feedback during this time, and if you have any other questions or concerns please feel free to let us know at support@magnusbox.com. However, please be aware that we are handling many tickets about this issue right now, so delays are to be expected.

Initial backups after the transfer have been taking a little bit longer than usual as the endpoints have to rescan the vault's data. However, from our initial assessment, backups have been completing successfully.

As always, please email support@magnusbox.com if you receive any errors.

We have just finished rerouting all backup traffic for the Defiant cluster from US-South to Vegas. Data is flowing, and we will be leaving this maintenance alert open while we continue to monitor data flow and monitor partner backups.

We have begun the process of redirecting traffic from US-South to Vegas.