Resolved
Resolved
After 1 day, 16 hours, and 37 minutes

With the exception of the very largest customer servers (>1TB), all backup policies are now running to schedule.

Please accept our apologies for any inconvenience caused by this interruption.

Avatar for
{:closed=>"Closed", :complete=>"Complete", :false_alarm=>"False Alarm", :identified=>"Identified", :investigating=>"Investigating", :open=>"Open", :recovering=>"Recovering", :resolved=>"Resolved", :scheduled=>"Scheduled", :underway=>"Underway"}
After 19 hours and 45 minutes

we have managed to upgrade the backup servers to 6.8.2 and backup jobs are now running again. It'll take a few hours for things to stabilise.

Apologies for the delay in getting here - unfortunately we were dependent on the vendor to resolve this issue.

Avatar for
Recovering
After 19 hours and 43 minutes

We've fixed the core issue, and are waiting for things to recover.

Avatar for
{:closed=>"Closed", :complete=>"Complete", :false_alarm=>"False Alarm", :identified=>"Identified", :investigating=>"Investigating", :open=>"Open", :recovering=>"Recovering", :resolved=>"Resolved", :scheduled=>"Scheduled", :underway=>"Underway"}
After 17 hours and 38 minutes

Unfortunately, we continue to wait upon a resolution from the vendor.

Avatar for
Identified

Unfortunately R1Soft have released a build of CDP Backup Manager that is refusing to upgrade most of our backup policies to the latest specification, and refuses to start with un-upgraded policies.

This means no new backup snapshots are currently being taken.

Unfortunately we cannot roll back to the previous build as the internal database and some of the policies are upgraded leaving us in a half upgraded state.

We have a P1 case open with the vendor in an attempt to resolve this; they currently suggest a new release is expected "tomorrow" which is supposed to cure this particular problem.

Avatar for
Began at:

Affected components
  • Hosting
    • CDP Backup Hosts