DEGRADED MODE — CACHED ENTITLEMENTS · SENTRIS-DB01 UNREACHABLE · People & Places duty desk
Modify ↓

Opened 14 years ago

Last modified 14 years ago

#8 RESOLVED fault

Backup tape verify failing; RAID array degraded on the CMS host

Reported by: People & Places Owned by: M. Ross (Infrastructure)
Priority: P2 Milestone:
Component: Infrastructure / Backup Version:
Keywords: Cc:
Desk: Estate & Systems Legacy ref: DEVCON-0705

Description

The weekly tape verify failed and, on inspection, the CMS host's RAID 5 array was running degraded on a failed disk — so we were a single disk away from a bad day. Replacement disk and a fresh, verified backup set both required urgently.

Attachments (0)

Change History (2)

comment:1 by M. Ross, 14 years ago

Disk 2 dead, array degraded but online. Ordered a matching disk, kicked off a verified backup to a fresh tape set in the meantime. Nobody panic.

comment:2 by M. Ross, 14 years ago

New disk in, array rebuilt overnight, tape verify green. We now test-restore monthly, not just verify. Lesson learned cheaply. Closing.

Modify Ticket

Change Properties
Set your email in Preferences
Action
as RESOLVED The owner will remain M. Ross (Infrastructure).

Add Comment
E-mail address and name can be saved in the Preferences .
Attachments ↑ Description ↑
 
Note: See TracTickets for help on using tickets.