AWS US-EAST-1 de-energized due to thunderstorms, victims need to run chkdsk
In the next fall, AWS would not be unusual if it were not for the cause of the failure. The power supply to the data center in the US-EAST-1 region (Northern Virginia) is disrupted due to a thunderstorm. Offline Netflix, Instagram, Pinterest and many other sites.
According to the status reports, the loss of power supply began at about 20:21 PDT (today at 07:21 Moscow time). After 28 minutes, the electricity supply to the data center was restored, and Amazon began to restore the affected volumes and instances. This work is still ongoing. As of 10:19 Moscow time, approximately 50% of the affected instances and 33% of the affected volumes were recovered.
Amazon reports that due to power loss in some recovered EBS volumes, there may be lost clusters: if you are among them, you will see “Impaired” status in the AWS console in the Status Checks column. In this case, it is recommended to run the fsck or chkdsk utility to verify the data.
PS For reference. When a thundercloud hangs over us, the electric field strength in the vertical direction can reach several tens of kV / m. Many have seen that when a thunderstorm approaches, the disconnected wires begin to sparkle. The charge accumulates before a thunderstorm and during a thunderstorm: the breakdown occurs at the maximum charge of the line relative to zero potential. So this weather phenomenon is very dangerous for electronics.
According to the status reports, the loss of power supply began at about 20:21 PDT (today at 07:21 Moscow time). After 28 minutes, the electricity supply to the data center was restored, and Amazon began to restore the affected volumes and instances. This work is still ongoing. As of 10:19 Moscow time, approximately 50% of the affected instances and 33% of the affected volumes were recovered.
Amazon reports that due to power loss in some recovered EBS volumes, there may be lost clusters: if you are among them, you will see “Impaired” status in the AWS console in the Status Checks column. In this case, it is recommended to run the fsck or chkdsk utility to verify the data.
PS For reference. When a thundercloud hangs over us, the electric field strength in the vertical direction can reach several tens of kV / m. Many have seen that when a thunderstorm approaches, the disconnected wires begin to sparkle. The charge accumulates before a thunderstorm and during a thunderstorm: the breakdown occurs at the maximum charge of the line relative to zero potential. So this weather phenomenon is very dangerous for electronics.
')
Source: https://habr.com/ru/post/146828/
All Articles