You are not logged in.

#1 2017-04-05 00:50:16

juampii
Member
Registered: 2015-09-19
Posts: 1

Raid 10 8 Devices Error

Hi, sry for my bad english. I need some expert help

Everything is working fine, and form one moment to another the md0 device stops working.

It consist in 8 4tb drives

cat /proc/mdstat 
Personalities : [linear] [raid0] [raid1] [raid10] 
md0 : inactive sdi1[6](S) sde1[2](S) sdf1[3](S) sdg1[5](S) sdj1[7](S) sdh1[4](S) sdc1[0](S) sdd1[1](S)
      31254904832 blocks super 1.2
       
unused devices: <none>

i run
mdadm --stop /dev/md0

and

mdadm -A /dev/md0 --verbose
and i get

mdadm: looking for devices for /dev/md0
mdadm: No super block found on /dev/sdj (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdj
mdadm: No super block found on /dev/sdi (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdi
mdadm: No super block found on /dev/sdh (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdh
mdadm: No super block found on /dev/sdg (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdg
mdadm: No super block found on /dev/sdf (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdf
mdadm: No super block found on /dev/sde (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sde
mdadm: No super block found on /dev/sdd (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdd
mdadm: No super block found on /dev/sdc (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdc
mdadm: No super block found on /dev/sdb4 (Expected magic a92b4efc, got 0fc02366)
mdadm: no RAID superblock on /dev/sdb4
mdadm: No super block found on /dev/sdb3 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdb3
mdadm: No super block found on /dev/sdb2 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdb2
mdadm: No super block found on /dev/sdb1 (Expected magic a92b4efc, got 0fc02366)
mdadm: no RAID superblock on /dev/sdb1
mdadm: No super block found on /dev/sdb (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sdb
mdadm: No super block found on /dev/sda2 (Expected magic a92b4efc, got 00000439)
mdadm: no RAID superblock on /dev/sda2
mdadm: No super block found on /dev/sda1 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sda1
mdadm: No super block found on /dev/sda (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/sda
mdadm: No super block found on /dev/ram15 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram15
mdadm: No super block found on /dev/ram14 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram14
mdadm: No super block found on /dev/ram13 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram13
mdadm: No super block found on /dev/ram12 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram12
mdadm: No super block found on /dev/ram11 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram11
mdadm: No super block found on /dev/ram10 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram10
mdadm: No super block found on /dev/ram9 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram9
mdadm: No super block found on /dev/ram8 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram8
mdadm: No super block found on /dev/ram7 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram7
mdadm: No super block found on /dev/ram6 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram6
mdadm: No super block found on /dev/ram5 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram5
mdadm: No super block found on /dev/ram4 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram4
mdadm: No super block found on /dev/ram3 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram3
mdadm: No super block found on /dev/ram2 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram2
mdadm: No super block found on /dev/ram1 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram1
mdadm: No super block found on /dev/ram0 (Expected magic a92b4efc, got 00000000)
mdadm: no RAID superblock on /dev/ram0
mdadm: /dev/sdj1 is identified as a member of /dev/md0, slot 7.
mdadm: /dev/sdi1 is identified as a member of /dev/md0, slot 6.
mdadm: /dev/sdh1 is identified as a member of /dev/md0, slot 4.
mdadm: /dev/sdg1 is identified as a member of /dev/md0, slot 5.
mdadm: /dev/sdf1 is identified as a member of /dev/md0, slot 3.
mdadm: /dev/sde1 is identified as a member of /dev/md0, slot 2.
mdadm: /dev/sdd1 is identified as a member of /dev/md0, slot 1.
mdadm: /dev/sdc1 is identified as a member of /dev/md0, slot 0.
mdadm: added /dev/sdd1 to /dev/md0 as 1
mdadm: added /dev/sde1 to /dev/md0 as 2
mdadm: added /dev/sdf1 to /dev/md0 as 3
mdadm: added /dev/sdh1 to /dev/md0 as 4 (possibly out of date)
mdadm: added /dev/sdg1 to /dev/md0 as 5 (possibly out of date)
mdadm: added /dev/sdi1 to /dev/md0 as 6
mdadm: added /dev/sdj1 to /dev/md0 as 7
mdadm: added /dev/sdc1 to /dev/md0 as 0
mdadm: /dev/md0 assembled from 6 drives - not enough to start the array.

cat /etc/mdadm.conf

DEVICE partitions
ARRAY /dev/md0 metadata=1.2 name=SAMSARA:0 UUID=01c86d33:50403b16:40e0da06:a7e3510a

I run smartctl -H for all members and it return PASSED

mdadm --examine /dev/sd[cdefghij][1]

/dev/sdc1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 01c86d33:50403b16:40e0da06:a7e3510a
           Name : SAMSARA:0  (local to host SAMSARA)
  Creation Time : Sat Mar  4 20:42:41 2017
     Raid Level : raid10
   Raid Devices : 8

 Avail Dev Size : 7813726208 (3725.88 GiB 4000.63 GB)
     Array Size : 15627452416 (14903.50 GiB 16002.51 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=0 sectors
          State : clean
    Device UUID : ed2cd418:9ad99b32:f96d201a:1ecb5483

Internal Bitmap : 8 sectors from superblock
    Update Time : Tue Apr  4 20:01:58 2017
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : cf6eac39 - correct
         Events : 81935

         Layout : far=2
     Chunk Size : 512K

   Device Role : Active device 0
   Array State : AAAA.AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdd1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 01c86d33:50403b16:40e0da06:a7e3510a
           Name : SAMSARA:0  (local to host SAMSARA)
  Creation Time : Sat Mar  4 20:42:41 2017
     Raid Level : raid10
   Raid Devices : 8

 Avail Dev Size : 7813726208 (3725.88 GiB 4000.63 GB)
     Array Size : 15627452416 (14903.50 GiB 16002.51 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=0 sectors
          State : clean
    Device UUID : 9c1d4e4f:9b4f461b:e911528b:5c20dd61

Internal Bitmap : 8 sectors from superblock
    Update Time : Tue Apr  4 20:01:58 2017
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 3e4d0c19 - correct
         Events : 81935

         Layout : far=2
     Chunk Size : 512K

   Device Role : Active device 1
   Array State : AAAA.AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sde1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 01c86d33:50403b16:40e0da06:a7e3510a
           Name : SAMSARA:0  (local to host SAMSARA)
  Creation Time : Sat Mar  4 20:42:41 2017
     Raid Level : raid10
   Raid Devices : 8

 Avail Dev Size : 7813726208 (3725.88 GiB 4000.63 GB)
     Array Size : 15627452416 (14903.50 GiB 16002.51 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=0 sectors
          State : clean
    Device UUID : b149ff1d:5734f435:1310609a:bdcde3b3

Internal Bitmap : 8 sectors from superblock
    Update Time : Tue Apr  4 20:01:58 2017
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 88c0c876 - correct
         Events : 81935

         Layout : far=2
     Chunk Size : 512K

   Device Role : Active device 2
   Array State : AAAA.AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdf1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 01c86d33:50403b16:40e0da06:a7e3510a
           Name : SAMSARA:0  (local to host SAMSARA)
  Creation Time : Sat Mar  4 20:42:41 2017
     Raid Level : raid10
   Raid Devices : 8

 Avail Dev Size : 7813726208 (3725.88 GiB 4000.63 GB)
     Array Size : 15627452416 (14903.50 GiB 16002.51 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=0 sectors
          State : clean
    Device UUID : 4859a760:210baa65:3d511039:47210e1e

Internal Bitmap : 8 sectors from superblock
    Update Time : Tue Apr  4 20:01:58 2017
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 3f9438c - correct
         Events : 81935

         Layout : far=2
     Chunk Size : 512K

   Device Role : Active device 3
   Array State : AAAA.AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdg1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 01c86d33:50403b16:40e0da06:a7e3510a
           Name : SAMSARA:0  (local to host SAMSARA)
  Creation Time : Sat Mar  4 20:42:41 2017
     Raid Level : raid10
   Raid Devices : 8

 Avail Dev Size : 7813726208 (3725.88 GiB 4000.63 GB)
     Array Size : 15627452416 (14903.50 GiB 16002.51 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=0 sectors
          State : active
    Device UUID : 7491a021:b72102d8:af4afc18:13e6992f

Internal Bitmap : 8 sectors from superblock
    Update Time : Tue Apr  4 19:31:16 2017
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 28c2460c - correct
         Events : 81087

         Layout : far=2
     Chunk Size : 512K

   Device Role : Active device 5
   Array State : AAAA.AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdh1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 01c86d33:50403b16:40e0da06:a7e3510a
           Name : SAMSARA:0  (local to host SAMSARA)
  Creation Time : Sat Mar  4 20:42:41 2017
     Raid Level : raid10
   Raid Devices : 8

 Avail Dev Size : 7813726208 (3725.88 GiB 4000.63 GB)
     Array Size : 15627452416 (14903.50 GiB 16002.51 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=0 sectors
          State : active
    Device UUID : 5de7059a:efd220fe:5892cabb:f5113b83

Internal Bitmap : 8 sectors from superblock
    Update Time : Sat Mar 25 22:18:51 2017
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : bda6d89a - correct
         Events : 23636

         Layout : far=2
     Chunk Size : 512K

   Device Role : Active device 4
   Array State : AAAAAAAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdi1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 01c86d33:50403b16:40e0da06:a7e3510a
           Name : SAMSARA:0  (local to host SAMSARA)
  Creation Time : Sat Mar  4 20:42:41 2017
     Raid Level : raid10
   Raid Devices : 8

 Avail Dev Size : 7813726208 (3725.88 GiB 4000.63 GB)
     Array Size : 15627452416 (14903.50 GiB 16002.51 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=0 sectors
          State : clean
    Device UUID : 2f3185f1:7f28054e:c7ca2e6c:1951893d

Internal Bitmap : 8 sectors from superblock
    Update Time : Tue Apr  4 20:01:58 2017
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : cfcbe230 - correct
         Events : 81935

         Layout : far=2
     Chunk Size : 512K

   Device Role : Active device 6
   Array State : AAAA.AAA ('A' == active, '.' == missing, 'R' == replacing)
/dev/sdj1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 01c86d33:50403b16:40e0da06:a7e3510a
           Name : SAMSARA:0  (local to host SAMSARA)
  Creation Time : Sat Mar  4 20:42:41 2017
     Raid Level : raid10
   Raid Devices : 8

 Avail Dev Size : 7813726208 (3725.88 GiB 4000.63 GB)
     Array Size : 15627452416 (14903.50 GiB 16002.51 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262056 sectors, after=0 sectors
          State : clean
    Device UUID : ec9b9519:32963113:36468058:c86e42b0

Internal Bitmap : 8 sectors from superblock
    Update Time : Tue Apr  4 20:01:58 2017
  Bad Block Log : 512 entries available at offset 72 sectors
       Checksum : 1c1353bf - correct
         Events : 81935

         Layout : far=2
     Chunk Size : 512K

   Device Role : Active device 7
   Array State : AAAA.AAA ('A' == active, '.' == missing, 'R' == replacing)

A side note:

The command i use to creatte the array in the past was:

mdadm --create --verbose --level=10 --metadata=1.2 --chunk=512 --raid-devices=8 --layout=f2 /dev/md0 /dev/sdc1 /dev/sdd1 /dev/sde1 /dev/sdf1 /dev/sdg1  /dev/sdh1  /dev/sdi1 /dev/sdj1

And to format it:

mkfs.ext4 -v -L DATOS -m 0.01 -b 4096 -E stride=128,stripe-width=1024 /dev/md0

i have mdraid loaded at boot level, but always shows a red *, i believe that was because kernel autodetect the arrays before mdraid do, so its already activated.


How can i reactivate the array?

Update:
mdadm --stop /dev/md0

mdadm: stopped /dev/md0

mdadm --assemble /dev/md0 /dev/sd[cdefghij]1

mdadm: /dev/sdc1 is busy - skipping
mdadm: /dev/sdd1 is busy - skipping
mdadm: /dev/sde1 is busy - skipping
mdadm: /dev/sdf1 is busy - skipping
mdadm: /dev/sdg1 is busy - skipping
mdadm: /dev/sdh1 is busy - skipping
mdadm: /dev/sdi1 is busy - skipping
mdadm: /dev/sdj1 is busy - skipping

I think bussy because i have parted open.

And then i try in the order it shows in --examine

mdadm --assemble /dev/md0 /dev/sd[cdefhgij]1

mdadm: /dev/md0 assembled from 6 drives - not enough to start the array.

Thanks very much

Offline

#2 2017-05-24 05:43:22

sud_crow
Member
From: Argentina
Registered: 2003-06-30
Posts: 546
Website

Re: Raid 10 8 Devices Error

md0 : inactive sdi1[6](S) sde1[2](S) sdf1[3](S) sdg1[5](S) sdj1[7](S) sdh1[4](S) sdc1[0](S) sdd1[1](S)

The (S) there means they are in SPARE mode.

You were on the right track trying to reassemble the array, but a couple of times I had to use --force for it to work.
You might have a dirty array (meaning the system crashed or was powered off without a clean shutdown).

I don't like recommending it, but if you have backups and don't mind the risk:

WARNING: THIS COULD DESTROY YOUR DATA, USE AT YOUR OWN RISK!

If you still want to try:

mdadm --stop /dev/md0

mdadm --assemble --scan --force

Or the specific version:

mdadm --stop /dev/md0

mdadm --assemble --force /dev/md0 /dev/sd[cdefghij]1

You should probably check your disks for SMART failures just in case. And remember, don't use RAID if you don't have an electric power backup (UPS) allowing the RAID to shutdown clean.

RAID is not a backup, it only covers a few disks failing physically. If your system data crashes or gets corrupted it will be replicated all over the array. Make an external copy.

ps. Replied as I was looking for some information regarding raid10 in Arch Linux and thought it would be good to leave a way to solve the issue as this was unanswered and the solution has been the same for a few years.

Last edited by sud_crow (2017-05-24 05:45:04)


Leonardo Andrés Gallego
www.archlinux-es.org || Comunidad Hispana de Arch Linux

Offline

Board footer

Powered by FluxBB