Error in md syncing ? If the disk gone first, I wonder why it will possible to complete the sync successful. If the disk is failing after the syncing, why does the sync occure so often ? [46472.588775] md: recovery of RAID array md0 [46472.589655] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.590503] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.591412] md: using 128k window, over a total of 1465135936 blocks. [46472.592316] md: resuming recovery of md0 from checkpoint. [46472.593229] md: md0: recovery done. [46472.612683] RAID5 conf printout: [46472.613588] --- rd:3 wd:2 [46472.614442] disk 0, o:1, dev:sde1 [46472.615279] disk 1, o:1, dev:sdf1 [46472.616111] disk 2, o:0, dev:sdh1 [46472.636717] md: recovery of RAID array md0 [46472.637602] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.638450] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.639346] md: using 128k window, over a total of 1465135936 blocks. [46472.640249] md: resuming recovery of md0 from checkpoint. [46472.641152] md: md0: recovery done. [46472.660743] RAID5 conf printout: [46472.661682] --- rd:3 wd:2 [46472.662536] disk 0, o:1, dev:sde1 [46472.663378] disk 1, o:1, dev:sdf1 [46472.664218] disk 2, o:0, dev:sdh1 [46472.684758] md: recovery of RAID array md0 [46472.685632] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.686490] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.687384] md: using 128k window, over a total of 1465135936 blocks. [46472.688287] md: resuming recovery of md0 from checkpoint. [46472.689186] md: md0: recovery done. [46472.708745] RAID5 conf printout: [46472.709661] --- rd:3 wd:2 [46472.710513] disk 0, o:1, dev:sde1 [46472.711357] disk 1, o:1, dev:sdf1 [46472.712188] disk 2, o:0, dev:sdh1 [46472.732776] md: recovery of RAID array md0 [46472.733663] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.734523] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.735429] md: using 128k window, over a total of 1465135936 blocks. [46472.736332] md: resuming recovery of md0 from checkpoint. [46472.737234] md: md0: recovery done. [46472.756744] RAID5 conf printout: [46472.757659] --- rd:3 wd:2 [46472.758501] disk 0, o:1, dev:sde1 [46472.759340] disk 1, o:1, dev:sdf1 [46472.760179] disk 2, o:0, dev:sdh1 [46472.780770] md: recovery of RAID array md0 [46472.781680] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.782567] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.783467] md: using 128k window, over a total of 1465135936 blocks. [46472.784379] md: resuming recovery of md0 from checkpoint. [46472.785285] md: md0: recovery done. [46472.804736] RAID5 conf printout: [46472.805653] --- rd:3 wd:2 [46472.806494] disk 0, o:1, dev:sde1 [46472.807332] disk 1, o:1, dev:sdf1 [46472.808162] disk 2, o:0, dev:sdh1 [46472.828773] md: recovery of RAID array md0 [46472.829653] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.830498] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.831404] md: using 128k window, over a total of 1465135936 blocks. [46472.832306] md: resuming recovery of md0 from checkpoint. [46472.833218] md: md0: recovery done. [46472.852685] RAID5 conf printout: [46472.853585] --- rd:3 wd:2 [46472.854437] disk 0, o:1, dev:sde1 [46472.855273] disk 1, o:1, dev:sdf1 [46472.856101] disk 2, o:0, dev:sdh1 [46472.876787] md: recovery of RAID array md0 [46472.877670] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.878517] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.879413] md: using 128k window, over a total of 1465135936 blocks. [46472.880315] md: resuming recovery of md0 from checkpoint. [46472.881215] md: md0: recovery done. [46472.900739] RAID5 conf printout: [46472.901691] --- rd:3 wd:2 [46472.902547] disk 0, o:1, dev:sde1 [46472.903383] disk 1, o:1, dev:sdf1 [46472.904223] disk 2, o:0, dev:sdh1 [46472.924719] md: recovery of RAID array md0 [46472.925598] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.926444] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.927341] md: using 128k window, over a total of 1465135936 blocks. [46472.928241] md: resuming recovery of md0 from checkpoint. [46472.929151] md: md0: recovery done. [46472.948749] RAID5 conf printout: [46472.949661] --- rd:3 wd:2 [46472.950512] disk 0, o:1, dev:sde1 [46472.951374] disk 1, o:1, dev:sdf1 [46472.952209] disk 2, o:0, dev:sdh1 [46472.972715] md: recovery of RAID array md0 [46472.973582] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46472.974440] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46472.975341] md: using 128k window, over a total of 1465135936 blocks. [46472.976245] md: resuming recovery of md0 from checkpoint. [46472.977146] md: md0: recovery done. [46472.996691] RAID5 conf printout: [46472.997617] --- rd:3 wd:2 [46472.998459] disk 0, o:1, dev:sde1 [46472.999293] disk 1, o:1, dev:sdf1 [46473.000132] disk 2, o:0, dev:sdh1 [46473.020781] md: recovery of RAID array md0 [46473.021663] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.022513] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.023421] md: using 128k window, over a total of 1465135936 blocks. [46473.024332] md: resuming recovery of md0 from checkpoint. [46473.025252] md: md0: recovery done. [46473.044741] RAID5 conf printout: [46473.045656] --- rd:3 wd:2 [46473.046501] disk 0, o:1, dev:sde1 [46473.047337] disk 1, o:1, dev:sdf1 [46473.048166] disk 2, o:0, dev:sdh1 [46473.068788] md: recovery of RAID array md0 [46473.069668] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.070519] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.071417] md: using 128k window, over a total of 1465135936 blocks. [46473.072323] md: resuming recovery of md0 from checkpoint. [46473.073235] md: md0: recovery done. [46473.092680] RAID5 conf printout: [46473.093583] --- rd:3 wd:2 [46473.094439] disk 0, o:1, dev:sde1 [46473.095275] disk 1, o:1, dev:sdf1 [46473.096105] disk 2, o:0, dev:sdh1 [46473.116778] md: recovery of RAID array md0 [46473.117660] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.118508] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.119408] md: using 128k window, over a total of 1465135936 blocks. [46473.120312] md: resuming recovery of md0 from checkpoint. [46473.121215] md: md0: recovery done. [46473.152689] RAID5 conf printout: [46473.153591] --- rd:3 wd:2 [46473.154446] disk 0, o:1, dev:sde1 [46473.155283] disk 1, o:1, dev:sdf1 [46473.156132] disk 2, o:0, dev:sdh1 [46473.176797] md: recovery of RAID array md0 [46473.177680] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.178533] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.179432] md: using 128k window, over a total of 1465135936 blocks. [46473.180336] md: resuming recovery of md0 from checkpoint. [46473.181242] md: md0: recovery done. [46473.200750] RAID5 conf printout: [46473.201679] --- rd:3 wd:2 [46473.202546] disk 0, o:1, dev:sde1 [46473.203385] disk 1, o:1, dev:sdf1 [46473.204231] disk 2, o:0, dev:sdh1 [46473.224789] md: recovery of RAID array md0 [46473.225673] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.226524] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.227422] md: using 128k window, over a total of 1465135936 blocks. [46473.228324] md: resuming recovery of md0 from checkpoint. [46473.229224] md: md0: recovery done. [46473.248746] RAID5 conf printout: [46473.249658] --- rd:3 wd:2 [46473.250515] disk 0, o:1, dev:sde1 [46473.251368] disk 1, o:1, dev:sdf1 [46473.252204] disk 2, o:0, dev:sdh1 [46473.272713] md: recovery of RAID array md0 [46473.273572] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.274447] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.275351] md: using 128k window, over a total of 1465135936 blocks. [46473.276259] md: resuming recovery of md0 from checkpoint. [46473.277165] md: md0: recovery done. [46473.296747] RAID5 conf printout: [46473.297659] --- rd:3 wd:2 [46473.298506] disk 0, o:1, dev:sde1 [46473.299356] disk 1, o:1, dev:sdf1 [46473.300199] disk 2, o:0, dev:sdh1 [46473.320714] md: recovery of RAID array md0 [46473.321601] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.322452] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.323363] md: using 128k window, over a total of 1465135936 blocks. [46473.324278] md: resuming recovery of md0 from checkpoint. [46473.325185] md: md0: recovery done. [46473.344745] RAID5 conf printout: [46473.345660] --- rd:3 wd:2 [46473.346505] disk 0, o:1, dev:sde1 [46473.347346] disk 1, o:1, dev:sdf1 [46473.348179] disk 2, o:0, dev:sdh1 [46473.380775] md: recovery of RAID array md0 [46473.381666] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.382522] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.383427] md: using 128k window, over a total of 1465135936 blocks. [46473.384341] md: resuming recovery of md0 from checkpoint. [46473.385252] md: md0: recovery done. [46473.404746] RAID5 conf printout: [46473.405657] --- rd:3 wd:2 [46473.406502] disk 0, o:1, dev:sde1 [46473.407343] disk 1, o:1, dev:sdf1 [46473.408173] disk 2, o:0, dev:sdh1 [46473.428789] md: recovery of RAID array md0 [46473.429672] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.430522] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.431420] md: using 128k window, over a total of 1465135936 blocks. [46473.432337] md: resuming recovery of md0 from checkpoint. [46473.433253] md: md0: recovery done. [46473.452686] RAID5 conf printout: [46473.453590] --- rd:3 wd:2 [46473.454445] disk 0, o:1, dev:sde1 [46473.455284] disk 1, o:1, dev:sdf1 [46473.456115] disk 2, o:0, dev:sdh1 [46473.476775] md: recovery of RAID array md0 [46473.477654] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.478504] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.479403] md: using 128k window, over a total of 1465135936 blocks. [46473.480309] md: resuming recovery of md0 from checkpoint. [46473.481213] md: md0: recovery done. [46473.500748] RAID5 conf printout: [46473.501675] --- rd:3 wd:2 [46473.502531] disk 0, o:1, dev:sde1 [46473.503375] disk 1, o:1, dev:sdf1 [46473.504216] disk 2, o:0, dev:sdh1 [46473.524773] md: recovery of RAID array md0 [46473.525652] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.526503] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.527401] md: using 128k window, over a total of 1465135936 blocks. [46473.528313] md: resuming recovery of md0 from checkpoint. [46473.529215] md: md0: recovery done. [46473.548695] RAID5 conf printout: [46473.549617] --- rd:3 wd:2 [46473.550470] disk 0, o:1, dev:sde1 [46473.551325] disk 1, o:1, dev:sdf1 [46473.552164] disk 2, o:0, dev:sdh1 [46473.572697] md: recovery of RAID array md0 [46473.573564] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.574429] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.575331] md: using 128k window, over a total of 1465135936 blocks. [46473.576247] md: resuming recovery of md0 from checkpoint. [46473.577151] md: md0: recovery done. [46473.596662] RAID5 conf printout: [46473.597600] --- rd:3 wd:2 [46473.598445] disk 0, o:1, dev:sde1 [46473.599282] disk 1, o:1, dev:sdf1 [46473.600124] disk 2, o:0, dev:sdh1 [46473.620768] md: recovery of RAID array md0 [46473.621648] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.622499] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.623407] md: using 128k window, over a total of 1465135936 blocks. [46473.624335] md: resuming recovery of md0 from checkpoint. [46473.625262] md: md0: recovery done. [46473.644683] RAID5 conf printout: [46473.645600] --- rd:3 wd:2 [46473.646446] disk 0, o:1, dev:sde1 [46473.647283] disk 1, o:1, dev:sdf1 [46473.648113] disk 2, o:0, dev:sdh1 [46473.668712] md: recovery of RAID array md0 [46473.669597] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.670452] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.671353] md: using 128k window, over a total of 1465135936 blocks. [46473.672258] md: resuming recovery of md0 from checkpoint. [46473.673182] md: md0: recovery done. [46473.692682] RAID5 conf printout: [46473.693584] --- rd:3 wd:2 [46473.694440] disk 0, o:1, dev:sde1 [46473.695277] disk 1, o:1, dev:sdf1 [46473.696107] disk 2, o:0, dev:sdh1 [46473.716716] md: recovery of RAID array md0 [46473.717601] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.718450] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.719350] md: using 128k window, over a total of 1465135936 blocks. [46473.720255] md: resuming recovery of md0 from checkpoint. [46473.721157] md: md0: recovery done. [46473.740748] RAID5 conf printout: [46473.741676] --- rd:3 wd:2 [46473.742531] disk 0, o:1, dev:sde1 [46473.743372] disk 1, o:1, dev:sdf1 [46473.744215] disk 2, o:0, dev:sdh1 [46473.764773] md: recovery of RAID array md0 [46473.765657] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.766508] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.767408] md: using 128k window, over a total of 1465135936 blocks. [46473.768310] md: resuming recovery of md0 from checkpoint. [46473.769210] md: md0: recovery done. [46473.788686] RAID5 conf printout: [46473.789598] --- rd:3 wd:2 [46473.790451] disk 0, o:1, dev:sde1 [46473.791303] disk 1, o:1, dev:sdf1 [46473.792138] disk 2, o:0, dev:sdh1 [46473.812710] md: recovery of RAID array md0 [46473.813580] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.814437] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.815335] md: using 128k window, over a total of 1465135936 blocks. [46473.816235] md: resuming recovery of md0 from checkpoint. [46473.817135] md: md0: recovery done. [46473.836746] RAID5 conf printout: [46473.837661] --- rd:3 wd:2 [46473.838504] disk 0, o:1, dev:sde1 [46473.839352] disk 1, o:1, dev:sdf1 [46473.840189] disk 2, o:0, dev:sdh1 [46473.860780] md: recovery of RAID array md0 [46473.861654] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.862504] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.863409] md: using 128k window, over a total of 1465135936 blocks. [46473.864316] md: resuming recovery of md0 from checkpoint. [46473.865222] md: md0: recovery done. [46473.884749] RAID5 conf printout: [46473.885659] --- rd:3 wd:2 [46473.886499] disk 0, o:1, dev:sde1 [46473.887331] disk 1, o:1, dev:sdf1 [46473.888158] disk 2, o:0, dev:sdh1 [46473.908781] md: recovery of RAID array md0 [46473.909659] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.910509] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.911404] md: using 128k window, over a total of 1465135936 blocks. [46473.912306] md: resuming recovery of md0 from checkpoint. [46473.913214] md: md0: recovery done. [46473.932682] RAID5 conf printout: [46473.933575] --- rd:3 wd:2 [46473.934449] disk 0, o:1, dev:sde1 [46473.935284] disk 1, o:1, dev:sdf1 [46473.936114] disk 2, o:0, dev:sdh1 [46473.956792] md: recovery of RAID array md0 [46473.957674] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46473.958520] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46473.959414] md: using 128k window, over a total of 1465135936 blocks. [46473.960313] md: resuming recovery of md0 from checkpoint. [46473.961212] md: md0: recovery done. [46474.340743] RAID5 conf printout: [46474.341668] --- rd:3 wd:2 [46474.342530] disk 0, o:1, dev:sde1 [46474.343373] disk 1, o:1, dev:sdf1 [46474.344214] disk 2, o:0, dev:sdh1 [46474.364763] md: recovery of RAID array md0 [46474.365648] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.366499] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.367396] md: using 128k window, over a total of 1465135936 blocks. [46474.368299] md: resuming recovery of md0 from checkpoint. [46474.369203] md: md0: recovery done. [46474.388740] RAID5 conf printout: [46474.389651] --- rd:3 wd:2 [46474.390507] disk 0, o:1, dev:sde1 [46474.391360] disk 1, o:1, dev:sdf1 [46474.392199] disk 2, o:0, dev:sdh1 [46474.412716] md: recovery of RAID array md0 [46474.413575] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.414440] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.415352] md: using 128k window, over a total of 1465135936 blocks. [46474.416263] md: resuming recovery of md0 from checkpoint. [46474.417168] md: md0: recovery done. [46474.436765] RAID5 conf printout: [46474.437675] --- rd:3 wd:2 [46474.438524] disk 0, o:1, dev:sde1 [46474.439365] disk 1, o:1, dev:sdf1 [46474.440215] disk 2, o:0, dev:sdh1 [46474.460773] md: recovery of RAID array md0 [46474.461638] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.462492] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.463403] md: using 128k window, over a total of 1465135936 blocks. [46474.464316] md: resuming recovery of md0 from checkpoint. [46474.465215] md: md0: recovery done. [46474.484680] RAID5 conf printout: [46474.485598] --- rd:3 wd:2 [46474.486448] disk 0, o:1, dev:sde1 [46474.487285] disk 1, o:1, dev:sdf1 [46474.488115] disk 2, o:0, dev:sdh1 [46474.508778] md: recovery of RAID array md0 [46474.509659] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.510514] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.511417] md: using 128k window, over a total of 1465135936 blocks. [46474.512323] md: resuming recovery of md0 from checkpoint. [46474.513241] md: md0: recovery done. [46474.532682] RAID5 conf printout: [46474.533588] --- rd:3 wd:2 [46474.534446] disk 0, o:1, dev:sde1 [46474.535286] disk 1, o:1, dev:sdf1 [46474.536116] disk 2, o:0, dev:sdh1 [46474.556779] md: recovery of RAID array md0 [46474.557655] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.558507] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.559408] md: using 128k window, over a total of 1465135936 blocks. [46474.560311] md: resuming recovery of md0 from checkpoint. [46474.561213] md: md0: recovery done. [46474.580739] RAID5 conf printout: [46474.581668] --- rd:3 wd:2 [46474.582522] disk 0, o:1, dev:sde1 [46474.583364] disk 1, o:1, dev:sdf1 [46474.584204] disk 2, o:0, dev:sdh1 [46474.604767] md: recovery of RAID array md0 [46474.605649] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.606497] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.607396] md: using 128k window, over a total of 1465135936 blocks. [46474.608300] md: resuming recovery of md0 from checkpoint. [46474.609204] md: md0: recovery done. [46474.628685] RAID5 conf printout: [46474.629597] --- rd:3 wd:2 [46474.630451] disk 0, o:1, dev:sde1 [46474.631306] disk 1, o:1, dev:sdf1 [46474.632139] disk 2, o:0, dev:sdh1 [46474.652705] md: recovery of RAID array md0 [46474.653581] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.654442] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.655347] md: using 128k window, over a total of 1465135936 blocks. [46474.656252] md: resuming recovery of md0 from checkpoint. [46474.657157] md: md0: recovery done. [46474.676677] RAID5 conf printout: [46474.677595] --- rd:3 wd:2 [46474.678439] disk 0, o:1, dev:sde1 [46474.679274] disk 1, o:1, dev:sdf1 [46474.680113] disk 2, o:0, dev:sdh1 [46474.700756] md: recovery of RAID array md0 [46474.701642] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.702506] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.703414] md: using 128k window, over a total of 1465135936 blocks. [46474.704328] md: resuming recovery of md0 from checkpoint. [46474.705238] md: md0: recovery done. [46474.724729] RAID5 conf printout: [46474.725654] --- rd:3 wd:2 [46474.726499] disk 0, o:1, dev:sde1 [46474.727337] disk 1, o:1, dev:sdf1 [46474.728168] disk 2, o:0, dev:sdh1 [46474.760763] md: recovery of RAID array md0 [46474.761644] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.762496] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.763406] md: using 128k window, over a total of 1465135936 blocks. [46474.764320] md: resuming recovery of md0 from checkpoint. [46474.765233] md: md0: recovery done. [46474.784728] RAID5 conf printout: [46474.785644] --- rd:3 wd:2 [46474.786491] disk 0, o:1, dev:sde1 [46474.787328] disk 1, o:1, dev:sdf1 [46474.788160] disk 2, o:0, dev:sdh1 [46474.808759] md: recovery of RAID array md0 [46474.809644] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.810496] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.811397] md: using 128k window, over a total of 1465135936 blocks. [46474.812303] md: resuming recovery of md0 from checkpoint. [46474.813220] md: md0: recovery done. [46474.832674] RAID5 conf printout: [46474.833578] --- rd:3 wd:2 [46474.834442] disk 0, o:1, dev:sde1 [46474.834444] disk 1, o:1, dev:sdf1 [46474.834445] disk 2, o:0, dev:sdh1 [46474.856785] md: recovery of RAID array md0 [46474.857649] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.858501] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.859398] md: using 128k window, over a total of 1465135936 blocks. [46474.860302] md: resuming recovery of md0 from checkpoint. [46474.861204] md: md0: recovery done. [46474.880734] RAID5 conf printout: [46474.881675] --- rd:3 wd:2 [46474.882526] disk 0, o:1, dev:sde1 [46474.883364] disk 1, o:1, dev:sdf1 [46474.884201] disk 2, o:0, dev:sdh1 [46474.904770] md: recovery of RAID array md0 [46474.905656] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.906507] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.907404] md: using 128k window, over a total of 1465135936 blocks. [46474.908307] md: resuming recovery of md0 from checkpoint. [46474.909208] md: md0: recovery done. [46474.928740] RAID5 conf printout: [46474.929656] --- rd:3 wd:2 [46474.930513] disk 0, o:1, dev:sde1 [46474.931374] disk 1, o:1, dev:sdf1 [46474.932211] disk 2, o:0, dev:sdh1 [46474.952711] md: recovery of RAID array md0 [46474.953578] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46474.954486] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46474.955385] md: using 128k window, over a total of 1465135936 blocks. [46474.956287] md: resuming recovery of md0 from checkpoint. [46474.957187] md: md0: recovery done. [46474.976675] RAID5 conf printout: [46474.977589] --- rd:3 wd:2 [46474.978432] disk 0, o:1, dev:sde1 [46474.979265] disk 1, o:1, dev:sdf1 [46474.980103] disk 2, o:0, dev:sdh1 [46475.504788] md: recovery of RAID array md0 [46475.505664] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46475.506515] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46475.507414] md: using 128k window, over a total of 1465135936 blocks. [46475.508320] md: resuming recovery of md0 from checkpoint. [46475.509221] md: md0: recovery done. [46475.549325] RAID5 conf printout: [46475.550240] --- rd:3 wd:2 [46475.551083] disk 0, o:1, dev:sde1 [46475.551956] disk 1, o:1, dev:sdf1 [46475.552800] disk 2, o:0, dev:sdh1 [46475.576713] md: recovery of RAID array md0 [46475.577595] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46475.578448] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46475.579349] md: using 128k window, over a total of 1465135936 blocks. [46475.580254] md: resuming recovery of md0 from checkpoint. [46475.581158] md: md0: recovery done. [46475.612682] RAID5 conf printout: [46475.613587] --- rd:3 wd:2 [46475.614445] disk 0, o:1, dev:sde1 [46475.615287] disk 1, o:1, dev:sdf1 [46475.616119] disk 2, o:0, dev:sdh1 [46475.636716] md: recovery of RAID array md0 [46475.637604] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46475.638455] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46475.639357] md: using 128k window, over a total of 1465135936 blocks. [46475.640263] md: resuming recovery of md0 from checkpoint. [46475.641166] md: md0: recovery done. [46475.660665] RAID5 conf printout: [46475.661570] --- rd:3 wd:2 [46475.662420] disk 0, o:1, dev:sde1 [46475.663270] disk 1, o:1, dev:sdf1 [46475.664122] disk 2, o:0, dev:sdh1 [46475.684761] md: recovery of RAID array md0 [46475.685670] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46475.686523] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46475.687423] md: using 128k window, over a total of 1465135936 blocks. [46475.688328] md: resuming recovery of md0 from checkpoint. [46475.689232] md: md0: recovery done. [46475.708733] RAID5 conf printout: [46475.709649] --- rd:3 wd:2 [46475.710504] disk 0, o:1, dev:sde1 [46475.711360] disk 1, o:1, dev:sdf1 [46475.712199] disk 2, o:0, dev:sdh1 [46475.732708] md: recovery of RAID array md0 [46475.733586] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46475.734449] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46475.735356] md: using 128k window, over a total of 1465135936 blocks. [46475.736260] md: resuming recovery of md0 from checkpoint. [46475.737162] md: md0: recovery done. [46475.756736] RAID5 conf printout: [46475.757649] --- rd:3 wd:2 [46475.758495] disk 0, o:1, dev:sde1 [46475.759334] disk 1, o:1, dev:sdf1 [46475.760177] disk 2, o:0, dev:sdh1 [46475.780772] md: recovery of RAID array md0 [46475.781656] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46475.782503] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46475.783414] md: using 128k window, over a total of 1465135936 blocks. [46475.784325] md: resuming recovery of md0 from checkpoint. [46475.785234] md: md0: recovery done. [46476.125295] RAID5 conf printout: [46476.126198] --- rd:3 wd:2 [46476.127057] disk 0, o:1, dev:sde1 [46476.127896] disk 1, o:1, dev:sdf1 [46476.128735] disk 2, o:0, dev:sdh1 [46476.401436] md: recovery of RAID array md0 [46476.402316] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.403178] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.404086] md: using 128k window, over a total of 1465135936 blocks. [46476.404999] md: resuming recovery of md0 from checkpoint. [46476.405902] md: md0: recovery done. [46476.452680] RAID5 conf printout: [46476.453584] --- rd:3 wd:2 [46476.454438] disk 0, o:1, dev:sde1 [46476.455278] disk 1, o:1, dev:sdf1 [46476.456108] disk 2, o:0, dev:sdh1 [46476.476708] md: recovery of RAID array md0 [46476.477597] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.478445] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.479345] md: using 128k window, over a total of 1465135936 blocks. [46476.480246] md: resuming recovery of md0 from checkpoint. [46476.481146] md: md0: recovery done. [46476.500721] RAID5 conf printout: [46476.501661] --- rd:3 wd:2 [46476.502512] disk 0, o:1, dev:sde1 [46476.503354] disk 1, o:1, dev:sdf1 [46476.504193] disk 2, o:0, dev:sdh1 [46476.524746] md: recovery of RAID array md0 [46476.525628] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.526480] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.527377] md: using 128k window, over a total of 1465135936 blocks. [46476.528280] md: resuming recovery of md0 from checkpoint. [46476.529179] md: md0: recovery done. [46476.548665] RAID5 conf printout: [46476.549554] --- rd:3 wd:2 [46476.550405] disk 0, o:1, dev:sde1 [46476.551239] disk 1, o:1, dev:sdf1 [46476.552087] disk 2, o:0, dev:sdh1 [46476.572707] md: recovery of RAID array md0 [46476.573576] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.574433] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.575337] md: using 128k window, over a total of 1465135936 blocks. [46476.576238] md: resuming recovery of md0 from checkpoint. [46476.577139] md: md0: recovery done. [46476.596730] RAID5 conf printout: [46476.597641] --- rd:3 wd:2 [46476.598486] disk 0, o:1, dev:sde1 [46476.599330] disk 1, o:1, dev:sdf1 [46476.600167] disk 2, o:0, dev:sdh1 [46476.620762] md: recovery of RAID array md0 [46476.621638] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.622485] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.623392] md: using 128k window, over a total of 1465135936 blocks. [46476.624299] md: resuming recovery of md0 from checkpoint. [46476.625203] md: md0: recovery done. [46476.644729] RAID5 conf printout: [46476.645640] --- rd:3 wd:2 [46476.646484] disk 0, o:1, dev:sde1 [46476.647322] disk 1, o:1, dev:sdf1 [46476.648152] disk 2, o:0, dev:sdh1 [46476.668700] md: recovery of RAID array md0 [46476.669580] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.670430] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.671326] md: using 128k window, over a total of 1465135936 blocks. [46476.672228] md: resuming recovery of md0 from checkpoint. [46476.673139] md: md0: recovery done. [46476.692666] RAID5 conf printout: [46476.693570] --- rd:3 wd:2 [46476.694422] disk 0, o:1, dev:sde1 [46476.695258] disk 1, o:1, dev:sdf1 [46476.696087] disk 2, o:0, dev:sdh1 [46476.716760] md: recovery of RAID array md0 [46476.717642] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.718528] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.719427] md: using 128k window, over a total of 1465135936 blocks. [46476.720331] md: resuming recovery of md0 from checkpoint. [46476.721235] md: md0: recovery done. [46476.740722] RAID5 conf printout: [46476.741654] --- rd:3 wd:2 [46476.742508] disk 0, o:1, dev:sde1 [46476.743351] disk 1, o:1, dev:sdf1 [46476.744193] disk 2, o:0, dev:sdh1 [46476.776698] md: recovery of RAID array md0 [46476.777580] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.778431] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.779330] md: using 128k window, over a total of 1465135936 blocks. [46476.780236] md: resuming recovery of md0 from checkpoint. [46476.781138] md: md0: recovery done. [46476.800731] RAID5 conf printout: [46476.801661] --- rd:3 wd:2 [46476.802521] disk 0, o:1, dev:sde1 [46476.803374] disk 1, o:1, dev:sdf1 [46476.804216] disk 2, o:0, dev:sdh1 [46476.824761] md: recovery of RAID array md0 [46476.825642] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.826492] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.827389] md: using 128k window, over a total of 1465135936 blocks. [46476.828290] md: resuming recovery of md0 from checkpoint. [46476.829192] md: md0: recovery done. [46476.860801] RAID5 conf printout: [46476.861726] --- rd:3 wd:2 [46476.862598] disk 0, o:1, dev:sde1 [46476.863433] disk 1, o:1, dev:sdf1 [46476.864276] disk 2, o:0, dev:sdh1 [46476.884779] md: recovery of RAID array md0 [46476.885660] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.886510] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.887408] md: using 128k window, over a total of 1465135936 blocks. [46476.888312] md: resuming recovery of md0 from checkpoint. [46476.889216] md: md0: recovery done. [46476.908731] RAID5 conf printout: [46476.909643] --- rd:3 wd:2 [46476.910497] disk 0, o:1, dev:sde1 [46476.911366] disk 1, o:1, dev:sdf1 [46476.912202] disk 2, o:0, dev:sdh1 [46476.932706] md: recovery of RAID array md0 [46476.933583] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.934442] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.935344] md: using 128k window, over a total of 1465135936 blocks. [46476.936247] md: resuming recovery of md0 from checkpoint. [46476.937150] md: md0: recovery done. [46476.956728] RAID5 conf printout: [46476.957642] --- rd:3 wd:2 [46476.958488] disk 0, o:1, dev:sde1 [46476.959327] disk 1, o:1, dev:sdf1 [46476.960169] disk 2, o:0, dev:sdh1 [46476.980767] md: recovery of RAID array md0 [46476.981647] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46476.982493] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46476.983403] md: using 128k window, over a total of 1465135936 blocks. [46476.984313] md: resuming recovery of md0 from checkpoint. [46476.985220] md: md0: recovery done. [46477.016654] RAID5 conf printout: [46477.017571] --- rd:3 wd:2 [46477.018425] disk 0, o:1, dev:sde1 [46477.019262] disk 1, o:1, dev:sdf1 [46477.020102] disk 2, o:0, dev:sdh1 [46477.040753] md: recovery of RAID array md0 [46477.041636] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.042485] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.043391] md: using 128k window, over a total of 1465135936 blocks. [46477.044310] md: resuming recovery of md0 from checkpoint. [46477.045216] md: md0: recovery done. [46477.064715] RAID5 conf printout: [46477.065632] --- rd:3 wd:2 [46477.066476] disk 0, o:1, dev:sde1 [46477.067312] disk 1, o:1, dev:sdf1 [46477.068151] disk 2, o:0, dev:sdh1 [46477.088748] md: recovery of RAID array md0 [46477.089631] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.090483] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.091384] md: using 128k window, over a total of 1465135936 blocks. [46477.092289] md: resuming recovery of md0 from checkpoint. [46477.093201] md: md0: recovery done. [46477.112681] RAID5 conf printout: [46477.113585] --- rd:3 wd:2 [46477.114438] disk 0, o:1, dev:sde1 [46477.115286] disk 1, o:1, dev:sdf1 [46477.116116] disk 2, o:0, dev:sdh1 [46477.136768] md: recovery of RAID array md0 [46477.137647] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.138497] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.139395] md: using 128k window, over a total of 1465135936 blocks. [46477.140300] md: resuming recovery of md0 from checkpoint. [46477.141204] md: md0: recovery done. [46477.160723] RAID5 conf printout: [46477.161652] --- rd:3 wd:2 [46477.162506] disk 0, o:1, dev:sde1 [46477.163349] disk 1, o:1, dev:sdf1 [46477.164191] disk 2, o:0, dev:sdh1 [46477.184749] md: recovery of RAID array md0 [46477.185636] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.186487] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.187385] md: using 128k window, over a total of 1465135936 blocks. [46477.188288] md: resuming recovery of md0 from checkpoint. [46477.189192] md: md0: recovery done. [46477.208675] RAID5 conf printout: [46477.209590] --- rd:3 wd:2 [46477.210458] disk 0, o:1, dev:sde1 [46477.211317] disk 1, o:1, dev:sdf1 [46477.212155] disk 2, o:0, dev:sdh1 [46477.232691] md: recovery of RAID array md0 [46477.233570] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.234434] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.235341] md: using 128k window, over a total of 1465135936 blocks. [46477.236248] md: resuming recovery of md0 from checkpoint. [46477.237155] md: md0: recovery done. [46477.256724] RAID5 conf printout: [46477.257637] --- rd:3 wd:2 [46477.258482] disk 0, o:1, dev:sde1 [46477.259321] disk 1, o:1, dev:sdf1 [46477.260165] disk 2, o:0, dev:sdh1 [46477.280742] md: recovery of RAID array md0 [46477.281630] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.282480] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.283390] md: using 128k window, over a total of 1465135936 blocks. [46477.284308] md: resuming recovery of md0 from checkpoint. [46477.285214] md: md0: recovery done. [46477.304721] RAID5 conf printout: [46477.305637] --- rd:3 wd:2 [46477.306483] disk 0, o:1, dev:sde1 [46477.307323] disk 1, o:1, dev:sdf1 [46477.308152] disk 2, o:0, dev:sdh1 [46477.328755] md: recovery of RAID array md0 [46477.329641] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.330491] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.331389] md: using 128k window, over a total of 1465135936 blocks. [46477.332292] md: resuming recovery of md0 from checkpoint. [46477.333205] md: md0: recovery done. [46477.352678] RAID5 conf printout: [46477.353580] --- rd:3 wd:2 [46477.354436] disk 0, o:1, dev:sde1 [46477.355272] disk 1, o:1, dev:sdf1 [46477.356104] disk 2, o:0, dev:sdh1 [46477.376771] md: recovery of RAID array md0 [46477.377648] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.378499] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.379399] md: using 128k window, over a total of 1465135936 blocks. [46477.380303] md: resuming recovery of md0 from checkpoint. [46477.381205] md: md0: recovery done. [46477.400725] RAID5 conf printout: [46477.401648] --- rd:3 wd:2 [46477.402498] disk 0, o:1, dev:sde1 [46477.403345] disk 1, o:1, dev:sdf1 [46477.404184] disk 2, o:0, dev:sdh1 [46477.424740] md: recovery of RAID array md0 [46477.425624] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.426472] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.427370] md: using 128k window, over a total of 1465135936 blocks. [46477.428273] md: resuming recovery of md0 from checkpoint. [46477.429174] md: md0: recovery done. [46477.448723] RAID5 conf printout: [46477.449634] --- rd:3 wd:2 [46477.450485] disk 0, o:1, dev:sde1 [46477.451336] disk 1, o:1, dev:sdf1 [46477.452171] disk 2, o:0, dev:sdh1 [46477.472690] md: recovery of RAID array md0 [46477.473566] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.474424] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.475327] md: using 128k window, over a total of 1465135936 blocks. [46477.476228] md: resuming recovery of md0 from checkpoint. [46477.477129] md: md0: recovery done. [46477.496672] RAID5 conf printout: [46477.497586] --- rd:3 wd:2 [46477.498433] disk 0, o:1, dev:sde1 [46477.499269] disk 1, o:1, dev:sdf1 [46477.500122] disk 2, o:0, dev:sdh1 [46477.520754] md: recovery of RAID array md0 [46477.521636] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.522488] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.523398] md: using 128k window, over a total of 1465135936 blocks. [46477.524311] md: resuming recovery of md0 from checkpoint. [46477.525221] md: md0: recovery done. [46477.544650] RAID5 conf printout: [46477.545569] --- rd:3 wd:2 [46477.546413] disk 0, o:1, dev:sde1 [46477.547250] disk 1, o:1, dev:sdf1 [46477.548078] disk 2, o:0, dev:sdh1 [46477.568698] md: recovery of RAID array md0 [46477.569580] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.570429] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.571329] md: using 128k window, over a total of 1465135936 blocks. [46477.572229] md: resuming recovery of md0 from checkpoint. [46477.573138] md: md0: recovery done. [46477.592656] RAID5 conf printout: [46477.593563] --- rd:3 wd:2 [46477.594416] disk 0, o:1, dev:sde1 [46477.595253] disk 1, o:1, dev:sdf1 [46477.596085] disk 2, o:0, dev:sdh1 [46477.628758] md: recovery of RAID array md0 [46477.629641] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.630494] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.631390] md: using 128k window, over a total of 1465135936 blocks. [46477.632296] md: resuming recovery of md0 from checkpoint. [46477.633210] md: md0: recovery done. [46477.664720] RAID5 conf printout: [46477.665632] --- rd:3 wd:2 [46477.666475] disk 0, o:1, dev:sde1 [46477.667324] disk 1, o:1, dev:sdf1 [46477.668152] disk 2, o:0, dev:sdh1 [46477.688750] md: recovery of RAID array md0 [46477.689629] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.690479] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.691376] md: using 128k window, over a total of 1465135936 blocks. [46477.692277] md: resuming recovery of md0 from checkpoint. [46477.693189] md: md0: recovery done. [46477.712676] RAID5 conf printout: [46477.713576] --- rd:3 wd:2 [46477.714429] disk 0, o:1, dev:sde1 [46477.715266] disk 1, o:1, dev:sdf1 [46477.716094] disk 2, o:0, dev:sdh1 [46477.736710] md: recovery of RAID array md0 [46477.737589] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.738437] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.739334] md: using 128k window, over a total of 1465135936 blocks. [46477.740237] md: resuming recovery of md0 from checkpoint. [46477.741137] md: md0: recovery done. [46477.760647] RAID5 conf printout: [46477.761569] --- rd:3 wd:2 [46477.762432] disk 0, o:1, dev:sde1 [46477.763278] disk 1, o:1, dev:sdf1 [46477.764120] disk 2, o:0, dev:sdh1 [46477.784746] md: recovery of RAID array md0 [46477.785629] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.786479] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.787377] md: using 128k window, over a total of 1465135936 blocks. [46477.788278] md: resuming recovery of md0 from checkpoint. [46477.789175] md: md0: recovery done. [46477.808662] RAID5 conf printout: [46477.809579] --- rd:3 wd:2 [46477.810434] disk 0, o:1, dev:sde1 [46477.811287] disk 1, o:1, dev:sdf1 [46477.812123] disk 2, o:0, dev:sdh1 [46477.832711] md: recovery of RAID array md0 [46477.833587] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.834448] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.835353] md: using 128k window, over a total of 1465135936 blocks. [46477.835354] md: resuming recovery of md0 from checkpoint. [46477.835355] md: md0: recovery done. [46477.856723] RAID5 conf printout: [46477.857637] --- rd:3 wd:2 [46477.858475] disk 0, o:1, dev:sde1 [46477.859311] disk 1, o:1, dev:sdf1 [46477.860145] disk 2, o:0, dev:sdh1 [46477.880750] md: recovery of RAID array md0 [46477.881646] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.882495] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.883401] md: using 128k window, over a total of 1465135936 blocks. [46477.884312] md: resuming recovery of md0 from checkpoint. [46477.885215] md: md0: recovery done. [46477.904729] RAID5 conf printout: [46477.905627] --- rd:3 wd:2 [46477.906470] disk 0, o:1, dev:sde1 [46477.907307] disk 1, o:1, dev:sdf1 [46477.908137] disk 2, o:0, dev:sdh1 [46477.928761] md: recovery of RAID array md0 [46477.929644] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.930492] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.931390] md: using 128k window, over a total of 1465135936 blocks. [46477.932292] md: resuming recovery of md0 from checkpoint. [46477.933203] md: md0: recovery done. [46477.952673] RAID5 conf printout: [46477.953584] --- rd:3 wd:2 [46477.954439] disk 0, o:1, dev:sde1 [46477.955273] disk 1, o:1, dev:sdf1 [46477.956124] disk 2, o:0, dev:sdh1 [46477.976768] md: recovery of RAID array md0 [46477.977643] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46477.978492] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46477.979389] md: using 128k window, over a total of 1465135936 blocks. [46477.980291] md: resuming recovery of md0 from checkpoint. [46477.981190] md: md0: recovery done. [46478.480720] RAID5 conf printout: [46478.481647] --- rd:3 wd:2 [46478.482500] disk 0, o:1, dev:sde1 [46478.483337] disk 1, o:1, dev:sdf1 [46478.484175] disk 2, o:0, dev:sdh1 [46478.513352] md: recovery of RAID array md0 [46478.514248] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46478.515101] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46478.515998] md: using 128k window, over a total of 1465135936 blocks. [46478.516903] md: resuming recovery of md0 from checkpoint. [46478.517807] md: md0: recovery done. [46478.540720] RAID5 conf printout: [46478.541649] --- rd:3 wd:2 [46478.542506] disk 0, o:1, dev:sde1 [46478.543351] disk 1, o:1, dev:sdf1 [46478.544193] disk 2, o:0, dev:sdh1 [46478.564757] md: recovery of RAID array md0 [46478.565638] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46478.566491] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46478.567389] md: using 128k window, over a total of 1465135936 blocks. [46478.568294] md: resuming recovery of md0 from checkpoint. [46478.569198] md: md0: recovery done. [46478.588717] RAID5 conf printout: [46478.589632] --- rd:3 wd:2 [46478.590486] disk 0, o:1, dev:sde1 [46478.591340] disk 1, o:1, dev:sdf1 [46478.592179] disk 2, o:0, dev:sdh1 [46478.612701] md: recovery of RAID array md0 [46478.613582] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46478.614449] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46478.615357] md: using 128k window, over a total of 1465135936 blocks. [46478.616263] md: resuming recovery of md0 from checkpoint. [46478.617167] md: md0: recovery done. [46478.636718] RAID5 conf printout: [46478.637634] --- rd:3 wd:2 [46478.638481] disk 0, o:1, dev:sde1 [46478.639323] disk 1, o:1, dev:sdf1 [46478.640168] disk 2, o:0, dev:sdh1 [46478.660695] md: recovery of RAID array md0 [46478.661581] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46478.662434] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46478.663348] md: using 128k window, over a total of 1465135936 blocks. [46478.664264] md: resuming recovery of md0 from checkpoint. [46478.665177] md: md0: recovery done. [46478.684659] RAID5 conf printout: [46478.685580] --- rd:3 wd:2 [46478.686440] disk 0, o:1, dev:sde1 [46478.687279] disk 1, o:1, dev:sdf1 [46478.688113] disk 2, o:0, dev:sdh1 [46478.960746] md: recovery of RAID array md0 [46478.961630] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46478.962501] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46478.963413] md: using 128k window, over a total of 1465135936 blocks. [46478.964328] md: resuming recovery of md0 from checkpoint. [46478.965275] md: md0: recovery done. [46479.248717] RAID5 conf printout: [46479.249635] --- rd:3 wd:2 [46479.250484] disk 0, o:1, dev:sde1 [46479.251350] disk 1, o:1, dev:sdf1 [46479.252196] disk 2, o:0, dev:sdh1 [46479.272742] md: recovery of RAID array md0 [46479.273633] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46479.274497] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46479.275403] md: using 128k window, over a total of 1465135936 blocks. [46479.276311] md: resuming recovery of md0 from checkpoint. [46479.277217] md: md0: recovery done. [46479.296658] RAID5 conf printout: [46479.297577] --- rd:3 wd:2 [46479.298424] disk 0, o:1, dev:sde1 [46479.299269] disk 1, o:1, dev:sdf1 [46479.300114] disk 2, o:0, dev:sdh1 [46479.320740] md: recovery of RAID array md0 [46479.321626] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46479.322483] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46479.323393] md: using 128k window, over a total of 1465135936 blocks. [46479.324312] md: resuming recovery of md0 from checkpoint. [46479.325221] md: md0: recovery done. [46479.344712] RAID5 conf printout: [46479.345632] --- rd:3 wd:2 [46479.346479] disk 0, o:1, dev:sde1 [46479.347317] disk 1, o:1, dev:sdf1 [46479.348151] disk 2, o:0, dev:sdh1 [46479.368671] md: recovery of RAID array md0 [46479.369559] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46479.370413] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46479.371315] md: using 128k window, over a total of 1465135936 blocks. [46479.372225] md: resuming recovery of md0 from checkpoint. [46479.373139] md: md0: recovery done. [46479.392672] RAID5 conf printout: [46479.393576] --- rd:3 wd:2 [46479.394432] disk 0, o:1, dev:sde1 [46479.395268] disk 1, o:1, dev:sdf1 [46479.396099] disk 2, o:0, dev:sdh1 [46479.416744] md: recovery of RAID array md0 [46479.417644] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46479.418498] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46479.419402] md: using 128k window, over a total of 1465135936 blocks. [46479.420310] md: resuming recovery of md0 from checkpoint. [46479.421211] md: md0: recovery done. [46479.440714] RAID5 conf printout: [46479.441642] --- rd:3 wd:2 [46479.442492] disk 0, o:1, dev:sde1 [46479.443344] disk 1, o:1, dev:sdf1 [46479.444186] disk 2, o:0, dev:sdh1 [46479.464751] md: recovery of RAID array md0 [46479.465632] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46479.466482] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46479.467383] md: using 128k window, over a total of 1465135936 blocks. [46479.468285] md: resuming recovery of md0 from checkpoint. [46479.469187] md: md0: recovery done. [46479.488711] RAID5 conf printout: [46479.489621] --- rd:3 wd:2 [46479.490483] disk 0, o:1, dev:sde1 [46479.491333] disk 1, o:1, dev:sdf1 [46479.492168] disk 2, o:0, dev:sdh1 [46479.512696] md: recovery of RAID array md0 [46479.513572] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46479.514428] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46479.515331] md: using 128k window, over a total of 1465135936 blocks. [46479.516233] md: resuming recovery of md0 from checkpoint. [46479.517130] md: md0: recovery done. [46479.536657] RAID5 conf printout: [46479.537573] --- rd:3 wd:2 [46479.538414] disk 0, o:1, dev:sde1 [46479.539253] disk 1, o:1, dev:sdf1 [46479.540093] disk 2, o:0, dev:sdh1 [46479.560726] md: recovery of RAID array md0 [46479.561609] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46479.562460] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46479.563367] md: using 128k window, over a total of 1465135936 blocks. [46479.564283] md: resuming recovery of md0 from checkpoint. [46479.565189] md: md0: recovery done. [46479.584710] RAID5 conf printout: [46479.585622] --- rd:3 wd:2 [46479.586486] disk 0, o:1, dev:sde1 [46479.587322] disk 1, o:1, dev:sdf1 [46479.588152] disk 2, o:0, dev:sdh1 [46479.608732] md: recovery of RAID array md0 [46479.609615] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46479.610467] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46479.611363] md: using 128k window, over a total of 1465135936 blocks. [46479.612265] md: resuming recovery of md0 from checkpoint. [46479.613177] md: md0: recovery done. [46479.632675] RAID5 conf printout: [46479.633575] --- rd:3 wd:2 [46479.634428] disk 0, o:1, dev:sde1 [46479.635263] disk 1, o:1, dev:sdf1 [46479.636092] disk 2, o:0, dev:sdh1 [46480.040112] ata7.00: exception Emask 0x0 SAct 0x0 SErr 0x0 action 0x6 frozen [46480.041041] ata7.00: failed command: READ DMA [46480.041916] ata7.00: cmd c8/00:08:3f:b2:a6/00:00:00:00:00/e9 tag 0 dma 4096 in [46480.041917] res 40/00:ff:00:00:00/00:00:00:00:00/40 Emask 0x4 (timeout) [46480.043728] ata7.00: status: { DRDY } [46480.044632] ata7: hard resetting link [46480.045500] ata7: nv: skipping hardreset on occupied port [46480.076694] md: recovery of RAID array md0 [46480.077583] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46480.078447] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46480.079352] md: using 128k window, over a total of 1465135936 blocks. [46480.080265] md: resuming recovery of md0 from checkpoint. [46480.081185] md: md0: recovery done. [46480.304710] RAID5 conf printout: [46480.305705] --- rd:3 wd:2 [46480.306637] disk 0, o:1, dev:sde1 [46480.307570] disk 1, o:1, dev:sdf1 [46480.308463] disk 2, o:0, dev:sdh1 [46480.328736] md: recovery of RAID array md0 [46480.329646] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46480.330506] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46480.331408] md: using 128k window, over a total of 1465135936 blocks. [46480.332319] md: resuming recovery of md0 from checkpoint. [46480.333249] md: md0: recovery done. [46480.352637] RAID5 conf printout: [46480.353619] --- rd:3 wd:2 [46480.354569] disk 0, o:1, dev:sde1 [46480.355489] disk 1, o:1, dev:sdf1 [46480.356379] disk 2, o:0, dev:sdh1 [46480.376736] md: recovery of RAID array md0 [46480.377640] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46480.378501] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46480.379403] md: using 128k window, over a total of 1465135936 blocks. [46480.380315] md: resuming recovery of md0 from checkpoint. [46480.381232] md: md0: recovery done. [46480.400709] RAID5 conf printout: [46480.401711] --- rd:3 wd:2 [46480.402655] disk 0, o:1, dev:sde1 [46480.403589] disk 1, o:1, dev:sdf1 [46480.404490] disk 2, o:0, dev:sdh1 [46480.424735] md: recovery of RAID array md0 [46480.425645] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46480.426504] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46480.427403] md: using 128k window, over a total of 1465135936 blocks. [46480.428315] md: resuming recovery of md0 from checkpoint. [46480.429234] md: md0: recovery done. [46480.448652] RAID5 conf printout: [46480.449643] --- rd:3 wd:2 [46480.450568] disk 0, o:1, dev:sde1 [46480.451484] disk 1, o:1, dev:sdf1 [46480.452374] disk 2, o:0, dev:sdh1 [46480.472673] md: recovery of RAID array md0 [46480.473576] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46480.474454] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46480.475360] md: using 128k window, over a total of 1465135936 blocks. [46480.476261] md: resuming recovery of md0 from checkpoint. [46480.477162] md: md0: recovery done. [46480.496653] RAID5 conf printout: [46480.497565] --- rd:3 wd:2 [46480.498407] disk 0, o:1, dev:sde1 [46480.499244] disk 1, o:1, dev:sdf1 [46480.500087] disk 2, o:0, dev:sdh1 [46480.520737] md: recovery of RAID array md0 [46480.521614] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46480.522459] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46480.523369] md: using 128k window, over a total of 1465135936 blocks. [46480.524279] md: resuming recovery of md0 from checkpoint. [46480.525183] md: md0: recovery done. [46480.533811] ata7: SATA link up 3.0 Gbps (SStatus 123 SControl 300) [46480.544707] RAID5 conf printout: [46480.545627] --- rd:3 wd:2 [46480.546485] disk 0, o:1, dev:sde1 [46480.547347] disk 1, o:1, dev:sdf1 [46480.548200] disk 2, o:0, dev:sdh1 [46480.568724] md: recovery of RAID array md0 [46480.569640] md: minimum _guaranteed_ speed: 1000 KB/sec/disk. [46480.570523] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery. [46480.571454] md: using 128k window, over a total of 1465135936 blocks. [46480.572374] md: resuming recovery of md0 from checkpoint. [46480.573285] md: md0: recovery done. [46480.594022] ata7.00: configured for UDMA/33 [46480.594901] ata7.00: device reported invalid CHS sector 0 [46480.595776] sd 7:0:0:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE [46480.596675] sd 7:0:0:0: [sdh] Sense Key : Aborted Command [current] [descriptor] [46480.597599] Descriptor sense data with sense descriptors (in hex): [46480.598526] 72 0b 00 00 00 00 00 0c 00 0a 80 00 00 00 00 00 [46480.599507] 00 00 00 00 [46480.600481] sd 7:0:0:0: [sdh] Add. Sense: No additional sense information [46480.601476] sd 7:0:0:0: [sdh] CDB: Read(10): 28 00 09 a6 b2 3f 00 00 08 00 [46480.602479] end_request: I/O error, dev sdh, sector 161919551 [46480.603457] ata7: EH complete [46481.033272] RAID5 conf printout: [46481.034264] --- rd:3 wd:2 [46481.035180] disk 0, o:1, dev:sde1 [46481.036100] disk 1, o:1, dev:sdf1 [46481.037023] disk 2, o:0, dev:sdh1 [46481.168777] RAID5 conf printout: [46481.169731] --- rd:3 wd:2 [46481.170643] disk 0, o:1, dev:sde1 [46481.171590] disk 1, o:1, dev:sdf1 [46481.172511] disk 2, o:0, dev:sdh1 [46481.211348] RAID5 conf printout: [46481.212243] --- rd:3 wd:2 [46481.213082] disk 0, o:1, dev:sde1 [46481.213917] disk 1, o:1, dev:sdf1 root@downtown:/home/alf# cat /proc/mdstat Personalities : [raid6] [raid5] [raid4] [linear] [multipath] [raid0] [raid1] [raid10] md4 : active raid5 sdc1[2] sdd1[1] sdb1[0] 1953519872 blocks level 5, 64k chunk, algorithm 2 [3/3] [UUU] md1 : active raid5 sdk1[2] sdi1[3](F) sdj1[1] 2930269824 blocks level 5, 64k chunk, algorithm 2 [3/2] [_UU] md0 : active raid5 sdh1[3](F) sdf1[1] sde1[0] 2930271872 blocks level 5, 64k chunk, algorithm 2 [3/2] [UU_]