Az LVM parancsok nem adnak vissza eredményt...

Ubuntu Linux

Az alábbi kimenetből tud valaki következtetni, hogy miért nem futnak le a pvs és vgs parancsok? (lvs jól lefut)

# pvs -v
Scanning for physical volume names
Wiping cache of LVM-capable devices
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
There are 1 physical volumes missing.

... ez nem fut végig, csak a kill segít rajta

# vgs -v
Finding all volume groups
Finding volume group "storage01"

... ez sem fut végig, kill...

# lvs
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
boot nova01-sys -wi-ao 244.00m
home nova01-sys -wi-ao 4.66g
root nova01-sys -wi-ao 4.66g
swap nova01-sys -wi-ao 7.45g
tmp nova01-sys -wi-ao 20.25g
usr nova01-sys -wi-ao 4.66g
var nova01-sys -wi-ao 4.66g
nova nova02-instance -wi-ao 319.28g
storage01 storage01 -wi--- 1020.00m

# lvremove storage01/storage01
One or more specified logical volume(s) not found.

# dmsetup ls
nova01--sys-home (251, 2)
nova01--sys-boot (251, 1)
nova01--sys-swap (251, 4)
nova01--sys-root (251, 3)
nova01--sys-tmp (251, 5)
nova01--sys-usr (251, 6)
nova01--sys-var (251, 7)
nova02--instance-nova (251, 0)

# cat /etc/issue
Ubuntu 11.04 \n \l

  • 2483 megtekintés

( athom | 2012. 02. 20., h – 15:28 )

Ami eddig elkerülte a figyelmemet, hogy az lvs utolsó sorában lévő logicalvolume-nál hiányzik az 'a' és az 'o' attributum, ergo nem aktiv és nincs éppen nyitva.

( athom | 2012. 02. 20., h – 15:39 )

másik szerver:

# pvs
File descriptor 7 (pipe:[99266431]) leaked on pvs invocation. Parent PID 25253: bash
/dev/dm-22: read failed after 0 of 4096 at 0: Input/output error
/dev/dm-26: read failed after 0 of 2048 at 0: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 1069481984: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 1069539328: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 4096: Input/output error
/dev/dm-26: read failed after 0 of 512 at 1073348608: Input/output error
/dev/dm-26: read failed after 0 of 512 at 1073438720: Input/output error
/dev/dm-26: read failed after 0 of 512 at 0: Input/output error
/dev/dm-26: read failed after 0 of 512 at 4096: Input/output error
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
PV VG Fmt Attr PSize PFree
/dev/dm-8 storage01 lvm2 a- 1020.00m 1020.00m
/dev/md0 storage01-sys lvm2 a- 46.56g 19.32g
/dev/md1 nova-volumes lvm2 a- 419.19g 216.19g
unknown device storage01 lvm2 a- 4.00g 4.00g

# vgs
File descriptor 7 (pipe:[99266431]) leaked on vgs invocation. Parent PID 25253: bash
/dev/dm-22: read failed after 0 of 4096 at 0: Input/output error
/dev/dm-26: read failed after 0 of 2048 at 0: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 1069481984: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 1069539328: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 4096: Input/output error
/dev/dm-26: read failed after 0 of 512 at 1073348608: Input/output error
/dev/dm-26: read failed after 0 of 512 at 1073438720: Input/output error
/dev/dm-26: read failed after 0 of 512 at 0: Input/output error
/dev/dm-26: read failed after 0 of 512 at 4096: Input/output error
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
VG #PV #LV #SN Attr VSize VFree
nova-volumes 1 26 0 wz--n- 419.19g 216.19g
storage01 2 0 0 wz-pn- 4.99g 4.99g
storage01-sys 1 7 0 wz--n- 46.56g 19.32g

# lvs
File descriptor 7 (pipe:[99266431]) leaked on lvs invocation. Parent PID 25253: bash
/dev/dm-22: read failed after 0 of 4096 at 0: Input/output error
/dev/dm-26: read failed after 0 of 2048 at 0: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 1069481984: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 1069539328: Input/output error
/dev/dm-22: read failed after 0 of 4096 at 4096: Input/output error
/dev/dm-26: read failed after 0 of 512 at 1073348608: Input/output error
/dev/dm-26: read failed after 0 of 512 at 1073438720: Input/output error
/dev/dm-26: read failed after 0 of 512 at 0: Input/output error
/dev/dm-26: read failed after 0 of 512 at 4096: Input/output error
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
volume-00000001 nova-volumes -wi-ao 1.00g
...
volume-00000026 nova-volumes -wi-ao 4.00g
boot storage01-sys -wi-ao 244.00m
home storage01-sys -wi-ao 4.66g
root storage01-sys -wi-ao 4.66g
swap storage01-sys -wi-ao 3.72g
tmp storage01-sys -wi-ao 4.66g
usr storage01-sys -wi-ao 4.66g
var storage01-sys -wi-ao 4.66g

Mitől lehet ilyen 'read failed...' hiba és mi okozhatja, hogy a storage01 VG fizikai device-nál az látszódik, hogy 'unknown device'?

Nem tapasztaltam olyat, hogy bármelyik diszkkel, bármilyen probléma lenne.
Egyébként az LVM által normálisnak vélt logikai volumeokkal semmilyen probléma nincs.

Közben amire rájöttem:

# dmsetup ls |grep '22)'
storage01-mysql01 (251, 22)

# dmsetup remove storage01-mysql01

Ez után már az 'lvs' kimenetében nincs /dev/dm-22 -re Input/output hiba.
Ez a két device tuti nincs használatban. A

# lvs
/dev/dm-26: read failed after 0 of 2048 at 0: Input/output error
/dev/dm-26: read failed after 0 of 512 at 1073348608: Input/output error
/dev/dm-26: read failed after 0 of 512 at 1073438720: Input/output error
/dev/dm-26: read failed after 0 of 512 at 0: Input/output error
/dev/dm-26: read failed after 0 of 512 at 4096: Input/output error
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
volume-00000001 nova-volumes -wi-ao 1.00g
...

# dmsetup ls |grep '26)'
nova--volumes-volume--00000011_snapshot1 (251, 26)

Ez -mint látsik- egy snapshot volt, amiből maradt már device:

# dmsetup ls |grep 00000011
nova--volumes-volume--00000011_snapshot-cow (251, 21)
nova--volumes-volume--00000011_snapshot1 (251, 26)
nova--volumes-volume--00000011 (251, 18)

# dmsetup remove nova--volumes-volume--00000011_snapshot-cow
# dmsetup remove nova--volumes-volume--00000011_snapshot1
# lvs
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
volume-00000001 nova-volumes -wi-ao 1.00g
...

Ezzel igy végre nem írja az Input/output error hibákat, viszont az lvs utáni első sor még mindig aggaszt.
Nincs is ilyen uuid-vel LV:

# lvs -v|grep THxokH
Finding all logical volumes
Wiping cache of LVM-capable devices
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
There are 1 physical volumes missing.

Ezen a második szerveren végre sikerült rendbe tenni az LVM-et. Becopyzom, hátha valaki befut ilyenbe:

# vgremove storage01
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
Volume group "storage01" not found, is inconsistent or has PVs missing.
Consider vgreduce --removemissing if metadata is inconsistent.

# vgreduce --removemissing storage01
Couldn't find device with uuid THxokH-LeST-tr1N-yMc5-zNxn-jDHO-vaqNPe.
Wrote out consistent volume group storage01

# lvs
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
volume-00000001 nova-volumes -wi-ao 1.00g
...
boot storage01-sys -wi-ao 244.00m
home storage01-sys -wi-ao 4.66g
root storage01-sys -wi-ao 4.66g
swap storage01-sys -wi-ao 3.72g
tmp storage01-sys -wi-ao 4.66g
usr storage01-sys -wi-ao 4.66g
var storage01-sys -wi-ao 4.66g

# vgs
VG #PV #LV #SN Attr VSize VFree
nova-volumes 1 26 0 wz--n- 419.19g 216.19g
storage01 1 0 0 wz--n- 1020.00m 1020.00m
storage01-sys 1 7 0 wz--n- 46.56g 19.32g

# vgremove storage01
Volume group "storage01" successfully removed

# vgs
VG #PV #LV #SN Attr VSize VFree
nova-volumes 1 26 0 wz--n- 419.19g 216.19g
storage01-sys 1 7 0 wz--n- 46.56g 19.32g

# pvs
PV VG Fmt Attr PSize PFree
/dev/dm-8 lvm2 a- 1023.72m 1023.72m
/dev/md0 storage01-sys lvm2 a- 46.56g 19.32g
/dev/md1 nova-volumes lvm2 a- 419.19g 216.19g

# pvremove /dev/dm-8
Labels on physical volume "/dev/dm-8" successfully wiped

# pvs
PV VG Fmt Attr PSize PFree
/dev/md0 storage01-sys lvm2 a- 46.56g 19.32g
/dev/md1 nova-volumes lvm2 a- 419.19g 216.19g

Egyébként simán elképzelhető, hogy ilyen történhetett, mivel az eredeti LV-k iscsi-n vannak kiajánlva, amit az openstack vezérel. Valami oknál fogva másik gépen is elkezdte b***tatni az LV-ket...

A megoldás az utókornak:
LV-t nem tudtam törölni, viszont VG-t igen és ez után már lefutott a pvs és vgs parancs is, amiben szépen látszódik, hogy valami nagyon nem jól működik, de legalább látszódik :)

# vgremove storage01
Do you really want to remove volume group "storage01" containing 1 logical volumes? [y/n]: y
Logical volume "storage01" successfully removed
Volume group "storage01" successfully removed

# dmsetup ls
nova02--sys-root (251, 1)
nova02--sys-tmp (251, 3)
nova02--sys-usr (251, 2)
nova02--sys-var (251, 4)
nova02--sys-home (251, 5)
nova02--sys-boot (251, 7)
nova02--instance-nova (251, 0)
nova02--sys-swap (251, 6)

# lvs
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
nova nova02-instance -wi-ao 300.00g
boot nova02-sys -wi-ao 244.00m
home nova02-sys -wi-ao 4.66g
root nova02-sys -wi-ao 4.66g
swap nova02-sys -wi-ao 7.45g
tmp nova02-sys -wi-ao 9.31g
usr nova02-sys -wi-ao 4.66g
var nova02-sys -wi-ao 4.66g
apache01 storage01 -wi--- 20.00g

# vgs
VG #PV #LV #SN Attr VSize VFree
nova02-instance 1 1 0 wz--n- 419.28g 119.28g
nova02-sys 1 7 0 wz--n- 46.56g 10.94g
storage01 1 1 0 wz--n- 4.00g 0
storage01 1 1 0 wz--n- 5.00g 0

# pvs
PV VG Fmt Attr PSize PFree
/dev/md0 nova02-sys lvm2 a- 46.56g 10.94g
/dev/sda5 nova02-instance lvm2 a- 419.28g 119.28g
/dev/sdf1 lvm2 a- 5.00g 5.00g
/dev/sdg1 lvm2 a- 1023.72m 1023.72m
/dev/sdj1 lvm2 a- 2.00g 2.00g
/dev/sdl1 storage01 lvm2 a- 5.00g 0
/dev/sdm1 storage01 lvm2 a- 20.00g 0
/dev/sdp1 storage01 lvm2 a- 4.00g 0

...nah, ha ezt tudom a legelején, akkor nem parázok rá annyira:
http://www.linuxintro.org/wiki/Set_up_an_iscsi_storage

:)

# hwinfo --block --short
disk:
/dev/sda ST31000524AS
/dev/sdb SAMSUNG HD103SJ
/dev/sdc ST31000524AS
/dev/sdd ST31000524AS
/dev/sdj IET VIRTUAL-DISK
/dev/sdl IET VIRTUAL-DISK
/dev/sdm IET VIRTUAL-DISK
/dev/sdf IET VIRTUAL-DISK
/dev/sdp IET VIRTUAL-DISK
/dev/sdg IET VIRTUAL-DISK
/dev/sde IET VIRTUAL-DISK
/dev/sdh IET VIRTUAL-DISK