Difference between revisions of "LVM"

From DWIKI
(45 intermediate revisions by the same user not shown)
Line 1: Line 1:
Logical Volume Management on [[Linux]]


=Link=
Logical Volume Management on [[Linux|Linux]]
*[http://www.andybotting.com/how-do-you-clone-an-lvm-partition How do you clone an lvm partition?]
*[https://github.com/radiorabe/rabe-zabbix/tree/master/app/LVM Monitoring with zabbix]
*[http://tldp.org/HOWTO/LVM-HOWTO/ HOWTO]
*[https://www.theurbanpenguin.com/thin-provisioning-lvm2/ Thin provisioning]
*[http://www.howtoforge.com/linux_lvm Beginner's guide to LVM]
*[http://theitdepartment.wordpress.com/2008/05/30/howto-resize-a-xen-drbd-lvm-vbd/ Resizing LVM + DRBD]
*http://wiki.tldp.org/LVM-on-RAID
*[http://serverfault.com/questions/678642/linux-device-mapper-maps-lvm-pv-nested-inside-lv-when-taking-snapshot LVM nesting]
*http://blog.gadi.cc/better-lvm-for-kvm/
*[]
*[http://tldp.org/HOWTO/LVM-HOWTO/snapshots_backup.html Taking a Backup Using Snapshots]


 
= Links =
*[http://www.andybotting.com/how-do-you-clone-an-lvm-partition How do you clone an lvm partition?]
*[https://github.com/radiorabe/rabe-zabbix/tree/master/app/LVM Monitoring with zabbix]
*[http://tldp.org/HOWTO/LVM-HOWTO/ HOWTO]
*[https://www.theurbanpenguin.com/thin-provisioning-lvm2/ Thin provisioning]
*[http://www.howtoforge.com/linux_lvm Beginner's guide to LVM]
*[http://theitdepartment.wordpress.com/2008/05/30/howto-resize-a-xen-drbd-lvm-vbd/ Resizing LVM + DRBD]
*[http://wiki.tldp.org/LVM-on-RAID http://wiki.tldp.org/LVM-on-RAID]
*[http://serverfault.com/questions/678642/linux-device-mapper-maps-lvm-pv-nested-inside-lv-when-taking-snapshot LVM nesting]
*[http://blog.gadi.cc/better-lvm-for-kvm/ http://blog.gadi.cc/better-lvm-for-kvm/]
*[[https://www.tecmint.com/take-snapshot-of-logical-volume-and-restore-in- https://www.tecmint.com/take-snapshot-of-logical-volume-and-restore-in-]
*[http://tldp.org/HOWTO/LVM-HOWTO/snapshots_backup.html Taking a Backup Using Snapshots]
*[https://linoxide.com/identify-linux-lvm-mirror/ LVM mirrors]
*https://www.thegeekdiary.com/how-to-convert-a-volume-to-stripe-raid0-volume-in-lvm/
*[https://mydbops.wordpress.com/2019/09/08/get-the-most-iops-out-of-your-hard-disk-mounts-using-lvm/ Get the most IOPS out of your physical volumes using LVM]
NOTE: remember to add snapshot support when calling lvcreate
NOTE: remember to add snapshot support when calling lvcreate


=Related commands=
 
==lvdisplay==
 
== Raid on LVM ==
 
*[https://www.theurbanpenguin.com/striped-lvm-volumes/ Striped LVM volumes]
*[https://www.linuxsysadmins.com/create-striped-logical-volume-on-linux/ https://www.linuxsysadmins.com/create-striped-logical-volume-on-linux/]
 
 
 
 
 
= LVM Thin provisioning =
 
== Show some more about thin volumes ==
 
lvm -a
 
= Related commands =
 
== lvs ==
 
== lvdisplay ==
 
== lvrename ==
 
lvrename groupname oldname newname
 


== pvs ==
Show the pyhysical volumens


==lsblk==
== pvscan ==


==partprobe==
== pvresize ==  
To use after chaning disk/partition size


==lvchange==
== vgrename ==


==vgchange==
== lsblk ==


==dmsetup==
== partprobe ==


==vgs==
== lvchange ==
 
== vgchange ==
 
== dmsetup ==
 
== vgs ==
 
== create physical volume ==


==create physical volume==
  pvcreate /dev/sda3
  pvcreate /dev/sda3


 
== lvcreate ==


==lvcreate==
  lvcreate -L12G -nmyvol myvolumegroup
  lvcreate -L12G -nmyvol myvolumegroup
  lvcreate -l 100%FREE -nmyvol myvolumegroup
  lvcreate -l 100%FREE -nmyvol myvolumegroup


==lvresize==  
== lvresize ==
  lvresize --resizefs -L-2G /dev/vg/foo
 
or grow to all left in vg:
Grow filesystem together with the volume
 
  lvresize --resizefs -L+20G /dev/vg/foo
 
or grow to all remaining space vg:
 
  lvresize -l +100%FREE /dev/myvg/myvol
  lvresize -l +100%FREE /dev/myvg/myvol


==lvremove==
 
 
 
 
== lvremove ==
 
To remove all volumes in group VGname
To remove all volumes in group VGname
  lvremove VGname
  lvremove VGname


To remove a volume
To remove a volume
  lvremove VGname/LVname
  lvremove VGname/LVname
     
== Do you really want to remove active logical volume ==
lvchange -a n vgname/lvname
just to make sure
 
=== Logical volume X/Y contains a filesystem in use ===
[https://www.thegeekdiary.com/lvremove-command-fails-with-error-lvm-cant-remove-open-logical-volume/ https://www.thegeekdiary.com/lvremove-command-fails-with-error-lvm-cant-remove-open-logical-volume/]
Could be NFS. Always remember NFS! If NFS has indeed been involved, restarting nfs service will most likely fix this.
== pvck ==


==pvck==
To find the metadata:
To find the metadata:
  pvck /dev/sdb1
  pvck /dev/sdb1


 


==LVM snapshot==
== LVM snapshot ==


*https://www.tecmint.com/take-snapshot-of-logical-volume-and-restore-in-lvm/ of Logical Volume and in LVM ]  
*[https://www.tecmint.com/take-snapshot-of-logical-volume-and-restore-in- https://www.tecmint.com/take-snapshot-of-logical-volume-and-restore-in-]  


  lvcreate --size 1G --snapshot --name snap-1 /dev/myvg/mylv
  lvcreate --size 1G --snapshot --name snap-1 /dev/myvg/mylv
Line 65: Line 138:
where size should be enough to hold the data changes
where size should be enough to hold the data changes


=FAQ=
 
==Access logical volumes within logical volume==
= HOWTO =
==Extend striped volume==
See [https://web.mit.edu/rhel-doc/5/RHEL-5-manual/Cluster_Logical_Volume_Manager/stripe_extend.html here]
==Convert linear logical volume to striped==
See [https://www.thegeekdiary.com/how-to-convert-a-volume-to-stripe-raid0-volume-in-lvm/ here] and [https://robbat2.livejournal.com/243144.html here] and [http://www.voleg.info/lvm2-convert-stripe-volume.html here] and [https://www.depesz.com/2015/10/08/converting-logical-volume-so-that-its-striped/ here]
and [https://www.handigeknakker.nl/?x=entry:entry160330-193558 this one] seems most useful
 
==Volume groups==
=== Add disk to volume group ===
 
pvcreate /dev/sdc
vgextend MYVG /dev/sdc
 
And if you need space right now:
 
lvextend -l +100%FREE /dev/NYVG/mylv
 
And then grow fs
 
=== Remove volume group ===
Deactivate the volume group:
vgchange -a n my_volume_group
 
Now you actually remove the volume group:
vgremove my_volume_group
 
=== Remove physical drive from a volume group ===
See [https://www.2daygeek.com/linux-remove-delete-physical-volume-pv-from-volume-group-vg-in-lvm/ here]
Make sure the data fits on remaining drives, then
pvmove /dev/sdbX
vgreduce myvg /dev/sdbX
 
= FAQ =
 
== Access logical volumes within logical volume ==
 
  partprobe /dev/mapper/vg-mydata
  partprobe /dev/mapper/vg-mydata
  lsblk
  lsblk
This will show the (sub) partitions/volumes, then edit /etc/lvm/lvm.conf
This will show the (sub) partitions/volumes, then edit /etc/lvm/lvm.conf
  filter = [ "a|.*/|", "a|mydata|","r|.*|" ]
  filter = [ "a|.*/|", "a|mydata|","r|.*|" ]
Then run:
Then run:
  vgscan
  vgscan
  lvscan
  lvscan
  vgs
  vgs
Now you should see the names of the volumes you're looking for, so now:
Now you should see the names of the volumes you're looking for, so now:
  vgchange -a y guestsname_mydata-home
  vgchange -a y guestsname_mydata-home
and then you should be able to  
 
and then you should be able to
 
  mount /dev/mapper/guestsname_mydata-home
  mount /dev/mapper/guestsname_mydata-home


When done, remember to change back the filter in lvm.conf, default is  
When done, remember to change back the filter in lvm.conf, default is
 
  filter = [ "a|.*/|" ]
  filter = [ "a|.*/|" ]
and of course then once again
and of course then once again
  vgscan
  vgscan
  lvscan
  lvscan


==grow logical volume==
 
https://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html
 
== vgreduce Can't remove final physical volume ==
 
Means you're trying to remove the last physical volume, instead just use
 
vgremove
 
== grow logical volume ==
 
[https://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html https://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html]
 
  lvextend -L+100G /dev/myvg/myvol
  lvextend -L+100G /dev/myvg/myvol


==Add disk to volume group==
pvcreate /dev/sdc
vgextend MYVG /dev/sdc


And if you need space right now:
lvextend -l +100%FREE /dev/NYVG/mylv


And then grow fs


==lvremove: Logical volume vg-kvm/vps-snapshot is used by another device.==
== lvremove: Logical volume vg-kvm/vps-snapshot is used by another device. ==


Could be kpartx, see
Could be kpartx, see
  /dev/mapper/
  /dev/mapper/


==lvremove Logical volume foo/bar in use==
== lvremove Logical volume foo/bar in use ==
 
check with lsof, fuser and:
check with lsof, fuser and:
  losetup -l
  losetup -l


to see if a /dev/dm-* looks familiar
to see if a /dev/dm-* looks familiar


 


*http://naveen161089.blogspot.nl/2014/03/forcefully-remove-lvm.html
*[http://naveen161089.blogspot.nl/2014/03/forcefully-remove-lvm.html http://naveen161089.blogspot.nl/2014/03/forcefully-remove-lvm.html]


some say lvchange -an the snapshot first, but that disables the lv it's connected to as well
some say lvchange -an the snapshot first, but that disables the lv it's connected to as well


OR
OR
  dmsetup info -c
  dmsetup info -c
http://blog.roberthallam.org/2017/12/solved-logical-volume-is-used-by-another-device/comment-page-1/
 
[http://blog.roberthallam.org/2017/12/solved-logical-volume-is-used-by-another-device/comment-page-1/ http://blog.roberthallam.org/2017/12/solved-logical-volume-is-used-by-another-device/comment-page-1/]
 
 
 
== lvremove Do you really want to remove and DISCARD active logical volume ==
 
If you like, deactivate the volume first:
 
lvchange -an vgname/lvname
 
 


== Grow physical volume ==
== Grow physical volume ==
Assuming your LVM partition is the last one, use fdisk to delete and recreate it, remember to set type to LVM again and reboot.
Then use pvresize /dev/sdaX


== Remove physical drive from a volume group ==
Assuming your LVM partition is the last one, use fdisk to delete and recreate it, remember to set type to LVM again and reboot. Then use pvresize /dev/sdaX
Make sure the data fits on remaining drive, then
 
  pvmove /dev/sdbX
Or just:
  vgreduce /dev/sdbX
 
  pvresize /dev/sdb
 
 
 
 
 
 
 
 
  vgreduce vgname /dev/sdbX


== Create volume group ==


==Create volume group==
  vgcreate vgname /dev/sdc1 /dev/sdd1
  vgcreate vgname /dev/sdc1 /dev/sdd1
== pvcreate Can't open /dev/sdg exclusively. Mounted filesystem? ==
[https://blog.hqcodeshop.fi/archives/274-Replacing-physical-drive-for-LVM-pvcreate-Cant-open-dev-exclusively.html https://blog.hqcodeshop.fi/archives/274-Replacing-physical-drive-for-LVM-pvcreate-Cant-open-dev-exclusively.html]
 
== pvcreate: Cannot use /dev/sdb: device is partitioned ==
some secret ritual required, or just create /dev/sdb1
== Device /dev/sdb excluded by filter ==
Check disk label(gpt!!
Try:
  wipefs -af /dev/sdg
 
 
== WARNING: Device /dev/dm-17 not initialized in udev database even after waiting 10000000 microseconds. ==
Try
udevadm trigger
 
== wipefs: error: /dev/sdg: probing initialization failed: Device or resource busy ==
try all ways to unbusy
== Check if volume is in use ==
dmsetup info -c
Check the 'Open' column
== WARNING: PV /dev/sda5 in VG foo-vg is using an old PV header, modify the VG to update. ==
vgck --updatemetadata foo-vg
 
== Mount logical volume from disk image ==
See also https://backdrift.org/mounting-a-file-system-on-a-partition-inside-of-an-lvm-volume
kpartx -av /path/to.img
lvscan
mount /dev/mapper/what-ever-var /mnt/loop
  [[Category:System Administration]] [[Category:Linux]]
umount
kpartx -d /path/to.img
== Error reading device sdb ==
After pvremoving a disk:
wipefs -a /dev/sdb




[[Category: System Administration]]
== pvmove: Cluster mirror log daemon is not running ==
[[Category: Linux]]
Useless message, but if pvmove is failing: did you shrink your LV yet?

Revision as of 12:04, 12 August 2022

Logical Volume Management on Linux

 

Links

NOTE: remember to add snapshot support when calling lvcreate

 

Raid on LVM

 

 

LVM Thin provisioning

Show some more about thin volumes

lvm -a

Related commands

lvs

lvdisplay

lvrename

lvrename groupname oldname newname


pvs

Show the pyhysical volumens

pvscan

pvresize

To use after chaning disk/partition size

vgrename

lsblk

partprobe

lvchange

vgchange

dmsetup

vgs

create physical volume

pvcreate /dev/sda3

 

lvcreate

lvcreate -L12G -nmyvol myvolumegroup
lvcreate -l 100%FREE -nmyvol myvolumegroup

lvresize

Grow filesystem together with the volume

lvresize --resizefs -L+20G /dev/vg/foo

or grow to all remaining space vg:

lvresize -l +100%FREE /dev/myvg/myvol

 

 

lvremove

To remove all volumes in group VGname

lvremove VGname

To remove a volume

lvremove VGname/LVname
      

Do you really want to remove active logical volume

lvchange -a n vgname/lvname

just to make sure

 

Logical volume X/Y contains a filesystem in use

https://www.thegeekdiary.com/lvremove-command-fails-with-error-lvm-cant-remove-open-logical-volume/

Could be NFS. Always remember NFS! If NFS has indeed been involved, restarting nfs service will most likely fix this.

pvck

To find the metadata:

pvck /dev/sdb1

 

LVM snapshot

lvcreate --size 1G --snapshot --name snap-1 /dev/myvg/mylv

where size should be enough to hold the data changes

 

HOWTO

Extend striped volume

See here

Convert linear logical volume to striped

See here and here and here and here and this one seems most useful

Volume groups

Add disk to volume group

pvcreate /dev/sdc
vgextend MYVG /dev/sdc

And if you need space right now:

lvextend -l +100%FREE /dev/NYVG/mylv 

And then grow fs

Remove volume group

Deactivate the volume group:

vgchange -a n my_volume_group

Now you actually remove the volume group:

vgremove my_volume_group

Remove physical drive from a volume group

See here Make sure the data fits on remaining drives, then

pvmove /dev/sdbX
vgreduce myvg /dev/sdbX

FAQ

Access logical volumes within logical volume

partprobe /dev/mapper/vg-mydata
lsblk

This will show the (sub) partitions/volumes, then edit /etc/lvm/lvm.conf

filter = [ "a|.*/|", "a|mydata|","r|.*|" ]

Then run:

vgscan
lvscan
vgs

Now you should see the names of the volumes you're looking for, so now:

vgchange -a y guestsname_mydata-home

and then you should be able to

mount /dev/mapper/guestsname_mydata-home

When done, remember to change back the filter in lvm.conf, default is

filter = [ "a|.*/|" ]

and of course then once again

vgscan
lvscan

 

vgreduce Can't remove final physical volume

Means you're trying to remove the last physical volume, instead just use

vgremove

grow logical volume

https://www.tldp.org/HOWTO/LVM-HOWTO/extendlv.html

lvextend -L+100G /dev/myvg/myvol



lvremove: Logical volume vg-kvm/vps-snapshot is used by another device.

Could be kpartx, see

/dev/mapper/

lvremove Logical volume foo/bar in use

check with lsof, fuser and:

losetup -l

to see if a /dev/dm-* looks familiar

 

some say lvchange -an the snapshot first, but that disables the lv it's connected to as well

OR

dmsetup info -c

http://blog.roberthallam.org/2017/12/solved-logical-volume-is-used-by-another-device/comment-page-1/

 

lvremove Do you really want to remove and DISCARD active logical volume

If you like, deactivate the volume first:

lvchange -an vgname/lvname

 

Grow physical volume

Assuming your LVM partition is the last one, use fdisk to delete and recreate it, remember to set type to LVM again and reboot. Then use pvresize /dev/sdaX

Or just:

pvresize /dev/sdb

 

 


 

vgreduce vgname /dev/sdbX

Create volume group

vgcreate vgname /dev/sdc1 /dev/sdd1

pvcreate Can't open /dev/sdg exclusively. Mounted filesystem?

https://blog.hqcodeshop.fi/archives/274-Replacing-physical-drive-for-LVM-pvcreate-Cant-open-dev-exclusively.html

 

pvcreate: Cannot use /dev/sdb: device is partitioned

some secret ritual required, or just create /dev/sdb1

Device /dev/sdb excluded by filter

Check disk label(gpt!!

Try:

 wipefs -af /dev/sdg

 

 

WARNING: Device /dev/dm-17 not initialized in udev database even after waiting 10000000 microseconds.

Try

udevadm trigger

 

wipefs: error: /dev/sdg: probing initialization failed: Device or resource busy

try all ways to unbusy

Check if volume is in use

dmsetup info -c

Check the 'Open' column

WARNING: PV /dev/sda5 in VG foo-vg is using an old PV header, modify the VG to update.

vgck --updatemetadata foo-vg

 

Mount logical volume from disk image

See also https://backdrift.org/mounting-a-file-system-on-a-partition-inside-of-an-lvm-volume

kpartx -av /path/to.img
lvscan
mount /dev/mapper/what-ever-var /mnt/loop
umount
kpartx -d /path/to.img


Error reading device sdb

After pvremoving a disk:

wipefs -a /dev/sdb


pvmove: Cluster mirror log daemon is not running

Useless message, but if pvmove is failing: did you shrink your LV yet?