Linux memory: Difference between revisions

From DWIKI
 
(10 intermediate revisions by the same user not shown)
Line 3: Line 3:
= Links =
= Links =


*[http://www.linuxatemyram.com/ Linux ate my RAM!]
*[http://www.linuxatemyram.com/ Linux ate my RAM!]
*[https://www.thegeekdiary.com/understanding-proc-meminfo-file-analyzing-memory-utilization-in-linux/ Understanding /proc/meminfo]
*[https://www.tecmint.com/clear-ram-memory-cache-buffer-and-swap-space-on-linux/ How to Clear RAM Memory Cache, Buffer and Swap Space on Linux]  
*[https://www.tecmint.com/clear-ram-memory-cache-buffer-and-swap-space-on-linux/ How to Clear RAM Memory Cache, Buffer and Swap Space on Linux]  
*[http://serverfault.com/questions/377617/how-to-interpret-output-from-linux-top-command How to interpret output from Linux 'top' command?]  
*[http://serverfault.com/questions/377617/how-to-interpret-output-from-linux-top-command How to interpret output from Linux 'top' command?]  
Line 17: Line 16:
*[https://unix.stackexchange.com/questions/2658/why-use-swap-when-there-is-more-than-enough-free-space-in-ram Why is system using swap when there is enough free space in ram?]
*[https://unix.stackexchange.com/questions/2658/why-use-swap-when-there-is-more-than-enough-free-space-in-ram Why is system using swap when there is enough free space in ram?]
*[https://www.thomas-krenn.com/en/wiki/Linux_Page_Cache_Basics Linux page cache basics]
*[https://www.thomas-krenn.com/en/wiki/Linux_Page_Cache_Basics Linux page cache basics]
==/proc/meminfo==
*[https://www.thegeekdiary.com/understanding-proc-meminfo-file-analyzing-memory-utilization-in-linux/ Understanding /proc/meminfo]
*[https://www.baeldung.com/linux/proc-meminfo The /proc/meminfo File in Linux]


= Documentation =
= Documentation =
==Output of 'free' command==
===available===
MemAvailable in /proc/meminfo


  man 5 proc
  man 5 proc
Line 53: Line 63:


==ZFS and arc==
==ZFS and arc==
===Tools===
*arc_summary
===Links===
===Links===
*[https://superuser.com/questions/1137416/how-can-i-determine-the-current-size-of-the-arc-in-zfs-and-how-does-the-arc-rel Determine arc usage]
*[https://superuser.com/questions/1137416/how-can-i-determine-the-current-size-of-the-arc-in-zfs-and-how-does-the-arc-rel Determine arc usage]
*[https://pve.proxmox.com/wiki/ZFS_on_Linux Proxmox: ZFS on Linux]
*[https://pve.proxmox.com/wiki/ZFS_on_Linux Proxmox: ZFS on Linux]
*[https://openzfs.org/wiki/Documentation/DnodeSync arc dnode]


===Changing arc sizes in runtime===
===Changing arc sizes in runtime===
Line 61: Line 76:
  echo 1024 > /sys/module/zfs/parameters/zfs_arc_min
  echo 1024 > /sys/module/zfs/parameters/zfs_arc_min
  echo 2048 > /sys/module/zfs/parameters/zfs_arc_max
  echo 2048 > /sys/module/zfs/parameters/zfs_arc_max
===Changing arc sizes in systctl===
===Changing arc settings===
In /etc/systctld.d/zfs.conf:  
In /etc/modprobe.d/zfs.conf:  
  options zfs zfs_arc_max=4294967296
  options zfs zfs_arc_max=4294967296
  options zfs zfs_arc_min=1073741824
  options zfs zfs_arc_min=1073741824


'''If root on ZFS'''
 
'''If root on ZFS''' (really?)
  update-initramfs -u -k all
  update-initramfs -u -k all


Line 82: Line 98:
or to just list top 3
or to just list top 3
  for file in /proc/*/status ; do awk '/VmSwap|Name/{printf $2 " " $3}END{ print ""}' $file; done | sort -k 2 -n -r | head -n 3
  for file in /proc/*/status ; do awk '/VmSwap|Name/{printf $2 " " $3}END{ print ""}' $file; done | sort -k 2 -n -r | head -n 3
==Watch buffer/cache activity==
https://www.heroix.com/blog/linux-memory-use/
sar -B
==What is in buffer/cache?==
===Tools===
*[https://github.com/brendangregg/perf-tools perf-tools]
*https://www.brendangregg.com/blog/2014-12-31/linux-page-cache-hit-ratio.html


== Clear buffer/cache ==
== Clear buffer/cache ==


  sync; echo 3 > /proc/sys/vm/drop_caches
  sync; echo 3 > /proc/sys/vm/drop_caches

Latest revision as of 13:07, 15 November 2023


Links

/proc/meminfo

Documentation

Output of 'free' command

available

MemAvailable in /proc/meminfo 


man 5 proc

see /proc/meminfo

total

Is MemTotal in /proc/meminfo

Total usable ram (i.e. physical ram minus a few reserved bits and the kernel binary code)

used

total - free - buffers - cache

unused

MemFree

RSS

Resident Set Size

RSS and VSZ in Linux memory management

"memory is allocated to that process and is in RAM. It does not include memory that is swapped out. It does include memory from shared libraries as long as the pages from those libraries are actually in memory. It does include all stack and heap memory."

VSZ / VmSize

Virtual Memory Size It includes all memory that the process can access, including memory that is swapped out, memory that is allocated, but not used, and memory that is from shared libraries.


ZFS and arc

Tools

  • arc_summary

Links


Changing arc sizes in runtime

#in bytes
echo 1024 > /sys/module/zfs/parameters/zfs_arc_min
echo 2048 > /sys/module/zfs/parameters/zfs_arc_max

Changing arc settings

In /etc/modprobe.d/zfs.conf: 

options zfs zfs_arc_max=4294967296
options zfs zfs_arc_min=1073741824


If root on ZFS (really?) 

update-initramfs -u -k all

FAQ

What is using all my memory?

smem -r -s swap| head -n3


What is using all my swap?

https://www.cyberciti.biz/faq/linux-which-process-is-using-swap/ 

for file in /proc/*/status ; do awk '/VmSwap|Name/{printf $2 " " $3}END{ print ""}' $file; done | sort -k 2 -n -r | less

or to just list top 3 

for file in /proc/*/status ; do awk '/VmSwap|Name/{printf $2 " " $3}END{ print ""}' $file; done | sort -k 2 -n -r | head -n 3


Watch buffer/cache activity

https://www.heroix.com/blog/linux-memory-use/ 

sar -B


What is in buffer/cache?

Tools

Clear buffer/cache

sync; echo 3 > /proc/sys/vm/drop_caches
Retrieved from "https://wiki.dhits.nl/index.php?title=Linux_memory&oldid=8600"