OpenVZ Virtuozzo Containers Wiki - User contributions [en]

Backup a running container over the network with ezvzdump

2009-09-10T12:08:14Z

Mgual: /*Fixed issue with "vzdump -- restore" permissions and user/group */

== Ezvzdump ==

Ezvzdump (not to be confused with [[vzdump]]) is a shell script that also allows
you to dump out a running VE container. The key differences are that ezvzdump
allows you to utilize past dumps to speed things up, and that a remote host can
be specified to allow backups and tar archiving over the network.

The dump files that are created are compatible with those that vzdump creates,
so you must still use <code>vzdump --restore</code> to restore them.

Dependencies: sendEmail package for emailing of statistics

== Cron ==
I recommend using <code>nice</code><code></code> and <code>ionice</code> to run this script so it doesn't bring the host to it's knees. Place this example in <code>/etc/cron.d/ezvzdump</code> and the backups will run at 3:30 AM every day.

<pre>
# /etc/cron.d/ezvzdump
SHELL=/bin/bash #This is necessary on Ubuntu where dash is the default shell and is thus used by cron.
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin

30 3 * * * root /usr/bin/nice -n19 /usr/bin/ionice -c3 /usr/local/scripts/ezvzdump > /dev/null 2>&1
</pre>

== Changes ==

2009/7/24 - JBiel - Added support for GZip compression and backup
retention/rotation. Also added support for emailing of statistics.

== Download ==

<pre>

#!/bin/bash

# ezvzdump

# Copyright (C) 2008 Alex Lance (alla at cyber.com.au)
# Sponsored by Silverband Pty. Ltd.

# This program is free software: you can redistribute it and/or modify
# it under the terms of the GNU General Public License as published by the Free
# Software Foundation, either version 3 of the License, or (at your option) any
# later version.

# This program is distributed in the hope that it will be useful, but
# WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
# FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for
# more details: http://www.gnu.org/licenses/gpl.txt

# Instructions
# ------------

# This script rsyncs a VE to a specified local directory, suspends the running
# VE, rsyncs again, and then resumes the VE. This creates a stable snapshot of
# the VE directories with minimal downtime.

# Once the VE has been dumped out locally, it is rsynced to a remote host. When
# the rsync has completed, a tar archive is created on the remote host. The tar
# archive is compatible with the vzdump tar format, so the VE tar file may be
# later restored with the `vzdump --restore` command.

# By tarring the files together on the remote host, the burden of creating
# the tar archive is taken away from the hardware node, and given to the remote
# host / backup server. This ensures that minimal additional CPU/disk resources
# are used on the machine that is running the VE's.

# This script runs slow the first time you use it, but from then on it utilizes
# the local and remote stored snapshot directories so that the rsyncs happen
# expediently. The script does not wait for the remote tar process to complete,
# it simply kicks off the tar archive creation and then immediately continues.

# This script uses rsync and ssh and assumes that you already have ssh keys
# set up between your hosts. This script was written because vzdump takes too
# long and does not utilize a local cache, and also does not do network
# backups. This script also puts less strain on the hardware node by finishing
# backups more quickly, and making the remote host do the heavy lifting.

# NASTY BUG! Make sure you're not "vzctl enter"ing a VE while it's being
# suspended. On my machine (Ubuntu 2.6.24-24-openvz) it caused the VE to
# zombifiy and I had to reboot the host (including killing the VZ shutdown
# script because it was unable to shutdown the VE/processes.) Just don't do it!

# This section contains variables that require user customisation.
# NOTE: all directory names *must* end in a forward-slash.

# This variable contains a space delimited list of VEID's to be backed up.
# You can use VEIDS="$(cd /vz/private/ && echo *)" to backup all your VE's.
VEIDS="101 102 103 104"

VZ_CONF="/etc/vz/conf/" # the path to your openvz $VEID.conf files
VZ_PRIVATE="/vz/private/" # the path to the running VE's
LOCAL_DIR="/vz/ezvzdump/" # the local rsync cache / destination directory

# The remote host and path that this script will rsync the VE's to.
REMOTE_HOST="somehost.example.com"
REMOTE_DIR="/backup/"

# Default rsync flags (please note the potentially unsafe delete flags).
# You can also remove the v flag to get less verbose logging.
RSYNC_DEFAULT="rsync -ravH --delete-after --delete-excluded"

# Exclude these directories from backup (space delimited).
# I left /var/log in the backup because when doing a full restore
# it's necessary that this directory structure is present.
RSYNC_EXCLUDE="/usr/portage"

# Path to vzctl executable
VZCTL="vzctl"

# Nice debugging messages...
function e {
echo -e $(date "+%F %T"): $1
}
function die {
e "Error: $1" >&2
exit 1;
}

# Make sure all is sane
[ ! -d "${VZ_CONF}" ] && die "\$VZ_CONF directory doesn't exist. ($VZ_CONF)"
[ ! -d "${VZ_PRIVATE}" ] && die "\$VZ_PRIVATE directory doesn't exist. ($VZ_PRIVATE)"
[ ! -d "${LOCAL_DIR}" ] && die "\$LOCAL_DIR directory doesn't exist. ($LOCAL_DIR)"

e "`hostname` - VZ backup for containers $VEIDS started." > /tmp/vzbackuptimes
# Loop through each VEID
for VEID in $VEIDS; do

VEHOSTNAME=`vzlist -o hostname $VEID -H`
echo ""
e "Beginning backup of VEID: $VEID";

# Build up the --exclude string for the rsync command
RSYNC="${RSYNC_DEFAULT}"
for path in $RSYNC_EXCLUDE; do
RSYNC+=" --exclude=${VEID}${path}"
done;

e "Commencing initial ${RSYNC} ${VZ_PRIVATE}${VEID} ${LOCAL_DIR}"
[ ! -d "${VZ_PRIVATE}${VEID}" ] && die "\$VZ_PRIVATE\$VEID directory doesn't exist. (${VZ_PRIVATE}${VEID})"
${RSYNC} ${VZ_PRIVATE}${VEID} ${LOCAL_DIR}

# If the VE is running, suspend, re-rsync and then resume it ...
if [ -n "$(${VZCTL} status ${VEID} | grep running)" ]; then

e "Suspending VEID: $VEID"
before="$(date +%s)"
${VZCTL} chkpnt $VEID --suspend

e "Commencing second pass rsync ..."
${RSYNC} ${VZ_PRIVATE}${VEID} ${LOCAL_DIR}

e "Resuming VEID: $VEID"
${VZCTL} chkpnt $VEID --resume
after="$(date +%s)"
elapsed_seconds="$(expr $after - $before)"

e "Done."
e "Container ${VEID} ($VEHOSTNAME) was down $elapsed_seconds seconds during backup process." >> /tmp/vzbackuptimes

else
e "# # # Skipping suspend/re-rsync/resume, as the VEID: ${VEID} is not curently running."
fi

# Copy VE config files over into the VE storage/cache area
if [ ! -d "${LOCAL_DIR}${VEID}/etc/vzdump" ]; then
e "Creating directory for openvz config files: mkdir ${LOCAL_DIR}${VEID}/etc/vzdump"
mkdir ${LOCAL_DIR}${VEID}/etc/vzdump
fi

e "Copying main config file: cp ${VZ_CONF}${VEID}.conf ${LOCAL_DIR}${VEID}/etc/vzdump/vps.conf"
[ ! -f "${VZ_CONF}${VEID}.conf" ] && die "Unable to find ${VZ_CONF}${VEID}.conf"
cp ${VZ_CONF}${VEID}.conf ${LOCAL_DIR}${VEID}/etc/vzdump/vps.conf

for ext in start stop mount umount; do
if [ -f "${VZ_CONF}${VEID}.${ext}" ]; then
e "Copying other config file: cp ${VZ_CONF}${VEID}.${ext} ${LOCAL_DIR}${VEID}/etc/vzdump/vps.${ext}"
cp ${VZ_CONF}${VEID}.${ext} ${LOCAL_DIR}${VEID}/etc/vzdump/vps.${ext}
fi
done;

# Run the remote rsync
if [ -n "${REMOTE_HOST}" ] && [ -n "${REMOTE_DIR}" ]; then
e "Commencing remote ${RSYNC} ${LOCAL_DIR}${VEID} ${REMOTE_HOST}:${REMOTE_DIR}${VEID}"
${RSYNC} ${LOCAL_DIR}${VEID}/ ${REMOTE_HOST}:${REMOTE_DIR}${VEID}/

# Rotate older tar.gz backups if they exist. You can comment out these lines if you wish to have only one copy.
e "Checking for existing files ${REMOTE_HOST}:${REMOTE_DIR}${VEID}.X.tar and rotating them"
ssh ${REMOTE_HOST} "[ -f ${REMOTE_DIR}${VEID}.6.tar.gz ] && mv -f ${REMOTE_DIR}${VEID}.6.tar.gz ${REMOTE_DIR}${VEID}.7.tar.gz"
ssh ${REMOTE_HOST} "[ -f ${REMOTE_DIR}${VEID}.5.tar.gz ] && mv -f ${REMOTE_DIR}${VEID}.5.tar.gz ${REMOTE_DIR}${VEID}.6.tar.gz"
ssh ${REMOTE_HOST} "[ -f ${REMOTE_DIR}${VEID}.4.tar.gz ] && mv -f ${REMOTE_DIR}${VEID}.4.tar.gz ${REMOTE_DIR}${VEID}.5.tar.gz"
ssh ${REMOTE_HOST} "[ -f ${REMOTE_DIR}${VEID}.3.tar.gz ] && mv -f ${REMOTE_DIR}${VEID}.3.tar.gz ${REMOTE_DIR}${VEID}.4.tar.gz"
ssh ${REMOTE_HOST} "[ -f ${REMOTE_DIR}${VEID}.2.tar.gz ] && mv -f ${REMOTE_DIR}${VEID}.2.tar.gz ${REMOTE_DIR}${VEID}.3.tar.gz"
ssh ${REMOTE_HOST} "[ -f ${REMOTE_DIR}${VEID}.1.tar.gz ] && mv -f ${REMOTE_DIR}${VEID}.1.tar.gz ${REMOTE_DIR}${VEID}.2.tar.gz"
ssh ${REMOTE_HOST} "[ -f ${REMOTE_DIR}${VEID}.0.tar.gz ] && mv -f ${REMOTE_DIR}${VEID}.0.tar.gz ${REMOTE_DIR}${VEID}.1.tar.gz"

# Create a remote tar archive - note you can remove the ampersand from the end if you
# don't want multiple tar processes running on the remote host simultaneously.
e "Making a g-zip compresssed tar archive on remote host (this process will run in the background on the remote host)."
ssh ${REMOTE_HOST} "tar czf ${REMOTE_DIR}${VEID}.0.tar.gz --numeric-owner -C ${REMOTE_DIR}${VEID} ./ 2>/dev/null " &
fi

e "Done."
done;
e "`hostname` - VZ backup for containers $VEIDS complete!" >> /tmp/vzbackuptimes
# Email a log of the backup process to some email address. Can be modified slightly to use native "mail" command
# if sendmail is installed and configured locally.
cat /tmp/vzbackuptimes | sendEmail -f root@`hostname` -t someuser@example.com -u "`hostname` VZ backup statistics." -s mail.example.com #(put your open relay here)
echo
cat /tmp/vzbackuptimes
rm /tmp/vzbackuptimes
</pre>

[[Category:HOWTO]]

Talk:Monitoring /proc/user beancounters with nagios

2008-08-14T06:14:57Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}

== Introduction ==

This script gives a warning if any parameter in a virtual environment (VZ) exceeds 80% of resources.

== packages basic installation ==
<pre>
aptitude install nail gawk
</pre>

== nail configuration ==
Configures <code> /etc/nailrc </code> or <code> ~/.mailrc </code> files.
<pre>
set smtp=smtp.server.org
set from=nail@smtp.server.org
set charset=iso-8859-1
</pre>

== configuration ==

Copy the script and configure the <code> /etc/crontab </code>

== Script resource ==

<source lang=bash>
#!/bin/bash resource.sh
# Copyright (C) 2008 Mgual
# Distributed under to GNU General Public License v2
# v0.1 2008-08-13
# Ajuntament de Benicarló

#!/bin/bash

gawk ' BEGIN {
printf "%3s %-20s %3s %3s \n", "ID", "Parameter", "%bar", "%lim" > "/tmp/beancounters"
}

/dummy/||/Version/||/uid/ { next }
! /:/ {
RESOURCE=$1
MAXHELD=$3
BARRIER=$4
LIMIT=$5
}
/:/ { gsub(/:/, "", $1)
printf "------- %s ------- \n",$1
VZ=$1
RESOURCE=$2
MAXHELD=$4
BARRIER=$5
LIMIT=$6
}
{
#printf "R=%s M=%s B=%s L=%s ", RESOURCE, MAXHELD, BARRIER, LIMIT
if (BARRIER>0) {
PBARRIER=MAXHELD*100/BARRIER
} else {
PBARRIER=0
}
if (LIMIT>0) {
PLIMIT=MAXHELD*100/LIMIT
} else {
PLIMIT=0
}
printf "%-20s %3d %3d ", RESOURCE , PBARRIER, PLIMIT
if (PBARRIER>=80) {
printf " Warning "
printf "%3d %-20s %3d %3d Perill\n", VZ, RESOURCE , PBARRIER, PLIMIT >> "/tmp/beancounters"
}
printf "\n"
}
' /proc/user_beancounters

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='Use Disc%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'

# Quota Disc

for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -h | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='IUse Disc%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'
for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -i | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

if [[ "$(cat /tmp/beancounters | wc -l)" != "5" ]] ; then
cat /tmp/beancounters | nail -s "Server:resource.sh Warning " user@smtp-server.org
fi

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T12:17:08Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}

== Introduction ==

This script gives a warning if any parameter in a virtual environment (VZ) exceeds 80% of resources.

== packages basic installation ==
<pre>
aptitude install nail gawk
</pre>

== nail configuration ==
Configures <code> /etc/nailrc </code> or <code> ~/.mailrc </code> files.
<pre>
set smtp=smtp.server.org
set from=nail@smtp.server.org
set charset=iso-8859-1
</pre>

== configuration ==

Copy the script and configure the <code> /etc/crontab </code>

== Script resource ==

<source lang=bash>
#!/bin/bash resource.sh
# Copyright (C) 2008 Mgual
# Distributed under to GNU General Public License v3
# v0.1 2008-08-13
# Ajuntament de Benicarló

#!/bin/bash

echo "" | gawk -vVZ='ID' -vRESOURCE='Parametre' -vPBARRIER='%bar' -vPLIMIT='%lim' '
{
printf "%3s %-20s %3s %3s \n", VZ, RESOURCE , PBARRIER, PLIMIT > "/tmp/beancounters"
}
'

gawk '
/dummy/||/Version/||/uid/ { next }
! /:/ {
RESOURCE=$1
MAXHELD=$3
BARRIER=$4
LIMIT=$5
}
/:/ { gsub(/:/, "", $1)
printf "------- %s ------- \n",$1
VZ=$1
RESOURCE=$2
MAXHELD=$4
BARRIER=$5
LIMIT=$6
}
{
#printf "R=%s M=%s B=%s L=%s ", RESOURCE, MAXHELD, BARRIER, LIMIT
if (BARRIER>0) {
PBARRIER=MAXHELD*100/BARRIER
} else {
PBARRIER=0
}
if (LIMIT>0) {
PLIMIT=MAXHELD*100/LIMIT
} else {
PLIMIT=0
}
printf "%-20s %3d %3d ", RESOURCE , PBARRIER, PLIMIT
if (PBARRIER>=80) {
printf " Perill "
printf "%3d %-20s %3d %3d Perill\n", VZ, RESOURCE , PBARRIER, PLIMIT >> "/tmp/beancounters"
}
printf "\n"
}
' /proc/user_beancounters

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='Use%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'

# Quota Disc

for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -h | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='IUse%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'
for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -i | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

if [[ "$(cat /tmp/beancounters | wc -l)" != "5" ]] ; then
cat /tmp/beancounters | nail -s Server:resource.sh perill@smtp-server.org
fi

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T12:12:41Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}

== Introduction ==

This script gives a warning if any parameter in a virtual environment (VZ) exceed 80% of resources.

== packages basic installation ==
<pre>
aptitude install nail gawk
</pre>

== nail configuration ==
Configures <code> /etc/nailrc </code> or <code> ~/.mailrc </code> files.
<pre>
set smtp=smtp.server.org
set from=nail@smtp.server.org
set charset=iso-8859-1
</pre>

== configuration ==

Copy the script and configure the <code> /etc/crontab </code>

== Script resource ==

<source lang=bash>
#!/bin/bash resource.sh
# Copyright (C) 2008 Mgual
# Distributed under to GNU General Public License v3
# v0.1 2008-08-13
# Ajuntament de Benicarló

#!/bin/bash

echo "" | gawk -vVZ='ID' -vRESOURCE='Parametre' -vPBARRIER='%bar' -vPLIMIT='%lim' '
{
printf "%3s %-20s %3s %3s \n", VZ, RESOURCE , PBARRIER, PLIMIT > "/tmp/beancounters"
}
'

gawk '
/dummy/||/Version/||/uid/ { next }
! /:/ {
RESOURCE=$1
MAXHELD=$3
BARRIER=$4
LIMIT=$5
}
/:/ { gsub(/:/, "", $1)
printf "------- %s ------- \n",$1
VZ=$1
RESOURCE=$2
MAXHELD=$4
BARRIER=$5
LIMIT=$6
}
{
#printf "R=%s M=%s B=%s L=%s ", RESOURCE, MAXHELD, BARRIER, LIMIT
if (BARRIER>0) {
PBARRIER=MAXHELD*100/BARRIER
} else {
PBARRIER=0
}
if (LIMIT>0) {
PLIMIT=MAXHELD*100/LIMIT
} else {
PLIMIT=0
}
printf "%-20s %3d %3d ", RESOURCE , PBARRIER, PLIMIT
if (PBARRIER>=80) {
printf " Perill "
printf "%3d %-20s %3d %3d Perill\n", VZ, RESOURCE , PBARRIER, PLIMIT >> "/tmp/beancounters"
}
printf "\n"
}
' /proc/user_beancounters

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='Use%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'

# Quota Disc

for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -h | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='IUse%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'
for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -i | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

if [[ "$(cat /tmp/beancounters | wc -l)" != "5" ]] ; then
cat /tmp/beancounters | nail -s Server:resource.sh perill@smtp-server.org
fi

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T12:07:01Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}

== Introduction ==

This script gives a warning if any parameter in a virtual environment (VZ) exceed 80% of resources.

== packages basic installation ==
<pre>
aptitude install nail gawk
</pre>

== nail configuration ==
Configures <code> /etc/nailrc </code> or <code> ~/.mailrc </code> files.
<pre>
set smtp=smtp.server.org
set from=nail@smtp.server.org
set charset=iso-8859-1
</pre>

== configuration ==

Copy the script and configure <code> /etc/crontab </code>

== Script resource ==

<source lang=bash>
#!/bin/bash resource.sh
# Copyright (C) 2008 Mgual
# Distributed under to GNU General Public License v3
# v0.1 2008-08-13
# Ajuntament de Benicarló

#!/bin/bash

echo "" | gawk -vVZ='ID' -vRESOURCE='Parametre' -vPBARRIER='%bar' -vPLIMIT='%lim' '
{
printf "%3s %-20s %3s %3s \n", VZ, RESOURCE , PBARRIER, PLIMIT > "/tmp/beancounters"
}
'

gawk '
/dummy/||/Version/||/uid/ { next }
! /:/ {
RESOURCE=$1
MAXHELD=$3
BARRIER=$4
LIMIT=$5
}
/:/ { gsub(/:/, "", $1)
printf "------- %s ------- \n",$1
VZ=$1
RESOURCE=$2
MAXHELD=$4
BARRIER=$5
LIMIT=$6
}
{
#printf "R=%s M=%s B=%s L=%s ", RESOURCE, MAXHELD, BARRIER, LIMIT
if (BARRIER>0) {
PBARRIER=MAXHELD*100/BARRIER
} else {
PBARRIER=0
}
if (LIMIT>0) {
PLIMIT=MAXHELD*100/LIMIT
} else {
PLIMIT=0
}
printf "%-20s %3d %3d ", RESOURCE , PBARRIER, PLIMIT
if (PBARRIER>=80) {
printf " Perill "
printf "%3d %-20s %3d %3d Perill\n", VZ, RESOURCE , PBARRIER, PLIMIT >> "/tmp/beancounters"
}
printf "\n"
}
' /proc/user_beancounters

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='Use%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'

# Quota Disc

for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -h | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='IUse%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'
for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -i | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

if [[ "$(cat /tmp/beancounters | wc -l)" != "5" ]] ; then
cat /tmp/beancounters | nail -s Server:resource.sh perill@smtp-server.org
fi

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T12:04:02Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}

== Introduction ==

This script gives a warning if any parameter in a virtual environment (VZ) exceed 80% of resources.

== packages basic installation ==
<pre>
aptitude install nail gawk
</pre>

== nail configuration ==
Configures <code> /etc/nailrc </code> or <code> ~/.mailrc </code> files.
<pre>
set smtp=smtp.server.org
set from=nail@smtp.server.org
set charset=iso-8859-1
</pre>

== configuration ==

Copy the script and configure <code> /etc/crontab </code>

== Script resource ==

<source lang=bash>
#!/bin/bash resource.sh
# Copyright (C) 2008 Mgual
# Distributed under to GNU General Public License v3
# v0.1 2008-08-13
# Ajuntament de Benicarló
# Miquel Gual Torner

#!/bin/bash

echo "" | gawk -vVZ='ID' -vRESOURCE='Parametre' -vPBARRIER='%bar' -vPLIMIT='%lim' '
{
printf "%3s %-20s %3s %3s \n", VZ, RESOURCE , PBARRIER, PLIMIT > "/tmp/beancounters"
}
'

gawk '
/dummy/||/Version/||/uid/ { next }
! /:/ {
RESOURCE=$1
MAXHELD=$3
BARRIER=$4
LIMIT=$5
}
/:/ { gsub(/:/, "", $1)
printf "------- %s ------- \n",$1
VZ=$1
RESOURCE=$2
MAXHELD=$4
BARRIER=$5
LIMIT=$6
}
{
#printf "R=%s M=%s B=%s L=%s ", RESOURCE, MAXHELD, BARRIER, LIMIT
if (BARRIER>0) {
PBARRIER=MAXHELD*100/BARRIER
} else {
PBARRIER=0
}
if (LIMIT>0) {
PLIMIT=MAXHELD*100/LIMIT
} else {
PLIMIT=0
}
printf "%-20s %3d %3d ", RESOURCE , PBARRIER, PLIMIT
if (PBARRIER>=80) {
printf " Perill "
printf "%3d %-20s %3d %3d Perill\n", VZ, RESOURCE , PBARRIER, PLIMIT >> "/tmp/beancounters"
}
printf "\n"
}
' /proc/user_beancounters

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='Use%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'

# Quota Disc

for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -h | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='IUse%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'
for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -i | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

if [[ "$(cat /tmp/beancounters | wc -l)" != "5" ]] ; then
cat /tmp/beancounters | nail -s Server:resource.sh perill@smtp-server.org
fi

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T10:54:18Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}

== Introduction ==

To be added locally on the VZ HN to <code> /etc/crontab </code> to script <code> resource.sh </code>

== Package Install base ==
<pre>
aptitude install nail gawk
</pre>

== nail configuration ==
To configure file <code> /etc/nailrc </code> or <code> ~/.mailrc </code>
<pre>
set smtp=smtp.server.org
set from=nail@smtp.server.org
set charset=iso-8859-1
</pre>

== Script eesource ==

<source lang=bash>
#!/bin/bash resource.sh
# Copyright (C) 2008 Mgual
# Distributed under to GNU General Public License v3
# v0.2 2008-08-13
# Miquel Gual Torner

#!/bin/bash

echo "" | gawk -vVZ='ID' -vRESOURCE='Parametre' -vPBARRIER='%bar' -vPLIMIT='%lim' '
{
printf "%3s %-20s %3s %3s \n", VZ, RESOURCE , PBARRIER, PLIMIT > "/tmp/beancounters"
}
'

gawk '
/dummy/||/Version/||/uid/ { next }
! /:/ {
RESOURCE=$1
MAXHELD=$3
BARRIER=$4
LIMIT=$5
}
/:/ { gsub(/:/, "", $1)
printf "------- %s ------- \n",$1
VZ=$1
RESOURCE=$2
MAXHELD=$4
BARRIER=$5
LIMIT=$6
}
{
#printf "R=%s M=%s B=%s L=%s ", RESOURCE, MAXHELD, BARRIER, LIMIT
if (BARRIER>0) {
PBARRIER=MAXHELD*100/BARRIER
} else {
PBARRIER=0
}
if (LIMIT>0) {
PLIMIT=MAXHELD*100/LIMIT
} else {
PLIMIT=0
}
printf "%-20s %3d %3d ", RESOURCE , PBARRIER, PLIMIT
if (PBARRIER>=80) {
printf " Perill "
printf "%3d %-20s %3d %3d Perill\n", VZ, RESOURCE , PBARRIER, PLIMIT >> "/tmp/beancounters"
}
printf "\n"
}
' /proc/user_beancounters

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='Use%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'

# Quota Disc

for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -h | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='IUse%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'
for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -i | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

if [[ "$(cat /tmp/beancounters | wc -l)" != "5" ]] ; then
cat /tmp/beancounters | nail -s Server:resource.sh perill@smtp-server.org
fi

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T10:53:48Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}

== Introduction ==

To be added locally on the VZ HN to <code> /etc/crontab </code> to script <code> resource.sh </code>

== Package Install base ==
<pre>
aptitude install nail gawk
</pre>

== nail configuration ==
To configure file <code> /etc/nailrc </code> or <code> ~/.mailrc </code>
<pre>
set smtp=smtp.server.org
set from=nail@smtp.server.org
set charset=iso-8859-1
</pre>

== Script Alarm ==

<source lang=bash>
#!/bin/bash resource.sh
# Copyright (C) 2008 Mgual
# Distributed under to GNU General Public License v3
# v0.2 2008-08-13
# Miquel Gual Torner

#!/bin/bash

echo "" | gawk -vVZ='ID' -vRESOURCE='Parametre' -vPBARRIER='%bar' -vPLIMIT='%lim' '
{
printf "%3s %-20s %3s %3s \n", VZ, RESOURCE , PBARRIER, PLIMIT > "/tmp/beancounters"
}
'

gawk '
/dummy/||/Version/||/uid/ { next }
! /:/ {
RESOURCE=$1
MAXHELD=$3
BARRIER=$4
LIMIT=$5
}
/:/ { gsub(/:/, "", $1)
printf "------- %s ------- \n",$1
VZ=$1
RESOURCE=$2
MAXHELD=$4
BARRIER=$5
LIMIT=$6
}
{
#printf "R=%s M=%s B=%s L=%s ", RESOURCE, MAXHELD, BARRIER, LIMIT
if (BARRIER>0) {
PBARRIER=MAXHELD*100/BARRIER
} else {
PBARRIER=0
}
if (LIMIT>0) {
PLIMIT=MAXHELD*100/LIMIT
} else {
PLIMIT=0
}
printf "%-20s %3d %3d ", RESOURCE , PBARRIER, PLIMIT
if (PBARRIER>=80) {
printf " Perill "
printf "%3d %-20s %3d %3d Perill\n", VZ, RESOURCE , PBARRIER, PLIMIT >> "/tmp/beancounters"
}
printf "\n"
}
' /proc/user_beancounters

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='Use%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'

# Quota Disc

for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -h | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='IUse%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'
for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -i | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

if [[ "$(cat /tmp/beancounters | wc -l)" != "5" ]] ; then
cat /tmp/beancounters | nail -s Server:resource.sh perill@smtp-server.org
fi

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T10:44:55Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}
To be added locally on the VZ HN to <code> /etc/crontab </code> to script <code> resource.sh </code>

<source lang=bash>
#!/bin/bash
# Copyright (C) 2008 Mgual
# Distributed under to GNU General Public License v3
# v0.2 2008-08-13
# Miquel Gual Torner

#!/bin/bash

echo "" | gawk -vVZ='ID' -vRESOURCE='Parametre' -vPBARRIER='%bar' -vPLIMIT='%lim' '
{
printf "%3s %-20s %3s %3s \n", VZ, RESOURCE , PBARRIER, PLIMIT > "/tmp/beancounters"
}
'

gawk '
/dummy/||/Version/||/uid/ { next }
! /:/ {
RESOURCE=$1
MAXHELD=$3
BARRIER=$4
LIMIT=$5
}
/:/ { gsub(/:/, "", $1)
printf "------- %s ------- \n",$1
VZ=$1
RESOURCE=$2
MAXHELD=$4
BARRIER=$5
LIMIT=$6
}
{
#printf "R=%s M=%s B=%s L=%s ", RESOURCE, MAXHELD, BARRIER, LIMIT
if (BARRIER>0) {
PBARRIER=MAXHELD*100/BARRIER
} else {
PBARRIER=0
}
if (LIMIT>0) {
PLIMIT=MAXHELD*100/LIMIT
} else {
PLIMIT=0
}
printf "%-20s %3d %3d ", RESOURCE , PBARRIER, PLIMIT
if (PBARRIER>=80) {
printf " Perill "
printf "%3d %-20s %3d %3d Perill\n", VZ, RESOURCE , PBARRIER, PLIMIT >> "/tmp/beancounters"
}
printf "\n"
}
' /proc/user_beancounters

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='Use%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'

# Quota Disc

for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -h | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

echo "---------------------------------------------------" >> /tmp/beancounters
echo "" | gawk -vVZ='ID' -vRESOURCE='IUse%' '
{
printf "%3s %-20s \n", VZ, RESOURCE >> "/tmp/beancounters"
}
'
for i in $(vzlist | cut -d" " -f 8)
do
vzctl exec $i df -i | gawk -vVEID=$i '/^simfs/ { if ($5 > "80%") { printf "%s %s\n", VEID, $5 } }' >>/tmp/beancounters

done

if [[ "$(cat /tmp/beancounters | wc -l)" != "5" ]] ; then
cat /tmp/beancounters | nail -s Server:resource.sh perill@smtp-server.org
fi

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T10:40:13Z

Mgual:

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T10:39:42Z

Mgual:

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}
To be added locally on the VZ HN to <code> /etc/crontab </code> to script <code> resource.sh <code>

<source lang=shell>
#!/bin/bash
# Copyright (C) 2008 Mgual
# Distributed under GNU General Public License v3
# v0.2 2008-04-04
# Christian Benke <benkokakao gmail com>

import string
import pickle
import sys
import getopt
import re

veid=''
current_data=dict()

Talk:Monitoring /proc/user beancounters with nagios

2008-08-13T10:36:45Z

Mgual: New page: {{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}} To be added locally on the VZ HN to Works as nagios-plugin with option '-f' or reports an increase of a failcnt-value by ma...

{{DISPLAYTITLE:Monitoring /proc/user_beancounters with email}}
To be added locally on the VZ HN to

Works as nagios-plugin with option '-f' or reports an increase of a failcnt-value by mail if run e.g. as a cronjob with option '-t'. We use it with both cases to be sure that we see a peak in case it happened between the nagios-checks.

<source lang=python>
#!/usr/bin/python
# Copyright (C) 2008 Christian Benke
# Distributed under the terms of the GNU General Public License v2
# v0.2 2008-04-04
# Christian Benke <benkokakao gmail com>

import string
import pickle
import sys
import getopt
import re

veid=''
current_data=dict()