OpenVZ Virtuozzo Containers Wiki - User contributions [en]

Traffic accounting through proc

2010-04-19T03:10:23Z

Denisix: /* Script */

Traffic Accounting through /proc/net/dev

== Introduction ==
Traffic accounting in OpenVZ can be done through data collection against
<code>/proc/net/dev</code> in the individual containers on a [[HN]].

== Prerequisites ==
* OpenVZ
* RRDTool
* GNU AWK

== Script ==
First create a directory to store your RRD files:

# mkdir /var/lib/rrd/

Then install this script:

<source lang="bash">
#!/bin/sh
# Script Name: vz_direct_traffic_log
# Author: "Brian Harrington, Alticon Inc" <bharrington@alticon.net>
# Website: htty://www.alticon.net
# Editor: "Denis Titov, ISP Okeanika" <denis@okeanika.net.ua>

# Time to do the data collection.
for veid in `/usr/sbin/vzlist -o veid -H | sed 's/ //g'`
do
RRDFILE="/var/lib/rrd/$veid.rrd"
if ! test -e $RRDFILE; then
echo $RRDFILE does not exist, creating.

# Place your preferred RRD Creation command here
# or use this one, following command will create new RRD file with 300 sec step (for 5 min cron)
/usr/bin/rrdtool create $RRDFILE --step 300 \
DS:IN:COUNTER:1000:0:U \
DS:OUT:COUNTER:1000:0:U \
RRA:AVERAGE:0.5:1:600000 \
RRA:AVERAGE:0.5:100:60000 \
RRA:AVERAGE:0.5:1000:6000
fi
# Parse out the inbound/outbound traffic and assign them to the corresponding variables
eval `/usr/sbin/vzctl exec $veid "grep venet0 /proc/net/dev" | \
awk -F: '{print $2}' | awk '{printf"CTIN=%-15d\nCTOUT=%-15d\n", $1, $9}'`

# Send the data to the corresponding RRD time with (N)now as the update time
/usr/bin/rrdtool update $RRDFILE N:$CTIN:$CTOUT
done
</source>

the following script uses previously generated RRD's, you'll get nice PNG pictures and index.html file with them:

<source lang="bash">
#!/bin/sh
# Script Name: vz_direct_traffic_render
# Author: "Denis Titov, ISP Okeanika" <denis@okeanika.net.ua>
# Website: http://www.okeanika.net.ua

rrd_path=/var/lib/rrd
www_path=/var/www/html/traf

cd $rrd_path
for RRD in *.rrd
do
CTID=`echo $RRD|awk -F\. '{print $1}'`

# list of intervals, 1d = last day, 1w = last week and so..
for INT in 1h 1d 1w 1m 1y
do
/usr/bin/rrdtool graph $www_path/${CTID}-${INT}.png \
--start now-$INT --end now \
-w 1000 -h 500 \
--title "CTID $CTID - Interval $INT" \
DEF:in=$RRD:IN:AVERAGE AREA:in#aea:'IN' LINE1:in#0e0 \
DEF:out=$RRD:OUT:AVERAGE AREA:out#eaa:'OUT' LINE1:out#e00
echo "<img src=\"${CTID}-${INT}.png\"> " >> $www_path/index.html
done
done
</source>

== Setup ==
Add this to cron to run every vz_direct_traffic_log every 5 min and vz_direct_traffic_render every 30 min:

# echo -e "*/5 * * * * root /path/to/script/vz_direct_traffic_log\n*/30 * * * * root /path/to/script/vz_direct_traffic_render " >> \
/etc/crontab && /etc/init.d/crontab restart

Better use the cron system of OpenVZ

# echo -e "*/5 * * * * root /path/to/script/vz_direct_traffic_log\n*/30 * * * * root /path/to/script/vz_direct_traffic_render " >> \
/etc/vz/cron/vz-traffic.sh && /etc/init.d/vz update-cron

To check the output of this later run:

# rrdtool fetch /var/lib/rrd/<veid>.rrd AVERAGE -s -3600

== See also ==

* [[Traffic accounting with iptables]]
* [[Monitoring bandwidth of containers]]

[[Category: Monitoring]]
[[Category: Networking]]

Traffic accounting through proc

2010-04-19T03:00:41Z

Denisix: /* Setup */

Traffic Accounting through /proc/net/dev

== Introduction ==
Traffic accounting in OpenVZ can be done through data collection against
<code>/proc/net/dev</code> in the individual containers on a [[HN]].

== Prerequisites ==
* OpenVZ
* RRDTool
* GNU AWK

== Script ==
First create a directory to store your RRD files:

# mkdir /var/lib/rrd/

Then install this script:

<source lang="bash">
#!/bin/sh
# Script Name: vz_direct_traffic_log
# Author: "Brian Harrington, Alticon Inc" <bharrington@alticon.net>
# Website: htty://www.alticon.net
# Editor: "Denis Titov, ISP Okeanika" <denis@okeanika.net.ua>

# Time to do the data collection.
for veid in `/usr/sbin/vzlist -o veid -H | sed 's/ //g'`
do
RRDFILE="/var/lib/rrd/$veid.rrd"
if ! test -e $RRDFILE; then
echo $RRDFILE does not exist, creating.

# Place your preferred RRD Creation command here
# or use this one, following command will create new RRD file with 300 sec step (for 5 min cron)
/usr/bin/rrdtool create $RRDFILE --step 300 \
DS:IN:COUNTER:1000:0:U \
DS:OUT:COUNTER:1000:0:U \
RRA:AVERAGE:0.5:1:600000 \
RRA:AVERAGE:0.5:100:60000 \
RRA:AVERAGE:0.5:1000:6000
fi
# Parse out the inbound/outbound traffic and assign them to the corresponding variables
eval `/usr/sbin/vzctl exec $veid "grep venet0 /proc/net/dev" | \
awk -F: '{print $2}' | awk '{printf"CTIN=%-15d\nCTOUT=%-15d\n", $1, $9}'`

# Send the data to the corresponding RRD time with (N)now as the update time
/usr/bin/rrdtool update $RRDFILE N:$CTIN:$CTOUT
done
</source>

the following script uses previously generated RRD's, you'll get nice PNG pictures and index.html file with them:

<source lang="bash">
#!/bin/sh
# Script Name: vz_direct_traffic_render
# Author: "Denis Titov, ISP Okeanika" <denis@okeanika.net.ua>
# Website: http://www.okeanika.net.ua

rrd_path=/var/lib/rrd
www_path=/var/www/html/traf

cd $rrd_path
for RRD in *.rrd
do
CTID=`echo $RRD|awk -F\. '{print $1}'`

# list of intervals, 1d = last day, 1w = last week and so..
for INT in 1h 1d 1w 1m 1y
do
/usr/bin/rrdtool graph $www_path/${CTID}-${INT}.png \
--start now-$INT --end now \
-w 1000 -h 500 \
--title "CTID $CTID - Interval $INT" \
DEF:in=$RRD:IN:AVERAGE AREA:in#aea:'IN' LINE1:in#0e0 \
DEF:out=$RRD:OUT:AVERAGE AREA:out#eaa:'OUT' LINE1:in#e00
echo "<img src=\"${CTID}-${INT}.png\"> " >> $www_path/index.html
done
done
</source>

== Setup ==
Add this to cron to run every vz_direct_traffic_log every 5 min and vz_direct_traffic_render every 30 min:

# echo -e "*/5 * * * * root /path/to/script/vz_direct_traffic_log\n*/30 * * * * root /path/to/script/vz_direct_traffic_render " >> \
/etc/crontab && /etc/init.d/crontab restart

Better use the cron system of OpenVZ

# echo -e "*/5 * * * * root /path/to/script/vz_direct_traffic_log\n*/30 * * * * root /path/to/script/vz_direct_traffic_render " >> \
/etc/vz/cron/vz-traffic.sh && /etc/init.d/vz update-cron

To check the output of this later run:

# rrdtool fetch /var/lib/rrd/<veid>.rrd AVERAGE -s -3600

== See also ==

* [[Traffic accounting with iptables]]
* [[Monitoring bandwidth of containers]]

[[Category: Monitoring]]
[[Category: Networking]]

Traffic accounting through proc

2010-04-19T02:55:46Z

Denisix: /* Script */

Traffic Accounting through /proc/net/dev

== Introduction ==
Traffic accounting in OpenVZ can be done through data collection against
<code>/proc/net/dev</code> in the individual containers on a [[HN]].

== Prerequisites ==
* OpenVZ
* RRDTool
* GNU AWK

== Script ==
First create a directory to store your RRD files:

# mkdir /var/lib/rrd/

Then install this script:

<source lang="bash">
#!/bin/sh
# Script Name: vz_direct_traffic_log
# Author: "Brian Harrington, Alticon Inc" <bharrington@alticon.net>
# Website: htty://www.alticon.net
# Editor: "Denis Titov, ISP Okeanika" <denis@okeanika.net.ua>

# Time to do the data collection.
for veid in `/usr/sbin/vzlist -o veid -H | sed 's/ //g'`
do
RRDFILE="/var/lib/rrd/$veid.rrd"
if ! test -e $RRDFILE; then
echo $RRDFILE does not exist, creating.

# Place your preferred RRD Creation command here
# or use this one, following command will create new RRD file with 300 sec step (for 5 min cron)
/usr/bin/rrdtool create $RRDFILE --step 300 \
DS:IN:COUNTER:1000:0:U \
DS:OUT:COUNTER:1000:0:U \
RRA:AVERAGE:0.5:1:600000 \
RRA:AVERAGE:0.5:100:60000 \
RRA:AVERAGE:0.5:1000:6000
fi
# Parse out the inbound/outbound traffic and assign them to the corresponding variables
eval `/usr/sbin/vzctl exec $veid "grep venet0 /proc/net/dev" | \
awk -F: '{print $2}' | awk '{printf"CTIN=%-15d\nCTOUT=%-15d\n", $1, $9}'`

# Send the data to the corresponding RRD time with (N)now as the update time
/usr/bin/rrdtool update $RRDFILE N:$CTIN:$CTOUT
done
</source>

the following script uses previously generated RRD's, you'll get nice PNG pictures and index.html file with them:

<source lang="bash">
#!/bin/sh
# Script Name: vz_direct_traffic_render
# Author: "Denis Titov, ISP Okeanika" <denis@okeanika.net.ua>
# Website: http://www.okeanika.net.ua

rrd_path=/var/lib/rrd
www_path=/var/www/html/traf

cd $rrd_path
for RRD in *.rrd
do
CTID=`echo $RRD|awk -F\. '{print $1}'`

# list of intervals, 1d = last day, 1w = last week and so..
for INT in 1h 1d 1w 1m 1y
do
/usr/bin/rrdtool graph $www_path/${CTID}-${INT}.png \
--start now-$INT --end now \
-w 1000 -h 500 \
--title "CTID $CTID - Interval $INT" \
DEF:in=$RRD:IN:AVERAGE AREA:in#aea:'IN' LINE1:in#0e0 \
DEF:out=$RRD:OUT:AVERAGE AREA:out#eaa:'OUT' LINE1:in#e00
echo "<img src=\"${CTID}-${INT}.png\"> " >> $www_path/index.html
done
done
</source>

== Setup ==
Add this to cron to run every 5 minutes:

# echo "*/5 * * * * root /path/to/script/vz_direct_traffic_log " >> \
/etc/crontab && /etc/init.d/crontab restart

Better use the cron system of OpenVZ

# echo "*/5 * * * * root /path/to/script/vz_direct_traffic_log " >> \
/etc/vz/cron/vz-traffic.sh && /etc/init.d/vz update-cron

To check the output of this later run:

# rrdtool fetch /var/lib/rrd/<veid>.rrd AVERAGE -s -3600

== See also ==

* [[Traffic accounting with iptables]]
* [[Monitoring bandwidth of containers]]

[[Category: Monitoring]]
[[Category: Networking]]

Traffic accounting through proc

2010-04-19T02:21:37Z

Denisix: /* Script */

Traffic accounting through proc

2010-04-19T02:20:29Z

Denisix: /* Script */