[rrd-users] Re: RRD-Performance Issue - Need Help

[Darryl Lewis]

Here are some suggestions;
Depends on how complicated you shell/awk scripts are.
Calling individual shell scripts are slower than having parameters read into a loop to go thru each server.
i.e.
while read servername
  do
  [snmp walk $servername]
  [update rrd $servername]
  [rrd graph $servername]
done <config.txt

config.txt contains a list of you servers or IP addresses, each on their own line
111.222.333.444
111.222.333.445
etc

Also if you have any often called pieces of code, put them in a function, as it stays in memory and it is faster.

Other things to look at, is the performance of the box itself. 
Set up some rrdgraphs to monitor your local machine and find out if it is CPU bound, or I/O bound.
Last time I was having trouble, I needed to upgrade the nic in the computer.

cheers
Darryl

-----Original Message-----
From: rrd-users-bounce at list.ee.ethz.ch
[mailto:rrd-users-bounce at list.ee.ethz.ch]On Behalf Of Simone Felici
Sent: Tuesday, 20 June 2006 7:58 PM
To: rrd-users at list.ee.ethz.ch
Subject: [rrd-users] RRD-Performance Issue - Need Help


Hello to all!

I've a little problem with our server and update rrd-files. We have 5300
rrd-files updated every 5 minutes. 4000 rrd-files of them are collected from
two devices.
These are two DSL routers. In there are configured all xDSL lines of our
customers. I've made a script do the following:

1. snmpwalk of full entry on first dsl router about all Incoming Traffic
(Inoctets) on all lines and stored into in.txt file
2. snmpwalk of full entry on first dsl router about all OUTgoing Traffic
(OutOctets) on all lines and stored into out.txt file
3. for every line configured and stored into in.txt file:
4. get uptime on router to determinate uptime and prevent spikes if router
is rebooted
5. determinate line id
6. determinate InCounter32 (cat in.txt | grep line | awk blablabla)
7. determinate OutCounter32 (cat out.txt | grep line | awk blablabla)
8. update rrd-file in and out (depends if in and/or out are equal to zero,
then skip update)

Equal script for second router.

The snmpwalk is fast, but the cicle with all grep, awk, rrdtool update needs
minimum 7 minutes on first router and 20 minutes on second router!!
It's normal that starting this script every 5 minutes it means a lot of
istances :((

Other useful infos:

RRA creation:
RRA:AVERAGE:0.5:1:2016 RRA:AVERAGE:0.5:24:390 RRA:AVERAGE:0.5:288:1830
RRA:MAX:0.5:1:2016 RRA:MAX:0.5:24:390 RRA:MAX:0.5:288:1830
RRA:MIN:0.5:1:2016 RRA:MIN:0.5:24:390 RRA:MIN:0.5:288:1830

Server:
Intel(R) Pentium(R) 4 CPU 2.80GHz (bogomips: 5583.66)
Fedora Core release 1 (Yarrow)
Linux 2.4.22-1.2115.nptlsmp
1 GB RAM
RRDtool 1.0.49
AVERAGE LOAD 20.00 (!!!!!)

Any suggesions on how improve performance or any other solution?

Thank's!

Simon


--
Unsubscribe mailto:rrd-users-request at list.ee.ethz.ch?subject=unsubscribe
Help        mailto:rrd-users-request at list.ee.ethz.ch?subject=help
Archive     http://lists.ee.ethz.ch/rrd-users
WebAdmin    http://lists.ee.ethz.ch/lsg2.cgi


==============================================================================
The information contained in this email and any attachment is confidential and
may contain legally privileged or copyright material.   It is intended only for
the use of the addressee(s).  If you are not the intended recipient of this
email, you are not permitted to disseminate, distribute or copy this email or
any attachments.  If you have received this message in error, please notify the
sender immediately and delete this email from your system.  The ABC does not
represent or warrant that this transmission is secure or virus free.   Before
opening any attachment you should check for viruses.  The ABC's liability is
limited to resupplying any email and attachments
==============================================================================

--
Unsubscribe mailto:rrd-users-request at list.ee.ethz.ch?subject=unsubscribe
Help        mailto:rrd-users-request at list.ee.ethz.ch?subject=help
Archive     http://lists.ee.ethz.ch/rrd-users
WebAdmin    http://lists.ee.ethz.ch/lsg2.cgi