[rrd-users] Strategies for data storage and graphing

[Kenneth Kalmer]

Guys

This is my first post to the list, please excuse if me if it's not up
to scratch...

I currently collect network accounting data using pmacct and save it
to MySQL. Due to the nature of the network we need to keep a massive
amount of data for various reporting. I've been playing with rrdtool
and a sample of the data with great results.

I'd like to know what would be the best way to populate the rrd's from
the data in the database to create graphs. I know there are plenty of
ways, but speed is number one here. I'm also positive that I'm not
first one facing this problem...

Currently I'm faced with two possibilities, and would like any
suggestions on better ways of doing this.

1) Create the rrd, populate and graph in one smooth step. Works fine,
but to populate 90 days worth of 300 second step data can take up to 5
minutes... Not desirable...

2) At set intervals, simply populate pre-created rrd's with the new
data since the last update, and when needed to graph add the remaining
data on-demand... Keeping track of the updates won't be difficult...
Haven't built this yet, but in theory it should yield much better
performance.

It boils down to needing rrd's excellent graphing capabilities, as
well as blistering speed when generating reports. This must be the
same problem the developers of cacti faced with all the data in MySQL,
and rrdtools graphing... Speaking of which, I'm about to tear up the
cacti code looking for insight, but any advise would be appreciated...

Best

--

Kenneth Kalmer
kenneth.kalmer at gmail.com

Folding at home stats
http://fah-web.stanford.edu/cgi-bin/main.py?qtype=userpage&username=kenneth%2Ekalmer

--
Unsubscribe mailto:rrd-users-request at list.ee.ethz.ch?subject=unsubscribe
Help        mailto:rrd-users-request at list.ee.ethz.ch?subject=help
Archive     http://lists.ee.ethz.ch/rrd-users
WebAdmin    http://lists.ee.ethz.ch/lsg2.cgi