[rrd-users] Re: Migrating RRD data to RDBMS

[Ruttenberg, Tanya]

On Wed, 2006-01-25 at 12:20 -0500, Ruttenberg, Tanya wrote:
> We have a requirement to migrate data from RRD files to an RDBMS.  
> 
> My current idea is to do a daily export from the rrdfiles, parse the 
> export file, and update the RDBMS with the resulting numbers.
> 
> Is anyone out there doing this already?  Suggestions?

I just wanted to give the follow-up on this post in case anyone finds it
useful.

I forgot to say that I am only involved in the end of the project that
involves getting the data out of the rrdfiles in a text format and packaging
it up for delivery.  I got a good tip from someone that if you use the
timestamp as the primary key when loading the data it ensures you do not get
duplicate data.  Therefore one of the considerations was to make sure the
timestamp was part of the output.

Using a bourne shell wrapper to a perl script I did the following:

Grepped my extensive collection (6500) of MRTG config files for Target names
with Se or Mu in the description (Serial or Multilink interfaces, which is
all we wanted).  Fed each target to a perl script which used Data::Manip to
specify "midnight" as an end time and a start time of "end - 24 hours",
figured out the name of the rrd file based on the target, and used a pipe
(RRDp) to export the data to a file in a directory.

It will be up to the other group to parse the data from the export files
(something they already figured out how to do) and slurp it into the
database of choice.


Tanya Ruttenberg - RSIS Contractor
OTSO/DNE/NMPEB
tanya.ruttenberg at ssa.gov
410-965-9605

--
Unsubscribe mailto:rrd-users-request at list.ee.ethz.ch?subject=unsubscribe
Help        mailto:rrd-users-request at list.ee.ethz.ch?subject=help
Archive     http://lists.ee.ethz.ch/rrd-users
WebAdmin    http://lists.ee.ethz.ch/lsg2.cgi