[rrd-developers] SQL Backend request

Martin Sperl rrdtool at martin.sperl.org
Wed May 16 07:00:20 CEST 2007


Hi Toby!

Do you know which parameters you are talking about exactly?

We have experience that for some reason we are able to update 40k rrd 
files every 5 minutes on an Intel RH7.2 system, but when we tried to 
migrate to RHES4 the system would no longer perform and we reach a limit 
of 20k RRD files updated every 5 minutes and then the updates to all 
those files fall apart.

It seems as if the 2.6 Kernel is doing some more agressive prefetching 
of blocks when opening each RRD file...

I remember having looked for tweaking, but I have never found a 
conclusive answer... That is why I initially started the libdbi patch...

Ciao,
          Martin

Tobias Oetiker wrote:
> Hi Robert,
>
> you may want to look at your sytem configuration ... especially
> blocksized and cache handling ... how often to you want to update
> these 100k rrd files per minute  ?
>
> cheers
> tobi
>
>
>   
>> I while ago I noticed a topic that let rrdtool use a database backend.  What
>> is the status with this project?  Also, has this turned out to be a viable
>> solution when updating large amounts of rrd files?  We're currently
>> exploring other storage media to help our writes become faster.  We are
>> currently writing just under 100K rrd files and have distributed writing.
>> We were thinking of modifying rrdtool to use a MySql database and would like
>> to modify the database beackend I saw on the list (if needed) accordingly so
>> that we don't have to re-invent the wheel.
>>
>> I tried to look through the archives, but was only seeing patches to the
>> library file.  Is there a place to get the whole thing at?  I couldn't see
>> it in the /lib or /contrib download directories of the main site.
>>
>>
>>     
>
>   

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.oetiker.ch/pipermail/rrd-developers/attachments/20070516/94ddfd76/attachment-0001.htm 


More information about the rrd-developers mailing list