[rrd-users] to many "data agregation" transactions at the same time

[Tobias Oetiker]

Hi Kristoff,

Today Kristoff Bonne wrote:

> Hi,
>
>
> We have an annoying problem.
>
> We have a tool that runs daily that does "network discovery" of net
> devices and creates .rrd automatically based on this.
>
>
> However, as this runs on crontab, we have now end up with a situation
> where a lot of .rrd files (thousands) where created at the same time of
> the day. The result is that the "data aggregation" process of all these
> .rrd files start at roughly the same time; and this causes disk IO
> congestion.
>
>
> OK, we have now taken steps to run the script at different times; but
> the problem is now "what to do with all the files we now have".
>
> What would be the best way to deal with this?
>
> The only thing I can think of to do a "rrdtool dump" of the files, run a
> perl-script to modify the time-stamps in the text-file (e.g. move all
> "every 24h" stats up by one hour) and then recreate a binary .rrd files
> based on that.
>
> Is this a feasable option? (it's not easy, but it's scriptable).
>
> Are the timestamps in the "every 24 hours" stats related to the
> timestamps of (say) the "every 2 hours" stats?

the 'roll up' happens at the same time, no matter what since it is
tied to the time of day. BUT the jumping from 1 block to another
can differ (write position inside each rra), and since 1.4 (I
think) rrdtool is randimizing this at creation time ...

cheers
tobi
>
>
>
>
> Cheerio! Kr. Bonne.
>
> _______________________________________________
> rrd-users mailing list
> rrd-users at lists.oetiker.ch
> https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
>
>

-- 
Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland
http://it.oetiker.ch tobi at oetiker.ch ++41 62 775 9902 / sb: -9900