[rrd-users] Slow collection runtimes occurring regularly

[Joshua Keroes]

Our collectors run long at regular intervals; in particular every two hours,
and to lesser extents every hour and half hour. Here's a graph showing how
long each collection cycle lasts on one of the collection machines:
http://i.imgur.com/xaZJ5.png – note the regular spikes.

Most RRD's consolidate every 30 minutes, 2 hours, and 24 hours; see the
bottom for a sample `rrd info`. Our current theory is that the RRD
consolidations are causing these long runtimes. If that's the case, is there
a way to evenly stagger the consolidations over time so we can better
distribute RRD update load?

Thanks,
Joshua

filename = "/rrd/router/cr01.ptleorte.integra.net/tengigabitethernet134.rrd"


rrd_version = "0003"


step = 300


last_update = 1304228713


ds[ds0].type = "COUNTER"


ds[ds0].minimal_heartbeat = 600


ds[ds0].min = 0.0000000000e+00


ds[ds0].max = 1.2500000000e+09


ds[ds0].last_ds = "1596044569532963"


ds[ds0].value = 4.0248335433e+08


ds[ds0].unknown_sec = 0


ds[ds1].type = "COUNTER"


ds[ds1].minimal_heartbeat = 600


ds[ds1].min = 0.0000000000e+00


ds[ds1].max = 1.2500000000e+09


ds[ds1].last_ds = "3460406816844600"


ds[ds1].value = 8.9596753966e+08


ds[ds1].unknown_sec = 0


rra[0].cf = "AVERAGE"


rra[0].rows = 600


rra[0].pdp_per_row = 1


rra[0].xff = 5.0000000000e-01


rra[0].cdp_prep[0].value = NaN


rra[0].cdp_prep[0].unknown_datapoints = 0


rra[0].cdp_prep[1].value = NaN


rra[0].cdp_prep[1].unknown_datapoints = 0


rra[1].cf = "AVERAGE"


rra[1].rows = 600


rra[1].pdp_per_row = 6


rra[1].xff = 5.0000000000e-01


rra[1].cdp_prep[0].value = 9.4104250250e+07


rra[1].cdp_prep[0].unknown_datapoints = 0


rra[1].cdp_prep[1].value = 2.0174889583e+08


rra[1].cdp_prep[1].unknown_datapoints = 0


rra[2].cf = "AVERAGE"


rra[2].rows = 600


rra[2].pdp_per_row = 24


rra[2].xff = 5.0000000000e-01


rra[2].cdp_prep[0].value = 6.5449761744e+08


rra[2].cdp_prep[0].unknown_datapoints = 0


rra[2].cdp_prep[1].value = 1.4734297081e+09


rra[2].cdp_prep[1].unknown_datapoints = 0


rra[3].cf = "AVERAGE"


rra[3].rows = 732


rra[3].pdp_per_row = 288


rra[3].xff = 5.0000000000e-01


rra[3].cdp_prep[0].value = 2.2692529674e+09


rra[3].cdp_prep[0].unknown_datapoints = 3


rra[3].cdp_prep[1].value = 4.7002069004e+09


rra[3].cdp_prep[1].unknown_datapoints = 3


rra[4].cf = "MAX"


rra[4].rows = 600


rra[4].pdp_per_row = 1


rra[4].xff = 5.0000000000e-01


rra[4].cdp_prep[0].value = NaN


rra[4].cdp_prep[0].unknown_datapoints = 0


rra[4].cdp_prep[1].value = NaN


rra[4].cdp_prep[1].unknown_datapoints = 0


rra[5].cf = "MAX"


rra[5].rows = 600


rra[5].pdp_per_row = 6


rra[5].xff = 5.0000000000e-01


rra[5].cdp_prep[0].value = 3.2405792329e+07


rra[5].cdp_prep[0].unknown_datapoints = 0


rra[5].cdp_prep[1].value = 6.9813629778e+07


rra[5].cdp_prep[1].unknown_datapoints = 0


rra[6].cf = "MAX"


rra[6].rows = 600


rra[6].pdp_per_row = 24


rra[6].xff = 5.0000000000e-01


rra[6].cdp_prep[0].value = 3.4089842030e+07


rra[6].cdp_prep[0].unknown_datapoints = 0


rra[6].cdp_prep[1].value = 7.6745619740e+07


rra[6].cdp_prep[1].unknown_datapoints = 0


rra[7].cf = "MAX"


rra[7].rows = 732


rra[7].pdp_per_row = 288


rra[7].xff = 5.0000000000e-01


rra[7].cdp_prep[0].value = 4.4271024386e+07


rra[7].cdp_prep[0].unknown_datapoints = 3


rra[7].cdp_prep[1].value = 8.8648080465e+07


rra[7].cdp_prep[1].unknown_datapoints = 3
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.oetiker.ch/pipermail/rrd-users/attachments/20110430/264c3505/attachment.htm