[rrd-developers] rrdcached use corrupting RRD files (trunk)

[Steve Shipway]

Info as requested:

Startup:
/u01/rrdtool-1.4/bin/rrdcached -s mrtg -m 0660 -l unix:/var/tmp/rrdcached.sock -l mrtg.auckland.ac.nz -l localhost -z 60 -p /var/tmp/rrdcached.pid -t 8 -j /u01/rrdtool/journal -F -b /u01/rrdtool -w 600 -O
(if you have some better ideas for the -t, -w and -z  then let me know)

Stats:
stats
9 Statistics follow
QueueLength: 0
UpdatesReceived: 9648678
FlushesReceived: 201241
UpdatesWritten: 3838532
DataSetsWritten: 9636973
TreeNodesNumber: 11451
TreeDepth: 16
JournalBytes: 888653616
JournalRotate: 77

RRD Info:
This is a standard MRTG-created RRD file.
filename = "maildelivery-mx1.rrd"
rrd_version = "0003"
step = 300
last_update = 1287714602
header_size = 2764
ds[ds0].index = 0
ds[ds0].type = "GAUGE"
ds[ds0].minimal_heartbeat = 600
ds[ds0].min = 0.0000000000e+00
ds[ds0].max = 3.6000000000e+05
ds[ds0].last_ds = "0"
ds[ds0].value = 0.0000000000e+00
ds[ds0].unknown_sec = 0
ds[ds1].index = 1
ds[ds1].type = "GAUGE"
ds[ds1].minimal_heartbeat = 600
ds[ds1].min = 0.0000000000e+00
ds[ds1].max = 3.6000000000e+05
ds[ds1].last_ds = "0"
ds[ds1].value = 0.0000000000e+00
ds[ds1].unknown_sec = 0
rra[0].cf = "AVERAGE"
rra[0].rows = 800
rra[0].cur_row = 363
rra[0].pdp_per_row = 1
rra[0].xff = 5.0000000000e-01
rra[0].cdp_prep[0].value = NaN
rra[0].cdp_prep[0].unknown_datapoints = 0
rra[0].cdp_prep[1].value = NaN
rra[0].cdp_prep[1].unknown_datapoints = 0
rra[1].cf = "AVERAGE"
rra[1].rows = 800
rra[1].cur_row = 467
rra[1].pdp_per_row = 6
rra[1].xff = 2.5000000000e-01
rra[1].cdp_prep[0].value = 0.0000000000e+00
rra[1].cdp_prep[0].unknown_datapoints = 0
rra[1].cdp_prep[1].value = 0.0000000000e+00
rra[1].cdp_prep[1].unknown_datapoints = 0
rra[2].cf = "AVERAGE"
rra[2].rows = 800
rra[2].cur_row = 752
rra[2].pdp_per_row = 24
rra[2].xff = 2.5000000000e-01
rra[2].cdp_prep[0].value = 2.9933333333e+00
rra[2].cdp_prep[0].unknown_datapoints = 0
rra[2].cdp_prep[1].value = 2.9933333333e+00
rra[2].cdp_prep[1].unknown_datapoints = 0
rra[3].cf = "AVERAGE"
rra[3].rows = 800
rra[3].cur_row = 724
rra[3].pdp_per_row = 288
rra[3].xff = 2.5000000000e-01
rra[3].cdp_prep[0].value = 2.7863333333e+01
rra[3].cdp_prep[0].unknown_datapoints = 0
rra[3].cdp_prep[1].value = 2.7863333333e+01
rra[3].cdp_prep[1].unknown_datapoints = 0
rra[4].cf = "MAX"
rra[4].rows = 800
rra[4].cur_row = 309
rra[4].pdp_per_row = 1
rra[4].xff = 5.0000000000e-01
rra[4].cdp_prep[0].value = NaN
rra[4].cdp_prep[0].unknown_datapoints = 0
rra[4].cdp_prep[1].value = NaN
rra[4].cdp_prep[1].unknown_datapoints = 0
rra[5].cf = "MAX"
rra[5].rows = 800
rra[5].cur_row = 136
rra[5].pdp_per_row = 6
rra[5].xff = 2.5000000000e-01
rra[5].cdp_prep[0].value = -inf
rra[5].cdp_prep[0].unknown_datapoints = 0
rra[5].cdp_prep[1].value = -inf
rra[5].cdp_prep[1].unknown_datapoints = 0
rra[6].cf = "MAX"
rra[6].rows = 800
rra[6].cur_row = 641
rra[6].pdp_per_row = 24
rra[6].xff = 2.5000000000e-01
rra[6].cdp_prep[0].value = 1.0000000000e+00
rra[6].cdp_prep[0].unknown_datapoints = 0
rra[6].cdp_prep[1].value = 1.0000000000e+00
rra[6].cdp_prep[1].unknown_datapoints = 0
rra[7].cf = "MAX"
rra[7].rows = 800
rra[7].cur_row = 180
rra[7].pdp_per_row = 288
rra[7].xff = 2.5000000000e-01
rra[7].cdp_prep[0].value = 6.8600000000e+00
rra[7].cdp_prep[0].unknown_datapoints = 0
rra[7].cdp_prep[1].value = 6.8600000000e+00
rra[7].cdp_prep[1].unknown_datapoints = 0

________________________________
Steve Shipway
ITS Unix Services Design Lead
University of Auckland, New Zealand
Floor 1, 58 Symonds Street, Auckland
Phone: +64 (0)9 3737599 ext 86487
DDI: +64 (0)9 924 6487
Mobile: +64 (0)21 753 189
Email: s.shipway at auckland.ac.nz<mailto:s.shipway at auckland.ac.nz>
P Please consider the environment before printing this e-mail


From: kevin brintnall [mailto:kbrint at rufus.net]
...
Could you show me:

 - the output of 'stats' from your daemon
 - "rrdtool info" from an RRD that's typical of your workload
 - the args you're using when starting the rrdcached daemon


-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.oetiker.ch/pipermail/rrd-developers/attachments/20101022/135748a6/attachment-0001.htm