<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Tahoma
}
--></style>
</head>
<body class='hmmessage'>
Hi again.<br>I can't make it work. A rrd is setup as:<br>rrdtool create -s 1 \<br>DS:DS1:GAUGE:2:0:3600 \<br>DS:DS1:GAUGE:2:0:3600 \<br>RRA:AVERAGE:0:1:86400 \<br>RRA:AVERAGE:0.02:48:3600 \<br>RRA:AVERAGE:0.002:336:3600 \<br>RRA:AVERAGE:0.001:720:3600 \<br>RRA:MAX:0.02:48:3600 \<br>RRA:MAX:0.002:336:3600 \<br>RRA:MAX:0.001:720:3600<br><br>Nothing gets stored in the rra's except in the 86400 one. And when generating an image, only time spans around 3.5 hours produces<br>graphs with data but there is data anywhere during a day. Is this because RRDtool tries to plot data from the "wider" rra? <br><br>Plot image width is 500. I'm using rrdcached with my own timestamps, and the journals are full of updates and writes.<br>I have rrd with step 60 and they work fine. But all the 1s step are not working as intended.<br><br>Here's a info from a file. <br>filename = "INT-7055.rrd"<br>rrd_version = "0003"<br>step = 1<br>last_update = 1293034861<br>header_size = 2632<br>ds[DS1].index = 0<br>ds[DS1].type = "GAUGE"<br>ds[DS1].minimal_heartbeat = 2<br>ds[DS1].min = 0.0000000000e+00<br>ds[DS1].max = 3.6000000000e+03<br>ds[DS1].last_ds = "U"<br>ds[DS1].value = NaN<br>ds[DS1].unknown_sec = 0<br>ds[DS2].index = 1<br>ds[DS2].type = "GAUGE"<br>ds[DS2].minimal_heartbeat = 2<br>ds[DS2].min = 0.0000000000e+00<br>ds[DS2].max = 3.6000000000e+03<br>ds[DS2].last_ds = "0.0441428571428571"<br>ds[DS2].value = 0.0000000000e+00<br>ds[DS2].unknown_sec = 0<br>rra[0].cf = "AVERAGE"<br>rra[0].rows = 86400<br>rra[0].cur_row = 28857<br>rra[0].pdp_per_row = 1<br>rra[0].xff = 0.0000000000e+00<br>rra[0].cdp_prep[0].value = NaN<br>rra[0].cdp_prep[0].unknown_datapoints = 0<br>rra[0].cdp_prep[1].value = NaN<br>rra[0].cdp_prep[1].unknown_datapoints = 0<br>rra[1].cf = "AVERAGE"<br>rra[1].rows = 3600<br>rra[1].cur_row = 2285<br>rra[1].pdp_per_row = 48<br>rra[1].xff = 2.0000000000e-02<br>rra[1].cdp_prep[0].value = 0.0000000000e+00<br>rra[1].cdp_prep[0].unknown_datapoints = 13<br>rra[1].cdp_prep[1].value = 8.8142857143e-02<br>rra[1].cdp_prep[1].unknown_datapoints = 11<br>rra[2].cf = "AVERAGE"<br>rra[2].rows = 3600<br>rra[2].cur_row = 1438<br>rra[2].pdp_per_row = 336<br>rra[2].xff = 2.0000000000e-03<br>rra[2].cdp_prep[0].value = 0.0000000000e+00<br>rra[2].cdp_prep[0].unknown_datapoints = 13<br>rra[2].cdp_prep[1].value = 8.8142857143e-02<br>rra[2].cdp_prep[1].unknown_datapoints = 11<br>rra[3].cf = "AVERAGE"<br>rra[3].rows = 3600<br>rra[3].cur_row = 1343<br>rra[3].pdp_per_row = 720<br>rra[3].xff = 1.0000000000e-03<br>rra[3].cdp_prep[0].value = 0.0000000000e+00<br>rra[3].cdp_prep[0].unknown_datapoints = 541<br>rra[3].cdp_prep[1].value = 2.8852595238e+00<br>rra[3].cdp_prep[1].unknown_datapoints = 474<br>rra[4].cf = "MAX"<br>rra[4].rows = 3600<br>rra[4].cur_row = 1784<br>rra[4].pdp_per_row = 48<br>rra[4].xff = 2.0000000000e-02<br>rra[4].cdp_prep[0].value = -inf<br>rra[4].cdp_prep[0].unknown_datapoints = 13<br>rra[4].cdp_prep[1].value = 4.4142857143e-02<br>rra[4].cdp_prep[1].unknown_datapoints = 11<br>rra[5].cf = "MAX"<br>rra[5].rows = 3600<br>rra[5].cur_row = 2409<br>rra[5].pdp_per_row = 336<br>rra[5].xff = 2.0000000000e-03<br>rra[5].cdp_prep[0].value = -inf<br>rra[5].cdp_prep[0].unknown_datapoints = 13<br>rra[5].cdp_prep[1].value = 4.4142857143e-02<br>rra[5].cdp_prep[1].unknown_datapoints = 11<br>rra[6].cf = "MAX"<br>rra[6].rows = 3600<br>rra[6].cur_row = 2751<br>rra[6].pdp_per_row = 720<br>rra[6].xff = 1.0000000000e-03<br>rra[6].cdp_prep[0].value = -inf<br>rra[6].cdp_prep[0].unknown_datapoints = 541<br>rra[6].cdp_prep[1].value = 5.7166666667e-02<br>rra[6].cdp_prep[1].unknown_datapoints = 474<br><br> I've been staring at all this for too long and can't come up with a
solution.<br>Merry Christmas<br>Henrik<br><hr id="stopSpelling">From: henrikhegardt@hotmail.com<br>To: s.shipway@auckland.ac.nz; rrd-users@lists.oetiker.ch<br>Date: Wed, 15 Dec 2010 16:10:15 +0100<br>Subject: Re: [rrd-users] Questions about effective database parameters<br><br>
<meta http-equiv="Content-Type" content="text/html; charset=unicode">
<meta name="Generator" content="Microsoft SafeHTML">
<style>
.ExternalClass .ecxhmmessage P
{padding:0px;}
.ExternalClass body.ecxhmmessage
{font-size:10pt;font-family:Tahoma;}
</style>
<style>
.ExternalClass .ecxhmmessage P
{padding:0px;}
.ExternalClass body.ecxhmmessage
{font-size:10pt;font-family:Tahoma;}
</style>
<br>Thank you for your reply!<br>For some reason I was thinking of the xff the other way around. I'm using your ideas, and it looks promising.<br>Regards Henrik<br><hr id="ecxstopSpelling">From: s.shipway@auckland.ac.nz<br>To: henrikhegardt@hotmail.com; rrd-users@lists.oetiker.ch<br>Subject: RE: [rrd-users] Questions about effective database parameters<br>Date: Wed, 15 Dec 2010 01:27:16 +0000<br><br>
<style>
.ExternalClass .ecxhmmessage p
{padding:0px;}
.ExternalClass body.ecxhmmessage
{font-size:10pt;font-family:Tahoma;}
</style><style>
.ExternalClass P
{margin-bottom:0;}
</style>
<div style="direction: ltr; font-family: Tahoma; color: rgb(0, 0, 0); font-size: 13px;">
<div style="">RRA:AVERAGE:0.5:30:720 <br>
RRA:AVERAGE:0.5:60:720 <br>
<br>
You need to set the XFF (the fraction of the data which must be known for an RRA to store a value) to be much lower; in fact, you might even want to make it as near to zero as you can, maybe 1/(#dp)<br>
<br>
So, for the above, use:<br>
<br>
RRA:AVERAGE:0.03:30:720 <br>
RRA:AVERAGE:0.01:60:720 <br>
<br>
and even make it smaller for other RRAs.<br>
<br>
This is a rather clever way to get around the whole data normalisation thing; by making the step size 1s you avoid normalisation, but use a tiny XFF to make sure your 1-min RRA still stores the data as posted (and averages if you get multiple samples).<br>
<br>
Steve<br>
</div>
<div><br>
<div style="font-family: Tahoma; font-size: 13px;">
<div style="font-family: Tahoma; font-size: 13px;"><strong>Steve Shipway</strong></div>
<div style="font-family: Tahoma; font-size: 13px;">University of Auckland ITS</div>
<div style="font-family: Tahoma; font-size: 13px;"><em>UNIX Systems Design Lead</em></div>
<div style="font-family: Tahoma; font-size: 13px;"><a href="mailto:s.shipway@auckland.ac.nz">s.shipway@auckland.ac.nz</a></div>
<div style="font-family: Tahoma; font-size: 13px;">Ph: +64 9 373 7599 ext 86487</div>
<div style="font-family: Tahoma; font-size: 13px;"><em></em> </div>
</div>
</div>
<div style="font-family: Times New Roman; color: rgb(0, 0, 0); font-size: 16px;">
<hr>
<div style="direction: ltr;" id="ecxdivRpF285712"><font color="#000000" face="Tahoma" size="2"><b>From:</b> rrd-users-bounces+s.shipway=auckland.ac.nz@lists.oetiker.ch [rrd-users-bounces+s.shipway=auckland.ac.nz@lists.oetiker.ch] on behalf of Henrik Hegardt [henrikhegardt@hotmail.com]<br>
<b>Sent:</b> Tuesday, 14 December 2010 10:59 p.m.<br>
<b>To:</b> rrd-users@lists.oetiker.ch<br>
<b>Subject:</b> [rrd-users] Questions about effective database parameters<br>
</font><br>
</div>
<div></div>
<div>Hello.<br>
I'm writing a program to monitor a server's activities. Its about response times for services on the server. There are quite many services and most of the written data are unknowns. The response times is quite crucial and would want to have as high resolution
as possible even though there are unknowns. If there's a response time I write it to the DB with 1 second interval though since there are several other services per rrd a update operation could look like 'update database.rrd 1292313983:U:U:U:U:U:U:U:0.012:U:U:U:U:U:U'.
I would like to store it for atleast 6 months and thus view it over that time. I'm not interested of if there was no value, but the value itself.<br>
I can't tell if there will be a lot of updates during a time interval or none at all which should result in some of the entries won't even get a 'U' value (most probably).<br>
I have worked with following<br>
rrdtool create -s 1 \<br>
DS:ds1:GAUGE:2:0:3600 \<br>
...<br>
RRA:AVERAGE:0.5:30:720 <br>
RRA:AVERAGE:0.5:60:720 <br>
RRA:AVERAGE:0.5:420:720<br>
RRA:AVERAGE:0.5:1800:720 <br>
RRA:MAX:0.5:30:720 <br>
RRA:MAX:0.5:60:720 <br>
RRA:MAX:0.5:420:720 <br>
RRA:MAX:0.5:1800:720<br>
<br>
This didn't work, since I believe there a lot more 'U' values than 0.5 and the resolution isn't good enough and really doesn't make sense according to what I'm trying to sample.<br>
RRA:AVERAGE:0.5:1:86400 worked but then having a rra over 6 months (6*30*86400) will result in a big db and slow rendering of images. Any ideas?<br>
<br>
Forgive my English.<br>
<br>
<br>
</div>
</div>
</div>                                           
<br>_______________________________________________
rrd-users mailing list
rrd-users@lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users                                            </body>
</html>