[rrd-users] Lost Data??
Martin Lietz
flieger.martin at web.de
Thu Oct 9 14:14:31 CEST 2008
For No. 3:
Hello Steve, that is exactly the problem.
<code>
1853 # cons xff steps rows
1854 AVERAGE 0.5 1 1008
1855 AVERAGE 0.5 12 4320
1856 MIN 0.5 12 4320
1857 MAX 0.5 12 4320
1858 AVERAGE 0.5 144 720
1859 MAX 0.5 144 720
1860 MIN 0.5 144 720
</code>
So I have only 33 hours in the small granularity. That explains also why the steps are later 12 times more.
If i create a database with a small granularity over 1 year, will it work correct or will I get problems?
Thanks!! You save my day.
Martin
> -----Ursprüngliche Nachricht-----
> Von: <rrd-users-request at lists.oetiker.ch>
> Gesendet: 09.10.08 13:19:53
> An: rrd-users at lists.oetiker.ch
> Betreff: rrd-users Digest, Vol 22, Issue 7
> Send rrd-users mailing list submissions to
> rrd-users at lists.oetiker.ch
>
> To subscribe or unsubscribe via the World Wide Web, visit
> https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
> or, via email, send a message with subject or body 'help' to
> rrd-users-request at lists.oetiker.ch
>
> You can reach the person managing the list at
> rrd-users-owner at lists.oetiker.ch
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of rrd-users digest..."
>
>
> Today's Topics:
>
> 1. graphing unconsolidated values (Jay Christopherson)
> 2. Re: graphing unconsolidated values (Jay Christopherson)
> 3. Re: Lost Data?? (Steve Shipway)
> 4. Re: graphing unconsolidated values (Alex van den Bogaerdt)
> 5. Unable to generate graphs error (George Mtonga)
> 6. Re: Unable to generate graphs error (Andreas Maus)
> 7. Re: Unable to generate graphs error (fredrik at n-mental.com)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Wed, 8 Oct 2008 15:53:31 -0700
> From: "Jay Christopherson" <jc.listmail at gmail.com>
> Subject: [rrd-users] graphing unconsolidated values
> To: rrd-users at lists.oetiker.ch
> Message-ID:
> <b569ddb0810081553g41e595f2kbc97fef72f44e4be at mail.gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Hi-
>
> I understand that RRDTool is designed to store/graph rates and not values.
> That being said, I need to graph values for a few of my datasources. I'd
> rather not have to setup a whole separate graphing system just for a few
> graphs so if it is possible, I'd like to use my existing rrdtool system to
> do this. Is it possible to setup a datasource definition so that it will
> store (and subsequently be able to display) exact values?
>
> I'd like to stick with a 300s interval. I am not an expert at rrdtool, but
> I have read the documentation on normalization and consolidation so I feel
> like I somewhat understand the underpinnings, but not enough to figure out
> how to make this work correctly.
>
> Thanks!
> Jay
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://lists.oetiker.ch/pipermail/rrd-users/attachments/20081008/2472431a/attachment-0001.html
>
> ------------------------------
>
> Message: 2
> Date: Wed, 8 Oct 2008 16:04:31 -0700
> From: "Jay Christopherson" <jc.listmail at gmail.com>
> Subject: Re: [rrd-users] graphing unconsolidated values
> To: rrd-users at lists.oetiker.ch
> Message-ID:
> <b569ddb0810081604n473b50c8l1f1aa75fdadca9b1 at mail.gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"
>
> I should mention that I did some searching and found reference to this link
> that no longer exists:
>
> http://www.ee.ethz.ch/~slist/rrd-users/msg06477.html
>
> On Wed, Oct 8, 2008 at 3:53 PM, Jay Christopherson <jc.listmail at gmail.com>wrote:
>
> > Hi-
> >
> > I understand that RRDTool is designed to store/graph rates and not values.
> > That being said, I need to graph values for a few of my datasources. I'd
> > rather not have to setup a whole separate graphing system just for a few
> > graphs so if it is possible, I'd like to use my existing rrdtool system to
> > do this. Is it possible to setup a datasource definition so that it will
> > store (and subsequently be able to display) exact values?
> >
> > I'd like to stick with a 300s interval. I am not an expert at rrdtool, but
> > I have read the documentation on normalization and consolidation so I feel
> > like I somewhat understand the underpinnings, but not enough to figure out
> > how to make this work correctly.
> >
> > Thanks!
> > Jay
> >
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: http://lists.oetiker.ch/pipermail/rrd-users/attachments/20081008/c76b8307/attachment-0001.html
>
> ------------------------------
>
> Message: 3
> Date: Thu, 9 Oct 2008 11:49:13 +1300
> From: Steve Shipway <s.shipway at auckland.ac.nz>
> Subject: Re: [rrd-users] Lost Data??
> To: 'Martin Lietz' <flieger.martin at web.de>,
> "'rrd-users at lists.oetiker.ch'" <rrd-users at lists.oetiker.ch>
> Message-ID:
> <6B587E8C999646469B54486AF219584606F3E1E369 at UXCHANGE7-1.UoA.auckland.ac.nz>
>
> Content-Type: text/plain; charset="us-ascii"
>
> > This task works fine when i am searching values in the last hour week
> > month, but if i search e.g. the hour between 15:00 and 16:00 one month ago
> > it give me back only three values where in my opinion has to be 12 times
> > more!
>
> My guess is that your small-granularity RRA only stretches less than 1 month; for older data, rrdtool is forced to rely on a larger granularity RRA, in this case about 30min intervals, and so you only get 3 samples.
>
> Check the RRD file configuration and in particular the definition of the small-granularity RRA. Multiply the number of rows by the rollup by the interval; this is as far back as you can go using this RRA.
>
> Example:
> /u01/bin/rrdtool info /u01/mrtg/data/test.rrd
> ...
> step = 300
> ...
> rra[0].cf = "AVERAGE"
> rra[0].rows = 800
> rra[0].pdp_per_row = 1
> rra[0].xff = 5.0000000000e-01
> ...
>
> Therefore, for my first RRA, I can go back (step)*(pdp_per_row)*(rows) seconds, since the step is the time interval for one pdp (5min in this case, as this is a default MRTG-generated RRD file)
> Step x pdp_per_row x rows
> = 300s x 1 x 800
> = 66 hours
> = about 2.5 days
>
> Any further, and it will have to use rra[1], which is the same apart from a pdp_per_row of 6 (IE, it rolls up date to a 30-min average). This is why you can make a MRTG system show a 'daily' and a '2 days' graph, but not a 'daily' graph from a week ago.
>
> Steve
>
>
>
> ------------------------------
>
> Message: 4
> Date: Thu, 9 Oct 2008 01:36:32 +0200
> From: "Alex van den Bogaerdt" <alex at vandenbogaerdt.nl>
> Subject: Re: [rrd-users] graphing unconsolidated values
> To: <rrd-users at lists.oetiker.ch>
> Message-ID: <462E5D2D750343A59FAD9A7E514586EA at vandenbogaerdt.nl>
> Content-Type: text/plain; format=flowed; charset="iso-8859-1";
> reply-type=original
>
> > I understand that RRDTool is designed to store/graph rates and not values.
>
> That is not part of your problem/challenge. I'm graphing temperatures;
> consolidation works just fine (e.g. temperatures 20.1, 20.3 will be averaged
> as 20.2 as intended).
>
> RRDtool doesn't know nor care where your data comes from. As long as you
> understand that RRDtool thinks each number is a 'something per second'
> number, all is fine.
>
> > That being said, I need to graph values for a few of my datasources. I'd
> > rather not have to setup a whole separate graphing system just for a few
> > graphs so if it is possible, I'd like to use my existing rrdtool system to
> > do this. Is it possible to setup a datasource definition so that it will
> > store (and subsequently be able to display) exact values?
>
> Yes and no. Techically no, but you don't mind as you can still achieve your
> goal.
>
> > I'd like to stick with a 300s interval. I am not an expert at rrdtool,
> > but
> > I have read the documentation on normalization and consolidation so I feel
> > like I somewhat understand the underpinnings, but not enough to figure out
> > how to make this work correctly.
>
> Normalization will always happen, although sometimes it isn't doing anything
> but copy your input. This is when it is given to RRDtool at exactly the
> right moment. For instance, if your step is 300 then your timestamps should
> be n*300 where n is a positive integer number. Wall clock time 01:20 results
> in such a timestamp, 01:25 does, 01:23 does not.
>
> Consolidation will also always happen, but consolidating one PDP into CDP
> won't change the rate so this too is a no-op.
>
> DS:somename:GAUGE:300:U:U should do. Modify 300 (heartbeat) to a larger
> number if you want to do updates which span a larger time interval (e.g.
> write 0 at midnight to set every rate between 17:00 and midnight to zero
> requires at least 50400, plus the amount of time in seconds by which the
> wall clock time is set back when daylight saving changes). Modify 300 to a
> lower number if you want RRDtool to ignore all your input.
>
> If you want to store data for a year, in 300 second intervals, then you
> should have 366 days (leap years!) times 24 hours (no daylight saving in
> UTC!) per day times 3600 seconds per hour divided by 300 seconds per
> interval = 105408 CDPs. Each CDP should be built from exactly one PDP (a
> step as defined by step size).
>
> RRA:AVERAGE:0:1:105408 should do.
>
> You may hit some hidden limitation when you try to graph all of your data,
> but if you want to try anyway just set --width 105408 and see what happens.
> Of course you most likely just want to see portions of your data. Make sure
> the end time minus the start time equals your step size times the amount of
> pixels and make sure both timestamps are n*300 again.
>
> HTH
> Alex
> (typos and brainfarts may occur in above text. No tests where performed
> while typing this message)
>
>
>
> ------------------------------
>
> Message: 5
> Date: Thu, 9 Oct 2008 12:20:37 +0200
> From: "George Mtonga" <gmtonga at gmail.com>
> Subject: [rrd-users] Unable to generate graphs error
> To: rrd-users at lists.oetiker.ch
> Message-ID:
> <deaf19780810090320u1f015f2aj83b923b162f323a2 at mail.gmail.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> I am installing rrdtool and when i run the perl script rrd_traffic.pl
> the following error message appears:
>
> /usr/local/bin/rrd_traffic.pl: unable to generate eth0 day traffic
> graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
> /usr/local/bin/rrd_traffic.pl: unable to generate eth0 week traffic
> graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
> /usr/local/bin/rrd_traffic.pl: unable to generate eth0 month traffic
> graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
> /usr/local/bin/rrd_traffic.pl: unable to generate eth0 year traffic
> graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
>
> Any help is appreciated highly.
>
> --
> +++++++++++++++++++++++++++++++++++++++
> George Kawamba Mtonga
> Ass network engineer
> Malawi SDNP
> Tel: +265-0-1-320671
> Cell: +265-0-8-791326
> Url: www.sdnp.org.mw
>
>
>
> ------------------------------
>
> Message: 6
> Date: Thu, 9 Oct 2008 12:25:02 +0200
> From: Andreas Maus <a.maus at science-computing.de>
> Subject: Re: [rrd-users] Unable to generate graphs error
> To: George Mtonga <gmtonga at gmail.com>
> Cc: rrd-users at lists.oetiker.ch
> Message-ID: <20081009102502.GI1416 at derril.science-computing.de>
> Content-Type: text/plain; charset="us-ascii"
>
> On Thu, Oct 09, 2008 at 12:20:37PM +0200, George Mtonga wrote:
> > I am installing rrdtool and when i run the perl script rrd_traffic.pl
> > the following error message appears:
> >
> > /usr/local/bin/rrd_traffic.pl: unable to generate eth0 day traffic
> > graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
> [... snipp ...]
>
> Well ...
> Are you sure this file (/var/lib/rrd/eth0.rrd) DO exist ?
>
> So long,
>
> Andreas.
>
> --
> Dipl.-Ing. Andreas Maus science+computing ag
> System Administration Hagellocher Weg 73
> tel.: +49 7071 9457 671 72070 Tuebingen, Germany
> fax: +49 7071 9457 411 www.science-computing.de
> -------------- next part --------------
> A non-text attachment was scrubbed...
> Name: not available
> Type: application/pgp-signature
> Size: 189 bytes
> Desc: not available
> Url : http://lists.oetiker.ch/pipermail/rrd-users/attachments/20081009/233dfcd9/attachment-0001.bin
>
> ------------------------------
>
> Message: 7
> Date: Thu, 09 Oct 2008 13:19:02 +0200
> From: <fredrik at n-mental.com>
> Subject: Re: [rrd-users] Unable to generate graphs error
> To: George Mtonga <gmtonga at gmail.com>
> Cc: rrd-users at lists.oetiker.ch
> Message-ID: <1e48d215b1de82ea166ed0928cb76558 at localhost>
> Content-Type: text/plain; charset="UTF-8"
>
>
> Try this secret command and send the result to this list:
>
> ls -l /var/lib/rrd/eth0.rrd
>
>
> /FW
>
> On Thu, 9 Oct 2008 12:20:37 +0200, "George Mtonga" <gmtonga at gmail.com>
> wrote:
> > I am installing rrdtool and when i run the perl script rrd_traffic.pl
> > the following error message appears:
> >
> > /usr/local/bin/rrd_traffic.pl: unable to generate eth0 day traffic
> > graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
> > /usr/local/bin/rrd_traffic.pl: unable to generate eth0 week traffic
> > graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
> > /usr/local/bin/rrd_traffic.pl: unable to generate eth0 month traffic
> > graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
> > /usr/local/bin/rrd_traffic.pl: unable to generate eth0 year traffic
> > graph: opening '/var/lib/rrd/eth0.rrd': No such file or directory
> >
> > Any help is appreciated highly.
> >
> >
>
>
>
> ------------------------------
>
> _______________________________________________
> rrd-users mailing list
> rrd-users at lists.oetiker.ch
> https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
>
>
> End of rrd-users Digest, Vol 22, Issue 7
> ****************************************
>
_________________________________________________________________________
In 5 Schritten zur eigenen Homepage. Jetzt Domain sichern und gestalten!
Nur 3,99 EUR/Monat! http://www.maildomain.web.de/?mc=021114
More information about the rrd-users
mailing list