[rrd-users] Incrementing type

[Steve Shipway]

This sort of situation (irregularly arriving events) is not really suitable for RRDTool, which is optimised and designed for storing and graphing time sequence rate-based data, coming in at regular intervals.

One possibility would be for you to store your logs in a separate location, then your RRD gathering process could run regularly via a scheduler every 5 min, and count the new logs since its last run.  This would be an 'absolute' type counter giving you a stored value in logs/sec that you could process as sum(interval*value) to get total number of logs.

Getting logs from time previous to the last update would not work - youd have to discard these.  If this is unacceptable, then you need to look at another more heavyweight and flexible database - maybe mysql or postgres...

Steve


Steve Shipway
University of Auckland ITS
UNIX Systems Design Lead
s.shipway at auckland.ac.nz
Ph: +64 9 373 7599 ext 86487


________________________________________
From: rrd-users-bounces+s.shipway=auckland.ac.nz at lists.oetiker.ch [rrd-users-bounces+s.shipway=auckland.ac.nz at lists.oetiker.ch] on behalf of Bjørnar Ness [bjornar.ness at gmail.com]
Sent: Saturday, 1 June 2013 7:54 p.m.
To: rrd-users at lists.oetiker.ch
Subject: Re: [rrd-users] Incrementing type

Ok, I will try to rewrite:

I am receiving a stream of loglines, this is common apache format and
includes,
among other fields, a timestamp and a response code.

When I receive a logline, I would like to flush this to rrdcached
immediately, but
for this to work I need to be able to not set a absolute value, or a
counter, but a
increment current value (in timestamp range) by 1. Is this possible?

If not I would need to keep track of my own counters in for example redis,
incrementing
here, and flushing to rrdcached.. which would not be nessesary if rrd can do
the incrementing.

And what about when I receive some loglines from a day back (because of some
network failure)?



--
View this message in context: http://rrd-mailinglists.937164.n2.nabble.com/Incrementing-type-tp7581036p7581041.html
Sent from the RRDtool Users Mailinglist mailing list archive at Nabble.com.

_______________________________________________
rrd-users mailing list
rrd-users at lists.oetiker.ch
https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users