[rrd-users] Storing Static + Dynamic data in rrd
Tobias Oetiker
tobi at oetiker.ch
Thu Feb 25 16:03:23 CET 2010
Today Shameem Ahamed wrote:
> Do you have any other tool suggestion ?.
>
> I want to store time-series data(and RRDTool is best suited for
> that), in normal SQL, i have to aggregate the data every time
> interval.
>
> My aim is to aggregate the spam/virus count with user and domain
> details within the network.
I don't have a suggestion, its just that sometimes people try to
solve a problem with rrdtool which would be realy simple writing a
few lines of script and using an sql db.
cheers
tobi
>
> Regards,
> Shameem
>
> --- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch> wrote:
>
> > From: Tobias Oetiker <tobi at oetiker.ch>
> > Subject: Re: [rrd-users] Storing Static + Dynamic data in rrd
> > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > Cc: rrd-users at lists.oetiker.ch
> > Date: Thursday, 25 February, 2010, 8:04 PM
> > Hi Shameed,
> >
> > Today Shameem Ahamed wrote:
> >
> > > Ok,
> > >
> > > You meant to say that, I can create a rrd file as
> > given below.
> > >
> > >
> > > rrdtool create domain1.com.rrd --step 300 \
> > >
> > DS:shameem1 \
> > >
> > DS:mailcount:COUNTER:1800:0:4294967295 \
> > >
> > RRA:AVERAGE:0.5:1:2016 \
> > >
> > DS:spamcount:COUNTER:1800:0:4294967295 \
> > >
> > RRA:AVERAGE:0.5:1:2016 \
> > >
> > DS:shameem2 \
> > >
> > DS:mailcount:COUNTER:1800:0:4294967295 \
> > >
> > RRA:AVERAGE:0.5:1:2016 \
> > >
> > DS:spamcount:COUNTER:1800:0:4294967295 \
> > >
> > RRA:AVERAGE:0.5:1:2016 \
> > >
> > >
> > > In this case, DS names will collide rt?. How can we
> > map the DS with corresponding user name.
> >
> > no you would do as follows (but note maybe an SQL db is
> > better for your
> > problem).
> >
> > rrdtool create domain1.com.rrd --step 300 \
> >
> > DS:shameem1_mailcount:COUNTER:1800:0:4294967295
> > \
> >
> > DS:shameem1_spamcount:COUNTER:1800:0:4294967295
> > \
> >
> > DS:shameem2_mailcount:COUNTER:1800:0:4294967295
> > \
> >
> > DS:shameem2_spamcount:COUNTER:1800:0:4294967295
> > \
> >
> > RRA:AVERAGE:0.5:1:2016
> >
> > cheers
> > tobi
> > >
> > > Regards,
> > > Shameem
> > >
> > >
> > > --- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch>
> > wrote:
> > >
> > > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > > Subject: Re: [rrd-users] Storing Static + Dynamic
> > data in rrd
> > > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > > Cc: rrd-users at lists.oetiker.ch
> > > > Date: Thursday, 25 February, 2010, 7:22 PM
> > > > Shameem,
> > > >
> > > > Today Shameem Ahamed wrote:
> > > >
> > > > > Ok,
> > > > >
> > > > > In that case, how can i add a static data in
> > rrd(Here
> > > > username).
> > > > >
> > > > > As far as i know, rrdcreate is expecting
> > data as given
> > > > below
> > > > >
> > > > > DS:ds-name:DST:dst arguments
> > > > >
> > > > > How can i add a fixed data (user name) as a
> > DS ?.
> > > >
> > > > you could use the username as the ds-name ...
> > there is no
> > > > provision
> > > > for meta data in the rrd format.
> > > >
> > > > cheers
> > > > tobi
> > > >
> > > > >
> > > > >
> > > > > Regards,
> > > > > Shameem
> > > > >
> > > > >
> > > > >
> > > > > --- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch>
> > > > wrote:
> > > > >
> > > > > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > > > > Subject: Re: [rrd-users] Storing Static
> > + Dynamic
> > > > data in rrd
> > > > > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > > > > Cc: rrd-users at lists.oetiker.ch
> > > > > > Date: Thursday, 25 February, 2010, 7:00
> > PM
> > > > > > Hi Shameem,
> > > > > >
> > > > > > Today Shameem Ahamed wrote:
> > > > > >
> > > > > > > Can we have rrd files per domain
> > (rather
> > > > than per
> > > > > > e-mail id) ?.
> > > > > > > As a total i may have 10K domains,
> > and if
> > > > each domain
> > > > > > has 5
> > > > > > > email, i will end up with 50K
> > files. So
> > > > instead of
> > > > > > that, can i
> > > > > > > have rrd files per domain (10K)
> > and store
> > > > the user
> > > > > > information
> > > > > > > and user data within it ?.
> > > > > > >
> > > > > > > Is this possible ?
> > > > > >
> > > > > > if you have a fixed number of emails
> > per domain
> > > > then this
> > > > > > is doable, the
> > > > > > problem is that all updates to a single
> > rrd file
> > > > must be
> > > > > > synchronous ... and changeing an
> > existing rrd
> > > > to a
> > > > > > different
> > > > > > structure is not that easy
> > > > > >
> > > > > > cheers
> > > > > > tobi
> > > > > > >
> > > > > > >
> > > > > > > Regards,
> > > > > > > Shameem
> > > > > > >
> > > > > > > --- On Thu, 25/2/10, Tobias
> > Oetiker <tobi at oetiker.ch>
> > > > > > wrote:
> > > > > > >
> > > > > > > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > > > > > > Subject: Re: [rrd-users]
> > Storing Static
> > > > + Dynamic
> > > > > > data in rrd
> > > > > > > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > > > > > > Cc: rrd-users at lists.oetiker.ch
> > > > > > > > Date: Thursday, 25 February,
> > 2010, 5:58
> > > > PM
> > > > > > > > Hi Shameen,
> > > > > > > >
> > > > > > > > Today Shameem Ahamed wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > > Is there anyway , I can
> > store both
> > > > static
> > > > > > and dynamic
> > > > > > > > data in rrd.
> > > > > > > > >
> > > > > > > > > I want to store the spam
> > count
> > > > details for
> > > > > > all the
> > > > > > > > e-mail accounts.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > The format, I am
> > thinking is
> > > > something like
> > > > > > > > >
> > > > > > > > >
> > > > > > > > -> user1 at domain1.com
> > > > > > > > ->[data]
> > > > > > > > > domain1.com -> user2 at domain1.com
> > > > > > > > ->[data]
> > > > > > > > >
> > > > > > > > -> user3 at domain1.com
> > > > > > > > ->[data]
> > > > > > > > >
> > > > > > > > >
> > > > > > > > -> user1 at domain2.com
> > > > > > > > ->[data]
> > > > > > > > > domain2.com -> user2 at domain2.com
> > > > > > > > ->[data]
> > > > > > > > >
> > > > > > > > -> user3 at domain2.com
> > > > > > > > ->[data]
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Is it possible ?. Is
> > there any
> > > > other rrd
> > > > > > tool to
> > > > > > > > achieve this kind of storage
> > ?.
> > > > > > > >
> > > > > > > > since rrd tool is best at
> > storing
> > > > 'preiodic'
> > > > > > data, you
> > > > > > > > should make
> > > > > > > > sure that you set the 'step'
> > at an
> > > > interval such
> > > > > > that users
> > > > > > > > are
> > > > > > > > likely to get several mails
> > withing
> > > > that interval
> > > > > > ... else
> > > > > > > > you are
> > > > > > > > wasting storage space and
> > would be
> > > > better served
> > > > > > with some
> > > > > > > > sql data
> > > > > > > > base ...
> > > > > > > >
> > > > > > > > having a separate rrd file
> > per email
> > > > address and
> > > > > > storing in
> > > > > > > > there
> > > > > > > > some data about the users
> > mail activity
> > > > once per
> > > > > > day seems
> > > > > > > > like a
> > > > > > > > sensible thing todo ...
> > > > > > > >
> > > > > > > > maybe
> > > > > > > >
> > > > > > > >
> > > > > >
> > > >
> > mail-sent:mail-received:spam-received:virus-received:bounces-received
> > > > > > > >
> > > > > > > > cheers
> > > > > > > > tobi
> > > > > > > > >
> > > > > > > > > Regards,
> > > > > > > > > Shameem
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Your Mail
> > works best
> > > > > > > > with the New Yahoo Optimized
> > IE8. Get
> > > > it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > > > > > > >
> > > > > > > > >
> > > > > >
> > _______________________________________________
> > > > > > > > > rrd-users mailing list
> > > > > > > > > rrd-users at lists.oetiker.ch
> > > > > > > > > https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > > --
> > > > > > > > Tobi Oetiker, OETIKER+PARTNER
> > AG,
> > > > Aarweg 15
> > > > > > CH-4600 Olten,
> > > > > > > > Switzerland
> > > > > > > > http://it.oetiker.ch tobi at oetiker.ch
> > > > > > > > ++41 62 775 9902 / sb: -9900
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > Your Mail works best
> > > > > > with the New Yahoo Optimized IE8. Get
> > it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > > > > >
> > > > > > >
> > > > > >
> > > > > > --
> > > > > > Tobi Oetiker, OETIKER+PARTNER AG,
> > Aarweg 15
> > > > CH-4600 Olten,
> > > > > > Switzerland
> > > > > > http://it.oetiker.ch tobi at oetiker.ch
> > > > > > ++41 62 775 9902 / sb: -9900
> > > > >
> > > > >
> > > > > Your Mail works best
> > > > with the New Yahoo Optimized IE8. Get it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > > >
> > > > >
> > > >
> > > > --
> > > > Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15
> > CH-4600 Olten,
> > > > Switzerland
> > > > http://it.oetiker.ch tobi at oetiker.ch
> > > > ++41 62 775 9902 / sb: -9900
> > >
> > >
> > > Your Mail works best
> > with the New Yahoo Optimized IE8. Get it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > >
> > >
> >
> > --
> > Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten,
> > Switzerland
> > http://it.oetiker.ch tobi at oetiker.ch
> > ++41 62 775 9902 / sb: -9900
>
>
> The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/
>
>
--
Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland
http://it.oetiker.ch tobi at oetiker.ch ++41 62 775 9902 / sb: -9900
More information about the rrd-users
mailing list