[rrd-users] Storing Static + Dynamic data in rrd
Shameem Ahamed
shameem.ahamed at yahoo.com
Thu Feb 25 16:08:38 CET 2010
Thanks a lot tobi.
Appreciate your time and patience. :-)
Regards,
Shameem
--- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch> wrote:
> From: Tobias Oetiker <tobi at oetiker.ch>
> Subject: Re: [rrd-users] Storing Static + Dynamic data in rrd
> To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> Cc: rrd-users at lists.oetiker.ch
> Date: Thursday, 25 February, 2010, 8:33 PM
> Today Shameem Ahamed wrote:
>
> > Do you have any other tool suggestion ?.
> >
> > I want to store time-series data(and RRDTool is best
> suited for
> > that), in normal SQL, i have to aggregate the data
> every time
> > interval.
> >
> > My aim is to aggregate the spam/virus count with user
> and domain
> > details within the network.
>
> I don't have a suggestion, its just that sometimes people
> try to
> solve a problem with rrdtool which would be realy simple
> writing a
> few lines of script and using an sql db.
>
> cheers
> tobi
>
> >
> > Regards,
> > Shameem
> >
> > --- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch>
> wrote:
> >
> > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > Subject: Re: [rrd-users] Storing Static + Dynamic
> data in rrd
> > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > Cc: rrd-users at lists.oetiker.ch
> > > Date: Thursday, 25 February, 2010, 8:04 PM
> > > Hi Shameed,
> > >
> > > Today Shameem Ahamed wrote:
> > >
> > > > Ok,
> > > >
> > > > You meant to say that, I can create a rrd
> file as
> > > given below.
> > > >
> > > >
> > > > rrdtool create domain1.com.rrd --step 300 \
> > > >
> > > DS:shameem1 \
> > > >
> > > DS:mailcount:COUNTER:1800:0:4294967295 \
> > > >
> > > RRA:AVERAGE:0.5:1:2016 \
> > > >
> > > DS:spamcount:COUNTER:1800:0:4294967295 \
> > > >
> > > RRA:AVERAGE:0.5:1:2016 \
> > > >
> > > DS:shameem2 \
> > > >
> > > DS:mailcount:COUNTER:1800:0:4294967295 \
> > > >
> > > RRA:AVERAGE:0.5:1:2016 \
> > > >
> > > DS:spamcount:COUNTER:1800:0:4294967295 \
> > > >
> > > RRA:AVERAGE:0.5:1:2016 \
> > > >
> > > >
> > > > In this case, DS names will collide rt?. How
> can we
> > > map the DS with corresponding user name.
> > >
> > > no you would do as follows (but note maybe an SQL
> db is
> > > better for your
> > > problem).
> > >
> > > rrdtool create domain1.com.rrd --step 300 \
> > >
> > >
> DS:shameem1_mailcount:COUNTER:1800:0:4294967295
> > > \
> > >
> > >
> DS:shameem1_spamcount:COUNTER:1800:0:4294967295
> > > \
> > >
> > >
> DS:shameem2_mailcount:COUNTER:1800:0:4294967295
> > > \
> > >
> > >
> DS:shameem2_spamcount:COUNTER:1800:0:4294967295
> > > \
> > >
> > > RRA:AVERAGE:0.5:1:2016
> > >
> > > cheers
> > > tobi
> > > >
> > > > Regards,
> > > > Shameem
> > > >
> > > >
> > > > --- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch>
> > > wrote:
> > > >
> > > > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > > > Subject: Re: [rrd-users] Storing Static
> + Dynamic
> > > data in rrd
> > > > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > > > Cc: rrd-users at lists.oetiker.ch
> > > > > Date: Thursday, 25 February, 2010, 7:22
> PM
> > > > > Shameem,
> > > > >
> > > > > Today Shameem Ahamed wrote:
> > > > >
> > > > > > Ok,
> > > > > >
> > > > > > In that case, how can i add a
> static data in
> > > rrd(Here
> > > > > username).
> > > > > >
> > > > > > As far as i know, rrdcreate is
> expecting
> > > data as given
> > > > > below
> > > > > >
> > > > > > DS:ds-name:DST:dst arguments
> > > > > >
> > > > > > How can i add a fixed data (user
> name) as a
> > > DS ?.
> > > > >
> > > > > you could use the username as the
> ds-name ...
> > > there is no
> > > > > provision
> > > > > for meta data in the rrd format.
> > > > >
> > > > > cheers
> > > > > tobi
> > > > >
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Shameem
> > > > > >
> > > > > >
> > > > > >
> > > > > > --- On Thu, 25/2/10, Tobias
> Oetiker <tobi at oetiker.ch>
> > > > > wrote:
> > > > > >
> > > > > > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > > > > > Subject: Re: [rrd-users]
> Storing Static
> > > + Dynamic
> > > > > data in rrd
> > > > > > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > > > > > Cc: rrd-users at lists.oetiker.ch
> > > > > > > Date: Thursday, 25 February,
> 2010, 7:00
> > > PM
> > > > > > > Hi Shameem,
> > > > > > >
> > > > > > > Today Shameem Ahamed wrote:
> > > > > > >
> > > > > > > > Can we have rrd files
> per domain
> > > (rather
> > > > > than per
> > > > > > > e-mail id) ?.
> > > > > > > > As a total i may have
> 10K domains,
> > > and if
> > > > > each domain
> > > > > > > has 5
> > > > > > > > email, i will end up
> with 50K
> > > files. So
> > > > > instead of
> > > > > > > that, can i
> > > > > > > > have rrd files per
> domain (10K)
> > > and store
> > > > > the user
> > > > > > > information
> > > > > > > > and user data within it
> ?.
> > > > > > > >
> > > > > > > > Is this possible ?
> > > > > > >
> > > > > > > if you have a fixed number of
> emails
> > > per domain
> > > > > then this
> > > > > > > is doable, the
> > > > > > > problem is that all updates
> to a single
> > > rrd file
> > > > > must be
> > > > > > > synchronous ... and
> changeing an
> > > existing rrd
> > > > > to a
> > > > > > > different
> > > > > > > structure is not that easy
> > > > > > >
> > > > > > > cheers
> > > > > > > tobi
> > > > > > > >
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Shameem
> > > > > > > >
> > > > > > > > --- On Thu, 25/2/10,
> Tobias
> > > Oetiker <tobi at oetiker.ch>
> > > > > > > wrote:
> > > > > > > >
> > > > > > > > > From: Tobias
> Oetiker <tobi at oetiker.ch>
> > > > > > > > > Subject: Re:
> [rrd-users]
> > > Storing Static
> > > > > + Dynamic
> > > > > > > data in rrd
> > > > > > > > > To: "Shameem
> Ahamed" <shameem.ahamed at yahoo.com>
> > > > > > > > > Cc: rrd-users at lists.oetiker.ch
> > > > > > > > > Date: Thursday, 25
> February,
> > > 2010, 5:58
> > > > > PM
> > > > > > > > > Hi Shameen,
> > > > > > > > >
> > > > > > > > > Today Shameem
> Ahamed wrote:
> > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > > Is there
> anyway , I can
> > > store both
> > > > > static
> > > > > > > and dynamic
> > > > > > > > > data in rrd.
> > > > > > > > > >
> > > > > > > > > > I want to
> store the spam
> > > count
> > > > > details for
> > > > > > > all the
> > > > > > > > > e-mail accounts.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > The format, I
> am
> > > thinking is
> > > > > something like
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > -> user1 at domain1.com
> > > > > > > > > ->[data]
> > > > > > > > > > domain1.com
> -> user2 at domain1.com
> > > > > > > > > ->[data]
> > > > > > > > > >
> > > > > > > > > -> user3 at domain1.com
> > > > > > > > > ->[data]
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > -> user1 at domain2.com
> > > > > > > > > ->[data]
> > > > > > > > > > domain2.com
> -> user2 at domain2.com
> > > > > > > > > ->[data]
> > > > > > > > > >
> > > > > > > > > -> user3 at domain2.com
> > > > > > > > > ->[data]
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Is it possible
> ?. Is
> > > there any
> > > > > other rrd
> > > > > > > tool to
> > > > > > > > > achieve this kind
> of storage
> > > ?.
> > > > > > > > >
> > > > > > > > > since rrd tool is
> best at
> > > storing
> > > > > 'preiodic'
> > > > > > > data, you
> > > > > > > > > should make
> > > > > > > > > sure that you set
> the 'step'
> > > at an
> > > > > interval such
> > > > > > > that users
> > > > > > > > > are
> > > > > > > > > likely to get
> several mails
> > > withing
> > > > > that interval
> > > > > > > ... else
> > > > > > > > > you are
> > > > > > > > > wasting storage
> space and
> > > would be
> > > > > better served
> > > > > > > with some
> > > > > > > > > sql data
> > > > > > > > > base ...
> > > > > > > > >
> > > > > > > > > having a separate
> rrd file
> > > per email
> > > > > address and
> > > > > > > storing in
> > > > > > > > > there
> > > > > > > > > some data about the
> users
> > > mail activity
> > > > > once per
> > > > > > > day seems
> > > > > > > > > like a
> > > > > > > > > sensible thing todo
> ...
> > > > > > > > >
> > > > > > > > > maybe
> > > > > > > > >
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> mail-sent:mail-received:spam-received:virus-received:bounces-received
> > > > > > > > >
> > > > > > > > > cheers
> > > > > > > > > tobi
> > > > > > > > > >
> > > > > > > > > > Regards,
> > > > > > > > > > Shameem
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> Your Mail
> > > works best
> > > > > > > > > with the New Yahoo
> Optimized
> > > IE8. Get
> > > > > it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > > > > > > > >
> > > > > > > > > >
> > > > > > >
> > > _______________________________________________
> > > > > > > > > > rrd-users
> mailing list
> > > > > > > > > > rrd-users at lists.oetiker.ch
> > > > > > > > > > https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Tobi Oetiker,
> OETIKER+PARTNER
> > > AG,
> > > > > Aarweg 15
> > > > > > > CH-4600 Olten,
> > > > > > > > > Switzerland
> > > > > > > > > http://it.oetiker.ch tobi at oetiker.ch
> > > > > > > > > ++41 62 775 9902 /
> sb: -9900
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > Your Mail
> works best
> > > > > > > with the New Yahoo Optimized
> IE8. Get
> > > it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Tobi Oetiker, OETIKER+PARTNER
> AG,
> > > Aarweg 15
> > > > > CH-4600 Olten,
> > > > > > > Switzerland
> > > > > > > http://it.oetiker.ch tobi at oetiker.ch
> > > > > > > ++41 62 775 9902 / sb: -9900
> > > > > >
> > > > > >
> > > > > > Your Mail works best
> > > > > with the New Yahoo Optimized IE8. Get
> it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > Tobi Oetiker, OETIKER+PARTNER AG,
> Aarweg 15
> > > CH-4600 Olten,
> > > > > Switzerland
> > > > > http://it.oetiker.ch tobi at oetiker.ch
> > > > > ++41 62 775 9902 / sb: -9900
> > > >
> > > >
> > > > Your Mail works best
> > > with the New Yahoo Optimized IE8. Get it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > >
> > > >
> > >
> > > --
> > > Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15
> CH-4600 Olten,
> > > Switzerland
> > > http://it.oetiker.ch tobi at oetiker.ch
> > > ++41 62 775 9902 / sb: -9900
> >
> >
> > The INTERNET now has a
> personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/
> >
> >
>
> --
> Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten,
> Switzerland
> http://it.oetiker.ch tobi at oetiker.ch
> ++41 62 775 9902 / sb: -9900
The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/
More information about the rrd-users
mailing list