[rrd-users] Storing Static + Dynamic data in rrd
Shameem Ahamed
shameem.ahamed at yahoo.com
Thu Feb 25 16:01:18 CET 2010
Do you have any other tool suggestion ?.
I want to store time-series data(and RRDTool is best suited for that), in normal SQL, i have to aggregate the data every time interval.
My aim is to aggregate the spam/virus count with user and domain details within the network.
Regards,
Shameem
--- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch> wrote:
> From: Tobias Oetiker <tobi at oetiker.ch>
> Subject: Re: [rrd-users] Storing Static + Dynamic data in rrd
> To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> Cc: rrd-users at lists.oetiker.ch
> Date: Thursday, 25 February, 2010, 8:04 PM
> Hi Shameed,
>
> Today Shameem Ahamed wrote:
>
> > Ok,
> >
> > You meant to say that, I can create a rrd file as
> given below.
> >
> >
> > rrdtool create domain1.com.rrd --step 300 \
> >
> DS:shameem1 \
> >
> DS:mailcount:COUNTER:1800:0:4294967295 \
> >
> RRA:AVERAGE:0.5:1:2016 \
> >
> DS:spamcount:COUNTER:1800:0:4294967295 \
> >
> RRA:AVERAGE:0.5:1:2016 \
> >
> DS:shameem2 \
> >
> DS:mailcount:COUNTER:1800:0:4294967295 \
> >
> RRA:AVERAGE:0.5:1:2016 \
> >
> DS:spamcount:COUNTER:1800:0:4294967295 \
> >
> RRA:AVERAGE:0.5:1:2016 \
> >
> >
> > In this case, DS names will collide rt?. How can we
> map the DS with corresponding user name.
>
> no you would do as follows (but note maybe an SQL db is
> better for your
> problem).
>
> rrdtool create domain1.com.rrd --step 300 \
>
> DS:shameem1_mailcount:COUNTER:1800:0:4294967295
> \
>
> DS:shameem1_spamcount:COUNTER:1800:0:4294967295
> \
>
> DS:shameem2_mailcount:COUNTER:1800:0:4294967295
> \
>
> DS:shameem2_spamcount:COUNTER:1800:0:4294967295
> \
>
> RRA:AVERAGE:0.5:1:2016
>
> cheers
> tobi
> >
> > Regards,
> > Shameem
> >
> >
> > --- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch>
> wrote:
> >
> > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > Subject: Re: [rrd-users] Storing Static + Dynamic
> data in rrd
> > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > Cc: rrd-users at lists.oetiker.ch
> > > Date: Thursday, 25 February, 2010, 7:22 PM
> > > Shameem,
> > >
> > > Today Shameem Ahamed wrote:
> > >
> > > > Ok,
> > > >
> > > > In that case, how can i add a static data in
> rrd(Here
> > > username).
> > > >
> > > > As far as i know, rrdcreate is expecting
> data as given
> > > below
> > > >
> > > > DS:ds-name:DST:dst arguments
> > > >
> > > > How can i add a fixed data (user name) as a
> DS ?.
> > >
> > > you could use the username as the ds-name ...
> there is no
> > > provision
> > > for meta data in the rrd format.
> > >
> > > cheers
> > > tobi
> > >
> > > >
> > > >
> > > > Regards,
> > > > Shameem
> > > >
> > > >
> > > >
> > > > --- On Thu, 25/2/10, Tobias Oetiker <tobi at oetiker.ch>
> > > wrote:
> > > >
> > > > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > > > Subject: Re: [rrd-users] Storing Static
> + Dynamic
> > > data in rrd
> > > > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > > > Cc: rrd-users at lists.oetiker.ch
> > > > > Date: Thursday, 25 February, 2010, 7:00
> PM
> > > > > Hi Shameem,
> > > > >
> > > > > Today Shameem Ahamed wrote:
> > > > >
> > > > > > Can we have rrd files per domain
> (rather
> > > than per
> > > > > e-mail id) ?.
> > > > > > As a total i may have 10K domains,
> and if
> > > each domain
> > > > > has 5
> > > > > > email, i will end up with 50K
> files. So
> > > instead of
> > > > > that, can i
> > > > > > have rrd files per domain (10K)
> and store
> > > the user
> > > > > information
> > > > > > and user data within it ?.
> > > > > >
> > > > > > Is this possible ?
> > > > >
> > > > > if you have a fixed number of emails
> per domain
> > > then this
> > > > > is doable, the
> > > > > problem is that all updates to a single
> rrd file
> > > must be
> > > > > synchronous ... and changeing an
> existing rrd
> > > to a
> > > > > different
> > > > > structure is not that easy
> > > > >
> > > > > cheers
> > > > > tobi
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Shameem
> > > > > >
> > > > > > --- On Thu, 25/2/10, Tobias
> Oetiker <tobi at oetiker.ch>
> > > > > wrote:
> > > > > >
> > > > > > > From: Tobias Oetiker <tobi at oetiker.ch>
> > > > > > > Subject: Re: [rrd-users]
> Storing Static
> > > + Dynamic
> > > > > data in rrd
> > > > > > > To: "Shameem Ahamed" <shameem.ahamed at yahoo.com>
> > > > > > > Cc: rrd-users at lists.oetiker.ch
> > > > > > > Date: Thursday, 25 February,
> 2010, 5:58
> > > PM
> > > > > > > Hi Shameen,
> > > > > > >
> > > > > > > Today Shameem Ahamed wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > > Is there anyway , I can
> store both
> > > static
> > > > > and dynamic
> > > > > > > data in rrd.
> > > > > > > >
> > > > > > > > I want to store the spam
> count
> > > details for
> > > > > all the
> > > > > > > e-mail accounts.
> > > > > > > >
> > > > > > > >
> > > > > > > > The format, I am
> thinking is
> > > something like
> > > > > > > >
> > > > > > > >
> > > > > > > -> user1 at domain1.com
> > > > > > > ->[data]
> > > > > > > > domain1.com -> user2 at domain1.com
> > > > > > > ->[data]
> > > > > > > >
> > > > > > > -> user3 at domain1.com
> > > > > > > ->[data]
> > > > > > > >
> > > > > > > >
> > > > > > > -> user1 at domain2.com
> > > > > > > ->[data]
> > > > > > > > domain2.com -> user2 at domain2.com
> > > > > > > ->[data]
> > > > > > > >
> > > > > > > -> user3 at domain2.com
> > > > > > > ->[data]
> > > > > > > >
> > > > > > > >
> > > > > > > > Is it possible ?. Is
> there any
> > > other rrd
> > > > > tool to
> > > > > > > achieve this kind of storage
> ?.
> > > > > > >
> > > > > > > since rrd tool is best at
> storing
> > > 'preiodic'
> > > > > data, you
> > > > > > > should make
> > > > > > > sure that you set the 'step'
> at an
> > > interval such
> > > > > that users
> > > > > > > are
> > > > > > > likely to get several mails
> withing
> > > that interval
> > > > > ... else
> > > > > > > you are
> > > > > > > wasting storage space and
> would be
> > > better served
> > > > > with some
> > > > > > > sql data
> > > > > > > base ...
> > > > > > >
> > > > > > > having a separate rrd file
> per email
> > > address and
> > > > > storing in
> > > > > > > there
> > > > > > > some data about the users
> mail activity
> > > once per
> > > > > day seems
> > > > > > > like a
> > > > > > > sensible thing todo ...
> > > > > > >
> > > > > > > maybe
> > > > > > >
> > > > > > >
> > > > >
> > >
> mail-sent:mail-received:spam-received:virus-received:bounces-received
> > > > > > >
> > > > > > > cheers
> > > > > > > tobi
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > > Shameem
> > > > > > > >
> > > > > > > >
> > > > > > > > Your Mail
> works best
> > > > > > > with the New Yahoo Optimized
> IE8. Get
> > > it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > > > > > >
> > > > > > > >
> > > > >
> _______________________________________________
> > > > > > > > rrd-users mailing list
> > > > > > > > rrd-users at lists.oetiker.ch
> > > > > > > > https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > Tobi Oetiker, OETIKER+PARTNER
> AG,
> > > Aarweg 15
> > > > > CH-4600 Olten,
> > > > > > > Switzerland
> > > > > > > http://it.oetiker.ch tobi at oetiker.ch
> > > > > > > ++41 62 775 9902 / sb: -9900
> > > > > > >
> > > > > >
> > > > > >
> > > > > > Your Mail works best
> > > > > with the New Yahoo Optimized IE8. Get
> it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > > > >
> > > > > >
> > > > >
> > > > > --
> > > > > Tobi Oetiker, OETIKER+PARTNER AG,
> Aarweg 15
> > > CH-4600 Olten,
> > > > > Switzerland
> > > > > http://it.oetiker.ch tobi at oetiker.ch
> > > > > ++41 62 775 9902 / sb: -9900
> > > >
> > > >
> > > > Your Mail works best
> > > with the New Yahoo Optimized IE8. Get it NOW! http://downloads.yahoo.com/in/internetexplorer/
> > > >
> > > >
> > >
> > > --
> > > Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15
> CH-4600 Olten,
> > > Switzerland
> > > http://it.oetiker.ch tobi at oetiker.ch
> > > ++41 62 775 9902 / sb: -9900
> >
> >
> > Your Mail works best
> with the New Yahoo Optimized IE8. Get it NOW! http://downloads.yahoo.com/in/internetexplorer/
> >
> >
>
> --
> Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten,
> Switzerland
> http://it.oetiker.ch tobi at oetiker.ch
> ++41 62 775 9902 / sb: -9900
The INTERNET now has a personality. YOURS! See your Yahoo! Homepage. http://in.yahoo.com/
More information about the rrd-users
mailing list