[rrd-users] find top 10 in > 4000 rrd files

[David Thornton]

I'd like to suggest that you could sped this up big time on a multi core
device by using "parallel"

http://savannah.gnu.org/projects/parallel/

You do the extraction in parallel:

  rrdtool graph /dev/null \
    --start ... --end ... --step ... \
    DEF:x=$x:column:AVERAGE \
    VDEF:y=x,MAXIMUM
    PRINT:y:$x=%lf
    grep = > /ramdisk/$ip.$id.data

and then you cat all the small little files, and sort , print.

(probaby the rrdtool command line is what takes most of the computing
power.)

David

On Thu, Oct 2, 2014 at 4:29 AM, Rob Hassing <rob.hassing at deltics.nl> wrote:

> I am measuring the bandwidth usage of over 4000 ports in a network using
> sFlow.
>
> The sFlow daemon I use generates a rrd file for each port.
>
> So I have over 4000 rrd files named: x.x.x.x-Y.rrd
> Where x.x.x.x is the ip address of the host and y is the portindex number.
>
> Now I would like to find the top 10 of bandwidth usage in these 4000 files.
>
> Anyone done something like this before or does somebody have an idea on how
> to do this?
>
> Thank you very much in advance
>
> Best regards,
> Rob Hassing
>
>
>
> --
> View this message in context:
> http://rrd-mailinglists.937164.n2.nabble.com/find-top-10-in-4000-rrd-files-tp7582509.html
> Sent from the RRDtool Users Mailinglist mailing list archive at Nabble.com.
>
> _______________________________________________
> rrd-users mailing list
> rrd-users at lists.oetiker.ch
> https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.oetiker.ch/pipermail/rrd-users/attachments/20141002/c884dbf7/attachment.html>