[rrd-users] rrd + zfs compression = massive space savings

[Tobias Oetiker]

Today Tntteam wrote:

> Hey,,
>
> "
> note that the gain will drop as your rrd files are filling with
> actual data ... so make sure you have plenty of free space on that
> system !
> "
>
>
> So when the rrd"s are full, the gain of space will be like how many % ? Any
> idea ?

I don't know for sure but since there is no padding in the rrd
format I would guess that the compressibility is pretty low unless
you have data with long stretches of repetitive values ...

try gziping a full rrd file and you will see ...

cheers
tobi

>
>
> Thanks
>
> 2011/2/20 Tobias Oetiker <tobi at oetiker.ch>
>
> > Steve,
> >
> > note that the gain will drop as your rrd files are filling with
> > actual data ... so make sure you have plenty of free space on that
> > system !
> >
> > cheers
> > tobi
> >
> > Yesterday Bernard Li wrote:
> >
> > > Hi Steve:
> > >
> > > Thanks for sharing this!
> > >
> > > Have you also tried using rrdcached on top of your ZFS setup?  I
> > > wonder if that would provide any additional benefits.
> > >
> > > Cheers,
> > >
> > > Bernard
> > >
> > > On Sat, Feb 19, 2011 at 10:54 AM, Steven Hartland
> > > <killing at multiplay.co.uk> wrote:
> > > > Just wanted to share our experience with using zfs compression
> > > > on FreeBSD for our rrds.
> > > >
> > > > We're seen a fantastic 21.41x compression ratio on our 46k rrds
> > > > stored on a zfs volume compressed with gzip. This means meaning
> > > > we're saving 93GB of space by doing this :)
> > > >
> > > > The gzip compression is CPU heavy so if you want to use this
> > > > you need a good amount of CPU available but if your short on
> > > > IO throughput which tends to be the case when updating this
> > > > many rrds it also a great way to improve performance.
> > > >
> > > >    Regards
> > > >    Steve
> > > >
> > > > ================================================
> > > > This e.mail is private and confidential between Multiplay (UK) Ltd. and
> > the person or entity to whom it is addressed. In the event of misdirection,
> > the recipient is prohibited from using, copying, printing or otherwise
> > disseminating it or any information contained in it.
> > > >
> > > > In the event of misdirection, illegible or incomplete transmission
> > please telephone +44 845 868 1337
> > > > or return the E.mail to postmaster at multiplay.co.uk.
> > > >
> > > > _______________________________________________
> > > > rrd-users mailing list
> > > > rrd-users at lists.oetiker.ch
> > > > https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
> > > >
> > >
> > > _______________________________________________
> > > rrd-users mailing list
> > > rrd-users at lists.oetiker.ch
> > > https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
> > >
> > >
> >
> > --
> > Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland
> > http://it.oetiker.ch tobi at oetiker.ch ++41 62 775 9902 / sb: -9900
> > _______________________________________________
> > rrd-users mailing list
> > rrd-users at lists.oetiker.ch
> > https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users
> >
> >
>

-- 
Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland
http://it.oetiker.ch tobi at oetiker.ch ++41 62 775 9902 / sb: -9900