[rrd-developers] implementing portable format - change format?

Sfiligoi Igor sfiligoi at lnf.infn.it
Mon Nov 17 16:07:04 CET 2008

Tobias Oetiker wrote:
> Hi Igor,
> Yesterday Igor Sfiligoi wrote:
>> Hi Kevin and Tobi.
>> Since you are planning to radically change the format, have you considered
>> going a more "standard" way?
>> Instead of having a completely RRDTool specific format, use something
>> other tools could easily read?
>> What about SQLite?
>> It is already portable.
>> And it is a database ;)
>> It should be pretty easy to define a schema that serves RRDTool well.
>> Would it be worth a consideration?
>> Igor
> yes the thought has crossed my mind, the problem with SQL databases
> is that they are not realy good at updating round robin archives,
> du to transactional consistancy constraints they will create
> internal fragmentation which will cause performance to suffer
> dramatically.
> BUT it would be an interesting thought to see, if we can abstract
> the interface enough so that writing a 'plugin' for an sqlite
> storage backend becomes easy ...
> cheers
> tobi
What if the table had a structure like this:

with index the table key.
I.e. very similar to what you have now in the RRD file.

One would populate all the rows with consecutive indexes and
date=NULL,valueX=NULL at creation time.
The updates would be SQL UPDATEs on the existing row, i.e. replacing
date+valueX at a specific index.

This should keep the database compact and of fixed size.

Do you still see a fragmentation problem under this conditions?


More information about the rrd-developers mailing list