<div>Thank you for your answer.</div>
<div> </div>
<div>I need to store the data during 1 month.</div>
<div>I store the data every 2 minutes.</div>
<div>One rrd file has a size of 150 ko. I create 5 files for a connection (source <-> destination for a protocol and for a service)</div>
<div>The subnet size is not too big but there is a lot of different source ip (thousands).</div>
<div>My hard drive could no manipulate so much files at the same time. </div>
<div>Consequently, i have performance problems to write and read data.<br><br> </div>
<div><span class="gmail_quote">2008/2/18, Carsten Aulbert <<a href="mailto:carsten@welcomes-you.com">carsten@welcomes-you.com</a>>:</span>
<blockquote class="gmail_quote" style="PADDING-LEFT: 1ex; MARGIN: 0px 0px 0px 0.8ex; BORDER-LEFT: #ccc 1px solid">Hi, I'm new here so please bear with me.<br><br>Gwenael Lahay wrote:<br>><br>> For the moment, i create rrd file to store data for one net flow :<br>
> - a total file which stores the flow for a destination of the subnet<br>> - a service file which store the flow for a service and for a<br>> destination of the subnet<br>> - a total file which stores the flow from a source (in direction of the<br>
> subnet)<br>> - a service file which store the flow for a service and for a source (in<br>> direction of the subnet)<br>> - a protocol file which store the flow for a protocol and for a source<br>> (in direction of the subnet)<br>
><br>> As i create a file for each sources and for each destinations (for each<br>> services and for each protocols), the size of rrd database is enormous.<br><br>What's the typical size for each file and how long do you want to store<br>
the data for? You might want to average over some time to save data if<br>that is possible.<br><br>How large is the subnet, i.e. how many machines are you expecting? Even<br>with a rrd size of 2MB and 250 possible hosts on a net you would<br>
generate "only" 250*249*2 ~ 120 GB of archives.<br><br>Remember: rrd is constant size, i..e once created they won't change<br>their size.<br><br>><br>> My questions :<br>> Do you think that it exists a better way to store all this data ?<br>
> Should i replace RRD database with another type of database (MySQL, ...) ?<br>><br><br>I don't know, depends on what you need. However, I think that with any<br>SQL you need to make sure of a way to purge/summarize data. Otherwise<br>
the tables will become too large and *SQL too slow.<br><br>Just an estimate:<br>Storing 32bit counters for each possible connection with 250 hosts, with<br>a datapoint every 1s yields already: ~ 250kB/s<br><br>You have to decide how much data you want to keep - and all this does<br>
not yet include the service traffic.<br><br>So I think rrds are still good enough for you, but you need to decide<br>how much data you need to keep and visualize.<br><br>HTH<br><br>Carsten<br></blockquote></div><br>