<html><body><div style="color:#000; background-color:#fff; font-family:arial, helvetica, sans-serif;font-size:10pt"><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><span><br></span></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><span>Jo,</span></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><span><br></span></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><span><div style="font-size: 10pt; ">In regards to RedHat:</div><div style="font-size: 10pt; "><br></div><div style="font-size: 10pt; "><span class="Apple-tab-span" style="white-space: pre; "> </span>Open a case with them and tell them about the corruption ... maybe they'll patch rrdtool and release a 1.3.8-xyz :-)</div><div style="font-size: 10pt; "><br></div><div style="font-size: 10pt; ">In regards to rrdtool:</div><div style="font-size: 10pt; "><br></div><div style="font-size:
10pt; "><span class="Apple-tab-span" style="white-space: pre; "> </span>Compile the latest revision 1.4.7 http://oss.oetiker.ch/rrdtool/pub/rrdtool-1.4.7.tar.gz and if it also corrupts report that to the list here.</div><div style="font-size: 10pt; "><br></div></span></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><span><rant></span></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><span><br></span></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">I don't feel it's rrdtool's place to compile binaries; it's far too simple to build a new binary and there are too many variances in distros ... additionally some binaries which come from operating system distros are such old revisions I'd never <span style="font-style: italic; ">_ever_</span><span style="font-size: 10pt; "> use them. For rrdtool.org to provide binaries isn't good because
rrdtool is often compiled against other software on the system: perl, mod_perl, python(?), pango, cairo, etc.</span></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><span></span></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">On a RHEL6.1 distro:</div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div><div><span style="font-size: 13px;">[epicadm@epicdn002 ]$ yum list | grep rrdtool</span></div><div><span style="font-size: 13px;">rrdtool.i686 1.3.8-6.el6 base </span></div><div style="font-family: arial, helvetica,
sans-serif; font-size: 10pt; "><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">In checking when that revision was released:</div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><pre style="border: 1px solid rgb(191, 191, 191); background-color: rgb(232, 232, 232); padding: 1em; "><img src="http://oss.oetiker.ch/icons/compressed.gif" alt="[ ]"> <a href="http://oss.oetiker.ch/rrdtool/pub/rrdtool-1.3.8.tar.gz" style="color: black; ">rrdtool-1.3.8.tar.gz</a> 19-May-2009 15:47 1.0M</pre></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">2009 ... there are numerous improvements/changes between 1.3 -> 1.4 all worth upgrading too. The -6 in the revision means RedHat made additional patches on their own, lord knows what, one would need to check redhat errata. </div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt;
"><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">This can be said for nearly every software release on a distro; and not all are double-tripple-checked by distro providers either; MySQL is old, Perl is old, Apache, memcached ... nearly everything are all old to some extent or another. Should they be stable? Yes ... but it's the distros responsibility to keep up-to-date; and many things are included for no other reason than convenience and being able to state 'we have that!'</div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">RHEL's version of perl for years was so broken it couldn't even be used to compile rrdtool, net-snmp or mod_perl ... so I was compiling perl for a long time as well.<br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div
style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">It's far too easy to build a new rrdtool binary and put it in a directory of your choosing, the shell script to do this automatically for me (directly from the rrdtool doc/rrdbuild.txt) is a handful of lines and creates a directory which I bundle in an RPM. doc/rrdbuild.txt is so good in fact it provides fully working examples for building zlib, libpng, freetype, libxml2, cairo, pango, zlib ... in case the distro has old-revs or no-revs of those (RHEL 5/6 need none of this.)</div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">To the extent of corruption, I've tested this as well and also can't reproduce. I know of less than a handful of bugs in rrdtool that are minor annoyances; none of which are corruption or stability concerns.</div><div style="font-family:
arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">The amusing end if you've made it this far ... since a distro will only fix what users report to them as broken; I doubt many use 'resize' in rrdtool ... it causes so much IO at scale that it's unlikely to be used very often; I for one nearly never use it and only provide a 'safe' app-based facility to curb the IO storm it would create when modifying thousands/millions of rrds.</div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">The most I use resize is for directly after creating a Holt-Winters datafile and wanting to resize the FAILURES RRA; as this is quick (in-memory entirely) and on a case-by-case creation basis.</div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div
style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "></rant></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><div style="font-size: 10pt; "><br></div><div style="font-size: 10pt; ">Wishful thinking: RRDTool could stand to have a new datafile format supporting extent-based RRAs, the header tracking extent offsets into the datafile so users can tune extent-count for an RRA and the datafile just be grown by an extent equal to the row-size of the original and not resized(rewritten) ... which would resolve a number of scaling/long-term concerns.</div><div><br></div></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; ">-Ryan</div><div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div><div
style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "><br></div></div> <div style="font-family: arial, helvetica, sans-serif; font-size: 10pt; "> <div style="font-family: 'times new roman', 'new york', times, serif; font-size: 12pt; "> <div dir="ltr"> <font size="2" face="Arial"> <hr size="1"> <b><span style="font-weight:bold;">From:</span></b> Tobias Oetiker <tobi@oetiker.ch><br> <b><span style="font-weight: bold;">To:</span></b> Jo Rhett <jrhett@netconsonance.com> <br><b><span style="font-weight: bold;">Cc:</span></b> rrd-users@lists.oetiker.ch <br> <b><span style="font-weight: bold;">Sent:</span></b> Saturday, August 18, 2012 2:38 AM<br> <b><span style="font-weight: bold;">Subject:</span></b> Re: [rrd-users] RHEL RPMS of rrdtool corrupts timestamps in both 1.3.9 and 1.4.7<br> </font> </div> <br>
Hi Joe,<br><br>Yesterday Jo Rhett wrote:<br><br>> So I am curious. There is not much interest in the fact that the<br>> CentOS / RHEL rpms for rrdtool corrupt/destroy data when resize<br>> is used? How many people have to slam into this issue on their<br>> own before someone will take action to get those RPMs updated?<br><br>there are no 'official' rrd rpms from me, so I have no say over how<br>and when the ones you are using are being updated ...<br><br>otoh, I would certainly like to make sure rrdtool does not have<br>bugs in the resize code ... I have tried to reproduce what you are<br>experiencing on my system (64bit Intel ubuntu 12.04).<br><br>* rrdtool compiled with mmap enabled<br>* rrd files even residing on an nfs mounted filesystem ...<br><br>to no avail ... it all works.<br><br>there were a bunch of rrd_resize bugs fixed for rrdtool 1.4.6<br>(r2192,r2169,r2166) though, so maybe for some odd reason, you are<br>actually running
PRE 1.4.6 code and not 1.4.7<br><br>it would help a lot if you could try and reproduce the problem you<br>are seeing with a freshly compiled rrdtool (from original source).<br><br>there is even a rpm spec file included in the distro, so that you<br>should be able to build an rpm if you so desire ...<br><br>hth<br>tobi<br><br>><br>> > On Jul 16, 2012, at 10:28 PM, Ryan Kubica wrote:<br>> >> I've never run into this issue before (and store a lot of data) and on 64bit hosts, but:<br>> >><br>> >> a) I always compile rrdtool not use stock OS rpm<br>> ><br>> > This isn't a common situation -- most people use RPMs, and that means that this is broken for most people. Also we are using a package that bundles a binary image of rrdtool, another situation where many people won't or can't change it out.<br>> ><br>><br>><br><br>-- <br>Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15
CH-4600 Olten, Switzerland<br>http://it.oetiker.ch <a ymailto="mailto:tobi@oetiker.ch" href="mailto:tobi@oetiker.ch">tobi@oetiker.ch</a> ++41 62 775 9902 / sb: -9900<br><br>_______________________________________________<br>rrd-users mailing list<br><a ymailto="mailto:rrd-users@lists.oetiker.ch" href="mailto:rrd-users@lists.oetiker.ch">rrd-users@lists.oetiker.ch</a><br><a href="https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users" target="_blank">https://lists.oetiker.ch/cgi-bin/listinfo/rrd-users</a><br><br><br> </div> </div> </div></body></html>