<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">I have MRTG configured to write to rrd files and run as a daemon, polling over a dozen devices, and this has been working for quite some time. Yesterday, however, I pulled up my routers2.cgi front-end to look at the data, and found *most* of the graphs blank, with just a few showing completely unbelievable data (steadily climbing usage, for example). In trying to debug it, it looks like the problem is that the RRD files are not being written correctly, or else that MRTG is no longer getting the correct values to put in them:<div class=""><br class=""></div><div class="">- When running a command like "rrdtool fetch 10.14.254.14_gi0_1.rrd AVERAGE", I get output like this:</div><div class=""><br class=""></div><div class="">1478885940: nan nan<br class="">1478886000: nan nan<br class="">1478886060: nan nan<br class="">1478886120: nan nan<br class="">1478886180: nan nan<br class="">1478886240: nan nan<br class="">1478886300: nan nan<br class="">1478886360: nan nan<br class="">1478886420: nan nan<br class="">1478886480: nan nan<br class="">1478886540: nan nan<br class="">1478886600: nan nan<br class="">1478886660: nan nan<br class="">1478886720: nan nan<br class="">1478886780: nan nan<br class="">1478886840: nan nan<br class="">1478886900: nan nan</div><div class=""><br class=""></div><div class="">Or, in a *few* isolated cases, I'll see something like this:</div><div class=""><br class=""></div><div class="">1478886180: nan nan<br class="">1478886240: nan nan<br class="">1478886300: nan nan<br class="">1478886360: nan nan<br class="">1478886420: 3.4949820633e+07 nan<br class="">1478886480: 3.4950327200e+07 nan<br class="">1478886540: 3.4950794517e+07 nan<br class="">1478886600: 3.4951350633e+07 nan<br class="">1478886660: 3.4951841283e+07 nan<br class="">1478886720: 3.4952208400e+07 nan<br class="">1478886780: 3.4952782750e+07 nan<br class="">1478886840: 3.4953294733e+07 nan<br class="">1478886900: 3.4953738400e+07 nan<br class="">1478886960: 3.4954303633e+07 nan<br class="">1478887020: 3.4954859750e+07 nan<br class="">1478887080: 3.4955419567e+07 nan<br class="">1478887140: 3.4956047750e+07 nan<br class="">1478887200: 3.4956552467e+07 nan<br class="">1478887260: 3.4957036567e+07 nan<br class="">1478887320: 3.4957632633e+07 nan<br class="">1478887380: 3.4958179633e+07 nan<br class="">1478887440: 3.4958717517e+07 nan<br class="">1478887500: nan nan<br class="">1478887560: nan nan</div><div class=""><br class=""></div><div class="">Where only the second number is nan (I can't claim to know what the numbers mean). </div><div class=""><br class=""></div><div class="">When running MRTG with debug flags, the snpo flag seems to indicate proper polling operation on all targets, giving output like this:</div><div class=""><br class=""></div><div class="">2016-11-11 09:28:54 -- --snpo: (0) Name crosscheck OK<br class="">2016-11-11 09:28:54 -- --snpo: (1) Name crosscheck OK</div><div class="">2016-11-11 09:28:54 -- --snpo: (0) Confcache Match Gi0/2 -> .10102<br class="">2016-11-11 09:28:54 -- --snpo: (1) Confcache Match Gi0/2 -> .10102<br class="">2016-11-11 09:28:54 -- --snpo: SNMPGet from <a href="mailto:public@10.14.254.14" class="">public@10.14.254.14</a>:::::2 -- ifName.10102,ifHCInOctets.10102,ifName.10102,ifHCOutOctets.10102<br class="">2016-11-11 09:28:54 -- --snpo: SNMPfound -- 'Gi0/7', '12796956213', 'Gi0/7', '93342632190'<br class="">2016-11-11 09:28:54 -- --snpo: (0) Name crosscheck OK<br class="">2016-11-11 09:28:54 -- --snpo: (1) Name crosscheck OK<br class=""></div><div class=""><br class=""></div><div class="">...but turning on the "log" flag shows entries like the following:</div><div class=""><br class=""></div><div class="">2016-11-11 08:47:50 -- --log: RRDs::update(/var/www/mrtg/10.14.254.14_gi0_1.rrd, '1478886468:34950240:805618082')<br class="">2016-11-11 08:47:50 -- --log: got: 34949820.6333333/???<br class="">2016-11-11 08:47:50 -- --log: RRDs::update(/var/www/mrtg/10.14.254.14_gi0_2.rrd, '1478886468:3971345709:119346021279')<br class="">2016-11-11 08:47:50 -- --log: got: ???/???</div><div class=""><br class=""></div><div class="">Presumably the first one is where we get the single-number entries from, while the second is where we get the pure nan entries from. In either case, though, it doesn't appear to be working correctly.</div><div class=""><br class=""></div><div class="">I did try removing all the rrd files and letting MRTG re-create them, but it didn't seem to make a difference. Also, please keep in mind that this is happening across dozens of different devices - it's not just a single device.</div><div class=""><br class=""></div><div class="">All configuration files have been generated using carmaker, with commands like "/usr/local/bin/cfgmaker --ifref=name --noreversedns --ifdesc=alias 10.14.254.14:::::2 --output=/etc/mrtg/main/ravnanc-sw13.cfg"</div><div class=""><br class=""></div><div class="">What might be causing this? How might I debug it? Thanks.<br class=""><br class=""><div class="">
<div style="font-variant-ligatures: normal; font-variant-position: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; line-height: normal; text-align: -webkit-auto; text-indent: 0px; orphans: 2; widows: 2; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class=""><div class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">-----------------------------------------------<o:p class=""></o:p></span></div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica, sans-serif; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">Israel Brewster<o:p class=""></o:p></span></div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica, sans-serif; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">Systems Analyst II<o:p class=""></o:p></span></div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica, sans-serif; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">Ravn Alaska<o:p class=""></o:p></span></div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica, sans-serif; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">5245 Airport Industrial Rd<o:p class=""></o:p></span></div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica, sans-serif; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">Fairbanks, AK 99709<o:p class=""></o:p></span></div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica, sans-serif; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">(907) 450-7293<o:p class=""></o:p></span></div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica, sans-serif; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; font-size: 12px;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class="">-----------------------------------------------</span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 9pt; font-family: Helvetica, sans-serif;" class=""></span><br class="Apple-interchange-newline"></div></div></div></div><span style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br class="Apple-interchange-newline"><span></span></span></div></div></body></html>