<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
On 10/23/2010 8:42 AM, Simon Hobson wrote:
<blockquote cite="mid:p06240833c8e8b1e93d7f@simon.thehobsons.co.uk"
type="cite">
<pre wrap="">Philip Peake wrote:
</pre>
<blockquote type="cite">
<pre wrap="">Simon, the script forces log data on 30 second boundaries, I use
calculated times, not "now".
This includes the NaN value when a data source disappears, and for the
zero values entered into it every 30 seconds until the source comes back
online.
</pre>
</blockquote>
<pre wrap="">
OK, that rules out a conflict between updates and reset. The bit
about zeros while the data source is away is new - you didn't mention
that.
</pre>
<blockquote type="cite">
<pre wrap="">I have dumped the DB values, and see exactly what I expect
</pre>
</blockquote>
<pre wrap="">
With all due respect - yu apparently aren't seeing what you expect,
hence the query !
</pre>
<blockquote type="cite">
<pre wrap=""> - increasing
values, a NaN (well, I actually got two Nans), then a string of zeros
followed by a HUGE number (rrd thinks a counter rollover occurred, but
only when it sees a non-zero data value ????) followed by data source
readings.
</pre>
</blockquote>
<pre wrap="">
What value does your source have when it comes back online ?
I'd still suggest modifying your script(s) to log the update values
to a text file - it will help enormously if you can provide a set of
update statements that replicates the problem. Without that we are
guessing, and you've already "changed the story" as I was assuming
your were immediately storing real values after the reset (and
wondering why the zeros before the spike).
</pre>
</blockquote>
<br>
No change -- someone didn't read the original post, which includes
an example of the type of data seen:<br>
<br>
<blockquote type="cite">
<pre wrap="">What I see if I look back over the data is a sequence looking like this
(simplified, with thee data sources):
T1 1000 1004 997
T2 1010 1020 1003
T3 NaN Nan NaN
T4 NaN NaN NaN
T5 0 0 0
T6 0 0 0
T7 0 0 0
T8 4E6 4E6 4E6
T9 15 12 10
</pre>
</blockquote>
<br>
There seem to be a sequence of zeros there ... no?<br>
<br>
Just to be clear, they way it works is:<br>
<br>
* Read fails - substitute a 'U' for the data.<br>
* Mark data source as down.<br>
* Schedule re-connect to data source for five minutes in the future.<br>
<br>
In 30 second loop:<br>
<br>
* For each data source, read value. if a DS is marked down,
substitute zero.<br>
<br>
So when a DS goes down, we will get a NaN, followed by a string of
zeros, until the DS comes back online.<br>
At that point, the value actually read will be sent to the DB.<br>
<br>
Here is the actual DB content:<br>
<br>
<tt><small>1287767520: 3.5333333333e+01 2.7066666667e+01
3.0866666667e+01 3.3033333333e+01 2.4733333333e+01
5.9566666667e+01 3.7766666667e+01 2.3133333333e+01
2.6200000000e+01<br>
<br>
1287767550: 3.8900000000e+01 2.5533333333e+01 3.2033333333e+01
3.4133333333e+01 2.6033333333e+01 6.3866666667e+01
4.8066666667e+01 2.5500000000e+01 2.9066666667e+01<br>
<br>
1287767580: 3.6966666667e+01 2.7166666667e+01 3.3033333333e+01
2.8300000000e+01 2.4066666667e+01 6.2033333333e+01
3.4833333333e+01 2.1233333333e+01 2.7266666667e+01<br>
<br>
1287767610: 3.6400000000e+01 2.4433333333e+01 3.0633333333e+01
2.7466666667e+01 2.1700000000e+01 5.7400000000e+01
4.3600000000e+01 2.0633333333e+01 1.8933333333e+01<br>
<br>
1287767640: 3.5200000000e+01 2.3066666667e+01 2.8200000000e+01
3.0700000000e+01 2.3466666667e+01 6.1633333333e+01
2.9266666667e+01 1.7700000000e+01 2.4466666667e+01<br>
<br>
1287767670: 3.7433333333e+01 2.7733333333e+01 3.3000000000e+01
3.3866666667e+01 2.8500000000e+01 5.8666666667e+01
4.3700000000e+01 2.5766666667e+01 2.6633333333e+01<br>
<br>
1287767700: 3.6366666667e+01 2.3633333333e+01 2.8300000000e+01
2.9833333333e+01 2.0933333333e+01 5.8000000000e+01
3.4400000000e+01 2.3666666667e+01 2.4000000000e+01<br>
<br>
1287767730: 3.8833333333e+01 3.6900000000e+01 3.6800000000e+01
3.9566666667e+01 2.6866666667e+01 6.2800000000e+01
4.4000000000e+01 3.0700000000e+01 3.0400000000e+01<br>
<br>
1287767760: 3.6366666667e+01 3.6533333333e+01 3.9066666667e+01
4.2300000000e+01 3.4100000000e+01 6.8600000000e+01
4.2866666667e+01 3.5633333333e+01 3.6166666667e+01<br>
<br>
1287767790: 3.4700000000e+01 2.2100000000e+01 2.9333333333e+01
3.7933333333e+01 2.5633333333e+01 5.7800000000e+01
4.4100000000e+01 2.5700000000e+01 3.5333333333e+01<br>
<br>
1287767820: 3.3866666667e+01 2.4200000000e+01 2.8833333333e+01
3.4766666667e+01 2.9233333333e+01 6.0933333333e+01
3.7066666667e+01 2.5700000000e+01 2.5700000000e+01<br>
<br>
1287767850: nan nan nan nan nan nan nan nan nan<br>
<br>
1287767880: nan nan nan nan nan nan nan nan nan<br>
<br>
1287767910: 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00<br>
<br>
1287767940: 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00<br>
<br>
1287767970: 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00<br>
<br>
1287768000: 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00<br>
<br>
1287768030: 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00<br>
<br>
1287768060: 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00<br>
<br>
1287768090: 0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e</small></tt><big><tt><small><small>+00
0.0000000000e+00<br>
<br>
....<br>
</small></small></tt></big>
<p class="MsoNormal"><big><tt><small><small>1287768450:
0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768480:
0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768510:
0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00
0.0000000000e+00 0.0000000000e+00</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768540:
2.5901286667e+06 6.3913936667e+05
2.8650751333e+06 3.9261653333e+06 6.5304750000e+05
1.9967121000e+06
6.6341213333e+05 3.0846810333e+06 3.4084224000e+06<br>
</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768570:
2.9600000000e+01 1.8233333333e+01
2.6966666667e+01 3.6666666667e+01 2.3133333333e+01
6.3000000000e+01
4.1733333333e+01 1.8100000000e+01 2.5700000000e+01</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768600:
3.3533333333e+01 2.1366666667e+01
2.5100000000e+01 2.9033333333e+01 2.1466666667e+01
6.2166666667e+01
3.3200000000e+01 2.2133333333e+01 2.3433333333e+01</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768630:
5.8900000000e+01 4.5400000000e+01
4.8666666667e+01 4.0333333333e+01 2.8966666667e+01
6.8666666667e+01
4.6433333333e+01 4.3733333333e+01 3.6300000000e+01</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768660:
3.7066666667e+01 2.8200000000e+01 3.5933333333e+01
3.5733333333e+01 2.9700000000e+01 6.8666666667e+01
4.3466666667e+01
3.6233333333e+01 3.5466666667e+01</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768690:
3.5100000000e+01 2.9733333333e+01
4.3900000000e+01 2.8033333333e+01 2.2300000000e+01
6.1433333333e+01
4.6766666667e+01 2.4966666667e+01 6.2766666667e+01</small></small></tt></big></p>
<p class="MsoNormal"><big><tt><small><small>1287768720:
4.1300000000e+01 2.8600000000e+01
3.5550000000e+01 3.4733333333e+01 2.4100000000e+01
6.4016666667e+01
4.0183333333e+01 1.8750000000e+01 1.7033333333e+01</small></small></tt></big></p>
<br>
</body>
</html>