[rrd-developers] rrdcached crashed with no logging

[Bernard Li]

Hi all:

I'm currently working with rrdcached from rrdtool r1588 and am having
problems getting it to integrate with Ganglia.

This has worked in the past (about 2 weeks ago).  Right now I'm trying
to figure out what's wrong.

It seems that the daemon crashed without logging to syslog.  I straced
the rrdcached process and here's what I got:

---cut---
accept(3, {sa_family=AF_FILE, path=@}, [2]) = 6
mmap2(NULL, 10489856, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0xb613d000
mprotect(0xb613d000, 4096, PROT_NONE)   = 0
clone(child_stack=0xb6b3d4c4,
flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM|CLONE_SETTLS|CLONE_PARENT_SETTID|CLONE_CHILD_CLEARTID|CLONE_DETACHED,
parent_tidptr=0xb6b3dbe8, {entry_number:6, base_addr:0xb6b3dba0,
limit:1048575, seg_32bit:1, contents:0, read_exec_only:0,
limit_in_pages:1, seg_not_present:0, useable:1},
child_tidptr=0xb6b3dbe8) = 10556
poll([{fd=3, events=POLLIN|POLLPRI, revents=POLLIN}], 1, 1000) = 1
accept(3, {sa_family=AF_FILE, path=@}, [2]) = 7
mmap2(NULL, 10489856, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0xb573c000
mprotect(0xb573c000, 4096, PROT_NONE)   = 0
clone(child_stack=0xb613c4c4,
flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM|CLONE_SETTLS|CLONE_PARENT_SETTID|CLONE_CHILD_CLEARTID|CLONE_DETACHED,
parent_tidptr=0xb613cbe8, {entry_number:6, base_addr:0xb613cba0,
limit:1048575, seg_32bit:1, contents:0, read_exec_only:0,
limit_in_pages:1, seg_not_present:0, useable:1},
child_tidptr=0xb613cbe8) = 10560
poll([{fd=3, events=POLLIN|POLLPRI, revents=POLLIN}], 1, 1000) = 1
brk(0x906f000)                          = 0x906f000
futex(0x5ad820, FUTEX_WAKE, 1)          = 1
accept(3, {sa_family=AF_FILE, path=@}, [2]) = 8
mmap2(NULL, 10489856, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0xb4bff000
mprotect(0xb4bff000, 4096, PROT_NONE)   = 0
clone(child_stack=0xb55ff4c4,
flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM|CLONE_SETTLS|CLONE_PARENT_SETTID|CLONE_CHILD_CLEARTID|CLONE_DETACHED,
parent_tidptr=0xb55ffbe8, {entry_number:6, base_addr:0xb55ffba0,
limit:1048575, seg_32bit:1, contents:0, read_exec_only:0,
limit_in_pages:1, seg_not_present:0, useable:1},
child_tidptr=0xb55ffbe8) = 10561
poll([{fd=3, events=POLLIN|POLLPRI, revents=POLLIN}], 1, 1000) = 1
accept(3, {sa_family=AF_FILE, path=@}, [2]) = 9
mmap2(NULL, 10489856, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS,
-1, 0) = 0xb41fe000
mprotect(0xb41fe000, 4096, PROT_NONE)   = 0
clone(child_stack=0xb4bfe4c4,
flags=CLONE_VM|CLONE_FS|CLONE_FILES|CLONE_SIGHAND|CLONE_THREAD|CLONE_SYSVSEM|CLONE_SETTLS|CLONE_PARENT_SETTID|CLONE_CHILD_CLEARTID|CLONE_DETACHED,
parent_tidptr=0xb4bfebe8, {entry_number:6, base_addr:0xb4bfeba0,
limit:1048575, seg_32bit:1, contents:0, read_exec_only:0,
limit_in_pages:1, seg_not_present:0, useable:1},
child_tidptr=0xb4bfebe8) = 10562
poll([{fd=3, events=POLLIN|POLLPRI}], 1, 1000) = -1 EINTR (Interrupted
system call)
+++ killed by SIGABRT +++
---cut---

Ganglia was running `rrdtool graph - --daemon
unix:/var/run/rrdcached/rrdcached.sock ...` command when it crashed.

Thanks,

Bernard