[Home]

Summary:ASTERISK-20395: CLI Originate to chan_gtalk causes memory corruption crash
Reporter:Private Name (falves11)Labels:
Date Opened:2012-09-08 21:38:25Date Closed:2013-09-23 21:23:48
Priority:MajorRegression?
Status:Closed/CompleteComponents:Channels/chan_gtalk
Versions:1.8.15.1 Frequency of
Occurrence		Frequent
Related
Issues:
Environment:centos 6.3Attachments:( 0) crash-1.txt
( 1) crash-10.txt
( 2) crash-2.txt
( 3) crash-3.txt
( 4) crash-4.txt
( 5) crash-5.txt
( 6) Untitled_5.txt
( 7) valgrind.txt
Description:It crashes every few minutes. I am uploading the trace.
I originate calls from the cli with originate and then if answered it gets dropped on a context with music-on-hold. No more logic to it.

It uses jabber and gtalk
Comments:By: Private Name (falves11) 2012-09-08 21:39:01.826-0500

I will continue uploading more files.
By: Private Name (falves11) 2012-09-08 21:52:28.359-0500

It crashes every 3 to 4 minutes.

By: Private Name (falves11) 2012-09-08 21:54:49.308-0500

Please let me know if I should stop uploading traces
By: Private Name (falves11) 2012-09-08 22:11:11.760-0500

I will stop now until somebody tells me if more information is necessary.
By: Private Name (falves11) 2012-09-08 22:11:52.123-0500

This is my sad situation
ls core.* -hls
9.7M -rw------- 1 root root  31M Sep  6 13:53 core.gvoice-2012-09-06T13:53:48-0400
152M -rw------- 1 root root 310M Sep  8 22:12 core.gvoice-2012-09-08T22:12:40-0400
96M -rw------- 1 root root 272M Sep  8 22:39 core.gvoice-2012-09-08T22:39:35-0400
50M -rw------- 1 root root 235M Sep  8 22:45 core.gvoice-2012-09-08T22:45:57-0400
39M -rw------- 1 root root 207M Sep  8 22:47 core.gvoice-2012-09-08T22:47:31-0400
28M -rw------- 1 root root 163M Sep  8 22:47 core.gvoice-2012-09-08T22:47:50-0400
34M -rw------- 1 root root 198M Sep  8 22:48 core.gvoice-2012-09-08T22:48:50-0400
37M -rw------- 1 root root 204M Sep  8 22:50 core.gvoice-2012-09-08T22:50:03-0400
39M -rw------- 1 root root 205M Sep  8 22:51 core.gvoice-2012-09-08T22:51:24-0400
33M -rw------- 1 root root 195M Sep  8 22:52 core.gvoice-2012-09-08T22:52:18-0400
34M -rw------- 1 root root 200M Sep  8 22:53 core.gvoice-2012-09-08T22:53:21-0400
38M -rw------- 1 root root 205M Sep  8 22:55 core.gvoice-2012-09-08T22:55:20-0400
38M -rw------- 1 root root 197M Sep  8 22:56 core.gvoice-2012-09-08T22:56:41-0400
39M -rw------- 1 root root 208M Sep  8 22:58 core.gvoice-2012-09-08T22:58:28-0400
25M -rw------- 1 root root 143M Sep  8 22:58 core.gvoice-2012-09-08T22:58:37-0400
35M -rw------- 1 root root 195M Sep  8 22:59 core.gvoice-2012-09-08T22:59:49-0400
42M -rw------- 1 root root 206M Sep  8 23:01 core.gvoice-2012-09-08T23:01:45-0400
36M -rw------- 1 root root 199M Sep  8 23:03 core.gvoice-2012-09-08T23:03:20-0400
38M -rw------- 1 root root 202M Sep  8 23:05 core.gvoice-2012-09-08T23:05:00-0400
42M -rw------- 1 root root 212M Sep  8 23:07 core.gvoice-2012-09-08T23:07:30-0400
31M -rw------- 1 root root 177M Sep  8 23:08 core.gvoice-2012-09-08T23:08:04-0400
33M -rw------- 1 root root 191M Sep  8 23:09 core.gvoice-2012-09-08T23:09:01-0400

Please help. Maybe there is a simple patch for this.
By: Private Name (falves11) 2012-09-09 03:28:48.732-0500

I installed Asterisk version 10 and it crashes the same as 1.8.
This trace is for svn version
372710

By: David Woolley (davidw) 2012-09-10 05:22:10.235-0500

These indicate a memory corruption problem, for which you should read the documentation about running under valgrind.

Also check the logs for any reports about locking failure going back a few minutes from the crash (you may need thread debugging compiled in to see these).

Obviously full logs immediately prior to the crash, at at least verbosity 3, will help.

Any information on how to reproduce will also help.
By: Private Name (falves11) 2012-09-10 05:45:35.498-0500

Is there any volunteer that wants to  log into the machine and debug this? I am not a programmer, but a small business owner. I can compensate the person via Pay Pal, if required. Please contact me at venefax@gmail.com.
Once everything is setup, there is a simple script that I run and crashes Asterisk in  a few minutes.
By: Matt Jordan (mjordan) 2012-09-10 07:48:01.211-0500

Your backtrace appears to contain memory corruption and we require valgrind output in order to move this issue forward. Please see https://wiki.asterisk.org/wiki/display/AST/Valgrind for more information about how to produce debugging information. Thanks!


By: Private Name (falves11) 2012-09-12 12:18:38.741-0500

Thanks to volunteer for capturing the debug
By: Private Name (falves11) 2012-09-15 13:28:16.427-0500

We uploaded the trace already. Kindly take a look. My project is paralyzed.
By: Rusty Newton (rnewton) 2012-09-15 17:01:16.158-0500

Private Name - falves11, please attach your gtalk.conf,jabber.conf  (sanitized), plus any other relevant configs and an asterisk full log including VERBOSE and DEBUG messages of level 5 right up to the time of crash.
By: Private Name (falves11) 2012-09-15 18:53:18.862-0500

I asked the volunteer to continue satisfying the requests. But for the record, the dialplan is really simple:
exten =>  s,1,Answer
exten =>  s,n,Set(GROUP()=trunkgroup1)
exten =>  s,n,Verbose(0,${UNIQUEID} ${EXTEN} Calls ${GROUP_COUNT(trunkgroup1)})
exten =>  s,n,MusicOnHold()
exten =>  s,n,Hangup()
I guess you could eliminate every line except one, this would work:"exten =>  s,1,MusicOnHold()"

What I do is this: I have 191 accounts in my jabber.conf, with names [asterisk1], [asterisk2], etc. Then a shell script reads phone numbers from database and goes into a loop from 1 to 191, generating this:

#!/bin/sh
for i in `seq 1 191`;do A=$(mysql -e "call asterisk.getme_line()");
a="channel originate gtalk/asterisk$i/+${A}@voice.google.com extension s@default";
asterisk -rx "$a" &
sleep 1
fi

This process is done in parallel many times, and it crashes in a matter of one to two minutes, all the time.





By: Walter Doekes (wdoekes) 2012-09-28 01:59:15.614-0500

Google says your valgrind is a bit old.
https://bugzilla.redhat.com/show_bug.cgi?id=626470

It might help if you update valgrind and get cleaner output.
By: Private Name (falves11) 2012-09-30 05:18:37.607-0500

I am looking for a volunteer who may login to the box and capture any traces needed, plus upgrade Valgrind and re-take the trace. I have no idea how to do it myself. I can provide compensation via PayPal.
Please contact me via gmail at venefax
By: Private Name (falves11) 2013-01-07 10:30:54.188-0600

Is there any change of this bug get resolved? It has been sitting idle for almost 4 months.  
By: Private Name (falves11) 2013-09-23 21:23:48.968-0500

Closed to giving up