| Summary: | ASTERISK-27214: Recurring crash with memory corruption | ||
| Reporter: | Lei Fu (solo@astercc.org) | Labels: | |
| Date Opened: | 2017-08-23 23:02:33 | Date Closed: | 2020-01-14 11:13:45.000-0600 |
| Priority: | Major | Regression? | |
| Status: | Closed/Complete | Components: | |
| Versions: | 13.13.1 13.16.0 13.17.0 | Frequency of Occurrence | Frequent |
| Related Issues: | |||
| Environment: | [root@as3 tmp]# lsb_release -a LSB Version: :core-4.1-amd64:core-4.1-noarch Distributor ID: CentOS Description: CentOS Linux release 7.3.1611 (Core) Release: 7.3.1611 Codename: Core | Attachments: | ( 0) asterisk-as3-crash-results.tar.gz ( 1) asterisk-as3-results.tar.gz ( 2) asterisk-as4-results.tar.gz ( 3) valgrind.1.txt ( 4) valgrind.txt ( 5) valgrind.txt.1 ( 6) valgrind1.txt |
| Description: | asterisk crash every few minutres
I have two asterisk using pjsip, active and standby, from time to time asterisk crash, and in this morning, when active asterisk crash, system start to use standby asterisk, then asterisk on standby server crash again in 10 minutes It also crashed on 13.16.0, then I switched to a certified version(13.13-cert3) and 13.17.0 at noon but same. Two asterisk crashed about 5-6 times today, I attached results file for both servers. Today, server crashed more times, during a period of time, asterisk never run more than 10 minutes | ||
| Comments: | By: Asterisk Team (asteriskteam) 2017-08-23 23:02:34.355-0500 Thanks for creating a report! The issue has entered the triage process. That means the issue will wait in this status until a Bug Marshal has an opportunity to review the issue. Once the issue has been reviewed you will receive comments regarding the next steps towards resolution. A good first step is for you to review the [Asterisk Issue Guidelines|https://wiki.asterisk.org/wiki/display/AST/Asterisk+Issue+Guidelines] if you haven't already. The guidelines detail what is expected from an Asterisk issue report. Then, if you are submitting a patch, please review the [Patch Contribution Process|https://wiki.asterisk.org/wiki/display/AST/Patch+Contribution+Process]. By: Rusty Newton (rnewton) 2017-08-25 15:02:25.641-0500 Your crashes appear to show memory corruption. Did you build Asterisk with bundled pjsip? If not, can you please rebuild with bundled pjsip and let me know what configuration options you are using? If the issue continues, at that point, please run Asterisk under Valgrind if possible and provide us the resulting output. https://wiki.asterisk.org/wiki/display/AST/Valgrind By: Lei Fu (solo@astercc.org) 2017-08-27 08:08:49.599-0500 Hi I'm using ./configure --with-pjproject-bundled , also I tried chan_sip, but it also crashed, the server are hosted by Aliyun, when there's crash, all 3 servers I am using crashed randomly, when there's no crash, all three servers work. Since I don't have a crash last Saturday, I only have valgrind file on one of them, please see if it helps. I will upload if crash happen again. It was working for 3 month and no issue until last week, do you think it's related to cloud hosting server? I opened a ticket but they replied there's nothing special, I was using asterisk 1.8 for a long time and this never happened on their cloud. By: Richard Mudgett (rmudgett) 2017-08-27 18:01:05.171-0500 The last part of the valgrind file appears to be corrupted when you get down to thread 78. By: Lei Fu (solo@astercc.org) 2017-08-27 21:04:04.641-0500 Do you want me to add/enable new log ? I attached a new log file(until this morning) please check. By: Lei Fu (solo@astercc.org) 2017-08-28 10:11:19.142-0500 When I run asterisk with valgrind, it's very slow, I could only have about 30 channels when other boxes get 150+, I am worried that I could not get this issue reproduced with valgrind, any suggestion? By: Richard Mudgett (rmudgett) 2017-08-28 10:23:20.406-0500 Reattaching [^valgrind.txt.1] as [^valgrind1.txt] so you can view it without downloading it. Stupid JIRA. By: Lei Fu (solo@astercc.org) 2017-08-31 03:38:03.769-0500 Hi Since with valgrind asterisk will only take about 10 calls, I have to switch it back to normal state, it was working fine yesterday but this afternoon, it start to reboot, 10+ times in 3 hours, I attached dump log, and use valgrind again, see if it crash again and I could collect enough information. I have asterisk 14.6.0 running for 5 days without reboot By: Rusty Newton (rnewton) 2017-09-05 15:34:27.813-0500 We require additional debug to continue with triage of your issue. Please follow the instructions on the wiki [1] for how to collect debugging information from Asterisk. For expediency, where possible, attach the debug with a '.txt' file extension so that the debug will be usable for further analysis. Thanks! [1] https://wiki.asterisk.org/wiki/display/AST/Collecting+Debug+Information By: Asterisk Team (asteriskteam) 2017-09-20 12:00:02.171-0500 Suspended due to lack of activity. This issue will be automatically re-opened if the reporter posts a comment. If you are not the reporter and would like this re-opened please create a new issue instead. If the new issue is related to this one a link will be created during the triage process. Further information on issue tracker usage can be found in the Asterisk Issue Guidlines [1]. [1] https://wiki.asterisk.org/wiki/display/AST/Asterisk+Issue+Guidelines | ||