| Summary: | ASTERISK-29523: cdr.c: FRACK!, Failed assertion user_data is NULL (0) | ||||
| Reporter: | BJ Weschke (bweschke) | Labels: | |||
| Date Opened: | 2021-07-16 09:23:28 | Date Closed: | 2021-08-11 12:00:06 | ||
| Priority: | Minor | Regression? | |||
| Status: | Closed/Complete | Components: | Applications/app_stasis CDR/General | ||
| Versions: | 18.4.0 | Frequency of Occurrence | One Time | ||
| Related Issues: |
| ||||
| Environment: | Attachments: | ||||
| Description: | In our daily pre-production regression, the following FRACK messages showed up in the log that seem to be related to a Snoop channel leaving a bridge.
Running core dump taken and will send under separate cover. {noformat} [Jul 16 09:56:33] ERROR[26751] cdr.c: FRACK!, Failed assertion user_data is NULL (0) [Jul 16 09:56:33] DEBUG[3945][C-00000011] res_rtp_asterisk.c: (0x7f28a0187df0) RTCP got report of 100 bytes from 192.168.1.218:17095 [Jul 16 09:56:33] DEBUG[2528] res_rtp_asterisk.c: (0x7f287c03faf0) RTCP got report of 56 bytes from 192.168.10.69:59300 [Jul 16 09:56:33] ERROR[26751] : Got 11 backtrace records # 0: [0x56423e1d5ef3] asterisk utils.c:2454 __ast_assert_failed() # 1: [0x56423e05d6b6] asterisk astobj2.c:298 __ao2_unlock() # 2: [0x56423e1effd6] asterisk cdr.c:2336 handle_channel_snapshot_update_message() # 3: [0x56423e1a99b6] asterisk stasis_message_router.c:202 router_dispatch() # 4: [0x56423e195f57] asterisk stasis.c:1266 dispatch_exec_async() # 5: [0x56423e1bf6f6] asterisk taskprocessor.c:370 tps_task_free() # 6: [inlined] asterisk taskprocessor.c:1239 ast_taskprocessor_execute() # 7: [inlined] asterisk taskprocessor.c:209 default_tps_processing_function() # 8: [0x56423e1d136f] asterisk utils.c:1301 dummy_start() # 9: [0x7f29512db6db] libpthread.so.0 pthread_create.c:463 start_thread() #10: [0x7f29504cca3f] libc.so.6 clone.S:97 clone() [Jul 16 09:56:33] ERROR[26751] cdr.c: FRACK!, Failed assertion user_data is NULL (0) [Jul 16 09:56:33] ERROR[26751] : Got 12 backtrace records # 0: [0x56423e1d5ef3] asterisk utils.c:2454 __ast_assert_failed() # 1: [0x56423e05dc57] asterisk astobj2.c:516 __ao2_ref() # 2: [0x56423e1e99fb] asterisk cdr.c:981 cdr_all_unlink() # 3: [0x56423e1effde] asterisk cdr.c:2337 handle_channel_snapshot_update_message() # 4: [0x56423e1a99b6] asterisk stasis_message_router.c:202 router_dispatch() # 5: [0x56423e195f57] asterisk stasis.c:1266 dispatch_exec_async() # 6: [0x56423e1bf6f6] asterisk taskprocessor.c:370 tps_task_free() # 7: [inlined] asterisk taskprocessor.c:1239 ast_taskprocessor_execute() # 8: [inlined] asterisk taskprocessor.c:209 default_tps_processing_function() # 9: [0x56423e1d136f] asterisk utils.c:1301 dummy_start() #10: [0x7f29512db6db] libpthread.so.0 pthread_create.c:463 start_thread() #11: [0x7f29504cca3f] libc.so.6 clone.S:97 clone() [Jul 16 09:56:33] ERROR[26751] cdr.c: FRACK!, Failed assertion user_data is NULL (0) [Jul 16 09:56:33] DEBUG[3918] res_pjsip/pjsip_distributor.c: No dialog serializer for Response msg 200/MESSAGE/cseq=41591 (rdata0x7f28a00c43b8). Using request transaction as basis. [Jul 16 09:56:33] DEBUG[3918] res_pjsip/pjsip_distributor.c: Found transaction tsx0x7f29381a0968 for Response msg 200/MESSAGE/cseq=41591 (rdata0x7f28a00c43b8). [Jul 16 09:56:33] DEBUG[3918] res_pjsip/pjsip_distributor.c: Found serializer pjsip/messaging on transaction tsx0x7f29381a0968 [Jul 16 09:56:33] DEBUG[3918] res_pjsip.c: 0x7f28a00c0690: PJSIP tsx response received [Jul 16 09:56:33] DEBUG[3918] res_pjsip.c: 0x7f28a00c0690: Callbacks executed [Jul 16 09:56:33] DEBUG[3918] res_pjsip.c: 0x7f28a00c0690: wrapper destroyed [Jul 16 09:56:33] ERROR[26751] : Got 11 backtrace records # 0: [0x56423e1d5ef3] asterisk utils.c:2454 __ast_assert_failed() # 1: [0x56423e05dc57] asterisk astobj2.c:516 __ao2_ref() # 2: [0x56423e1effde] asterisk cdr.c:2337 handle_channel_snapshot_update_message() # 3: [0x56423e1a99b6] asterisk stasis_message_router.c:202 router_dispatch() # 4: [0x56423e195f57] asterisk stasis.c:1266 dispatch_exec_async() # 5: [0x56423e1bf6f6] asterisk taskprocessor.c:370 tps_task_free() # 6: [inlined] asterisk taskprocessor.c:1239 ast_taskprocessor_execute() # 7: [inlined] asterisk taskprocessor.c:209 default_tps_processing_function() # 8: [0x56423e1d136f] asterisk utils.c:1301 dummy_start() # 9: [0x7f29512db6db] libpthread.so.0 pthread_create.c:463 start_thread() #10: [0x7f29504cca3f] libc.so.6 clone.S:97 clone() [Jul 16 09:56:33] ERROR[26751] cdr.c: FRACK!, Failed assertion user_data is NULL (0) [Jul 16 09:56:33] ERROR[26751] : Got 12 backtrace records # 0: [0x56423e1d5ef3] asterisk utils.c:2454 __ast_assert_failed() # 1: [0x56423e05d2e4] asterisk astobj2.c:212 log_bad_ao2() # 2: [0x56423e060eba] asterisk astobj2_container.c:178 __ao2_unlink() # 3: [0x56423e1f0004] asterisk cdr.c:2341 handle_channel_snapshot_update_message() # 4: [0x56423e1a99b6] asterisk stasis_message_router.c:202 router_dispatch() # 5: [0x56423e195f57] asterisk stasis.c:1266 dispatch_exec_async() # 6: [0x56423e1bf6f6] asterisk taskprocessor.c:370 tps_task_free() # 7: [inlined] asterisk taskprocessor.c:1239 ast_taskprocessor_execute() # 8: [inlined] asterisk taskprocessor.c:209 default_tps_processing_function() # 9: [0x56423e1d136f] asterisk utils.c:1301 dummy_start() #10: [0x7f29512db6db] libpthread.so.0 pthread_create.c:463 start_thread() #11: [0x7f29504cca3f] libc.so.6 clone.S:97 clone() [Jul 16 09:56:33] DEBUG[26751] cdr.c: Finalized CDR for Snoop/SKTAOTP.jdote-00000006 - start 1626443793.404317 answer 1626443793.404317 end 1626443793.424157 dur 0.019 bill 0.019 dispo ANSWERED [Jul 16 09:56:33] DEBUG[2528] res_rtp_asterisk.c: (0x7f287c03faf0) RTCP got report of 8 bytes from 192.168.10.69:59300 {noformat} | ||||
| Comments: | By: Asterisk Team (asteriskteam) 2021-07-16 09:23:32.856-0500 Thanks for creating a report! The issue has entered the triage process. That means the issue will wait in this status until a Bug Marshal has an opportunity to review the issue. Once the issue has been reviewed you will receive comments regarding the next steps towards resolution. Please note that log messages and other files should not be sent to the Sangoma Asterisk Team unless explicitly asked for. All files should be placed on this issue in a sanitized fashion as needed. A good first step is for you to review the [Asterisk Issue Guidelines|https://wiki.asterisk.org/wiki/display/AST/Asterisk+Issue+Guidelines] if you haven't already. The guidelines detail what is expected from an Asterisk issue report. Then, if you are submitting a patch, please review the [Patch Contribution Process|https://wiki.asterisk.org/wiki/display/AST/Patch+Contribution+Process]. Please note that once your issue enters an open state it has been accepted. As Asterisk is an open source project there is no guarantee or timeframe on when your issue will be looked into. If you need expedient resolution you will need to find and pay a suitable developer. Asking for an update on your issue will not yield any progress on it and will not result in a response. All updates are posted to the issue when they occur. Please note that by submitting data, code, or documentation to Sangoma through JIRA, you accept the Terms of Use present at [https://www.asterisk.org/terms-of-use/|https://www.asterisk.org/terms-of-use/]. By: BJ Weschke (bweschke) 2021-07-16 09:32:48.695-0500 Coredump tarball and logs shared via DropBox By: George Joseph (gjoseph) 2021-07-16 09:43:58.661-0500 [~bweschke] I've got the files if you want to delete them from DropBox. By: George Joseph (gjoseph) 2021-07-16 09:51:49.101-0500 Unfortunately, by the time the coredump was taken, the events are long gone. Can you reproduce this? If so, can you recompile asterisk with DO_CRASH so that it crashes when it hits those FRACKs? This will give us a better look at what's going on when the event actually happens. By: Kevin Harwell (kharwell) 2021-07-28 10:32:09.565-0500 ASTERISK-28692 crashed in nearly the same place (similar backtraces) so linking issue. By: Asterisk Team (asteriskteam) 2021-08-11 12:00:05.504-0500 Suspended due to lack of activity. This issue will be automatically re-opened if the reporter posts a comment. If you are not the reporter and would like this re-opened please create a new issue instead. If the new issue is related to this one a link will be created during the triage process. Further information on issue tracker usage can be found in the Asterisk Issue Guidlines [1]. [1] https://wiki.asterisk.org/wiki/display/AST/Asterisk+Issue+Guidelines | ||||