[Home]

Summary:ASTERISK-28976: Crashes releted to pjsip
Reporter:YAMADA SHUMPEI (yamada@revcomm.co.jp)Labels:
Date Opened:2020-07-03 05:30:21Date Closed:2020-07-03 05:30:22
Priority:MajorRegression?No
Status:Closed/CompleteComponents:pjproject/pjsip
Versions:16.11.0 Frequency of
Occurrence
Related
Issues:
Environment:Ubuntu 16.04.5 LTS (Xenial Xerus)Attachments:
Description:We are running Asterisk 16.11.0 + Pjproject 2.10 in Ubuntu 16.04.5 LTS (Xenial Xerus) and got Segmentation fault error three times below at same day.
We have invested this problem, but we couldn't even reproduce this problem.
Does anyone have any idea?
1st
{noformat}
!@!@!@! thread1.txt !@!@!@!

$1 = {si_signo = 11, si_errno = 0, si_code = 128, _sifields = {_pad = {0 <repeats 28 times>}, _kill = {si_pid = 0, si_uid = 0}, _timer = {si_tid = 0, si_overrun = 0, si_sigval = {sival_int = 0, sival_ptr = 0x0}}, _rt = {si_pid = 0, si_uid = 0, si_sigval = {sival_int = 0, sival_ptr = 0x0}}, _sigchld = {si_pid = 0, si_uid = 0, si_status = 0, si_utime = 0, si_stime = 0}, _sigfault = {si_addr = 0x0, _addr_lsb = 0, _addr_bnd = {_lower = 0x0, _upper = 0x0}}, _sigpoll = {si_band = 0, si_fd = 0}}}
Signal        Stop Print Pass to program Description
SIGSEGV       Yes Yes Yes Segmentation fault

Thread 1 (Thread 0x7efc926bc700 (LWP 24867)):
#0  0x00000000004ee144 in ast_format_get_codec_id (format=format@entry=0x7efd701b9fc8) at format.c:331
No locals.
#1  0x00000000004f0b36 in format_cap_framed_init (framing=0, format=0x7efd701b9fc8, cap=0x7efd70440b48, framed=0x7efd70589c28) at format_cap.c:155
       list = <optimized out>
#2  __ast_format_cap_append (cap=cap@entry=0x7efd70440b48, format=format@entry=0x7efd701b9fc8, framing=framing@entry=0, tag=tag@entry=0x643c9a "ast_format_cap_append", file=file@entry=0x65b9c6 "format_cap.c", line=line@entry=279, func=0x65bc10 <__PRETTY_FUNCTION__.10929> "ast_format_cap_append_from_cap") at format_cap.c:213
       framed = 0x7efd70589c28
#3  0x00000000004f1a32 in __ast_format_cap_append (tag=0x643c9a "ast_format_cap_append", file=0x65b9c6 "format_cap.c", func=<synthetic pointer>, line=279, framing=<optimized out>, format=0x7efd701b9fc8, cap=0x7efd70440b48) at format_cap.c:184
No locals.
#4  ast_format_cap_append_from_cap (dst=dst@entry=0x7efd70440b48, src=0x7efd70348ee8, type=type@entry=AST_MEDIA_TYPE_AUDIO) at format_cap.c:279
       framed = <optimized out>
       idx = 0
       res = 0
       __PRETTY_FUNCTION__ = "ast_format_cap_append_from_cap"
#5  0x00007efd363cfd0e in create_outgoing_sdp_stream (session=0x7efd700ef4e0, session_media=0x7efd70419198, sdp=0x7efd701b9938, remote=<optimized out>, stream=0x7efd704324b0) at res_pjsip_sdp_rtp.c:1755
       pool = 0x7efd703361c0
       hostip = <optimized out>
       addr = {ss = {ss_family = 10, __ss_padding = "Cl", '000' <repeats 24 times>, "375~000000001000000000000000000000311K4261375~000000000270k222000000000000060000000000060000000000260270k222374~000000260267k222374~000000001H224m003201377377377267k222374~000000001000000000000000000000@9X003000000000000251zd000000000000", __ss_align = 1}, len = 28}
       tmp = "7042004000000000000034322001000000000000255267c000000000000000&242207071375~000000@9X003000000000000230221Ap375~000000X000000p375~000000p271k222374~000000p000000p375~000000221F224m003201377377o271k222374~000000P271k222374~000000340272k222374~000000000224035214256\255374210071X003000000000000@9X003000000000000255267c000000000000000377377377377", '000' <repeats 12 times>, "p273k222374~000000003000000000004000000000 000000p375~000000020006000000000000000000030000000000000000000000300a3p375~000000"...
       stmp = {ptr = 0x3535313239324b62 <error: Cannot access memory at address 0x3535313239324b62>, slen = 3273110194183867699}
       attr = <optimized out>
       index = <optimized out>
       noncodec = 1
       min_packet_size = 0
       max_packet_size = 0
       rtp_code = <optimized out>
       caps = 0x7efd70440b48
       media_type = AST_MEDIA_TYPE_AUDIO
       session_media_transport = 0x7efd70419198
       ip = {addr = {sa_family = 2}, ipv4 = {sin_family = 2, sin_port = 0, sin_addr = {s_addr = 2936087212}, sin_zero = "000000000000000000000"}, ipv6 = {sin6_family = 2, sin6_port = 0, sin6_flowinfo = 2936087212, sin6_addr = {s6_addr = "000000000000000000000000"mesh010", u6_addr32 = {0, 0, 1936026914, 808530024}}, sin6_scope_id = 30546944}}
       direct_media_enabled = <optimized out>
       __PRETTY_FUNCTION__ = "create_outgoing_sdp_stream"
#6  0x00007efd398722a4 in add_sdp_streams (stream=0x7efd704324b0, remote=0x7efd7000a1b8, answer=0x7efd701b9938, session=0x7efd700ef4e0, session_media=0x7efd70419198) at res_pjsip_session.c:4095
       handler = <optimized out>
       handler_list = 0x0
       res = <optimized out>
#7  create_local_sdp (session=session@entry=0x7efd700ef4e0, offer=0x7efd7000a1b8, inv=<optimized out>, inv=<optimized out>) at res_pjsip_session.c:4266
       session_media = 0x7efd70419198
       stream = 0x7efd704324b0
       streams = 0
       i = 0
       stream = <optimized out>
#8  0x00007efd39878113 in new_invite (invite=<synthetic pointer>) at res_pjsip_session.c:3279
       timer = {min_se = 90, sess_expires = 1800}
       sdp_info = 0x7efd7000a198
       local = 0x0
       buffer = "240261361:375~000000D275k222374~000000340244006p375~000000373344):375~000000300243361:375~000000S020315:375~000000240261361:375~"
       tdata = 0x7efd700c50c8
#9  handle_new_invite_request (rdata=0x7efd70062488) at res_pjsip_session.c:3365
       endpoint = 0x7efd881ee4e8
       tdata = 0x0
       inv_session = <optimized out>
       session = 0x7efd700ef4e0
       invite = {session = 0x7efd700ef4e0, rdata = 0x7efd70062488}
#10 session_on_rx_request (rdata=0x7efd70062488) at res_pjsip_session.c:3429
       handled = 1
       dlg = <optimized out>
       inv_session = <optimized out>
#11 0x00007efdb3be0ad7 in pjsip_endpt_process_rx_data (endpt=<optimized out>, rdata=rdata@entry=0x7efd70062488, p=p@entry=0x7efd3af1b1a0 <param>, p_handled=p_handled@entry=0x7efc926bbd44) at ../src/pjsip/sip_endpoint.c:930
       msg = 0x7efd7006a4e0
       def_prm = {start_prio = 2080946688, start_mod = 0x45cc94 <__ao2_lock+244>, idx_after_start = 134224312, silent = 32509}
       i = <optimized out>
       status = <optimized out>
       mod = 0x7efd39a7e960 <session_module>
       handled = 0
       p_handled = 0x7efc926bbd44
       p = 0x7efd3af1b1a0 <param>
       rdata = 0x7efd70062488
       endpt = <optimized out>
#12 0x00007efd3aceca7f in distribute (data=0x7efd70062488) at res_pjsip/pjsip_distributor.c:955
       param = {start_prio = 0, start_mod = 0x7efd3af1b2e0 <distributor_mod>, idx_after_start = 1, silent = 0}
       handled = 0
       rdata = 0x7efd70062488
       is_request = <optimized out>
       endpoint = <optimized out>
       __PRETTY_FUNCTION__ = "distribute"
#13 0x000000000059b98e in ast_taskprocessor_execute (tps=tps@entry=0x354a880) at taskprocessor.c:1237
       local = {local_data = 0x7efd7c0ffd30, data = 0xfcad5cae8c1d9400}
       t = 0x7efd706d7610
       __PRETTY_FUNCTION__ = "ast_taskprocessor_execute"
#14 0x00000000005a3080 in execute_tasks (data=0x354a880) at threadpool.c:1354
       tps = 0x354a880
#15 0x000000000059b98e in ast_taskprocessor_execute (tps=0x222d410) at taskprocessor.c:1237
       local = {local_data = 0x7ffe78971d50, data = 0xfcad5cae8c1d9400}
       t = 0x7efd701cc7d0
       __PRETTY_FUNCTION__ = "ast_taskprocessor_execute"
#16 0x00000000005a3820 in threadpool_execute (pool=0x222d5c0) at threadpool.c:367
No locals.
#17 worker_active (worker=0x7efd080019b0) at threadpool.c:1137
No locals.
#18 worker_start (arg=arg@entry=0x7efd080019b0) at threadpool.c:1056
       worker = 0x7efd080019b0
       saved_state = <optimized out>
       __PRETTY_FUNCTION__ = "worker_start"
#19 0x00000000005ab6bc in dummy_start (data=<optimized out>) at utils.c:1249
       __cancel_buf = {__cancel_jmp_buf = {{__cancel_jmp_buf = {139625226050688, -5889329925537048689, 0, 139625951886303, 507904, 139627239381456, 6034191787286419343, -5889330522222667889}, __mask_was_saved = 0}}, __pad = {0x7efc926bbef0, 0x0, 0x7efdb13a3142 <__libc_thread_freeres+34>, 0x7efc926bc700}}
       __cancel_arg = 0x7efc926bc700
       __not_first_call = <optimized out>
       ret = <optimized out>
       a = {start_routine = 0x5a3460 <worker_start>, data = 0x7efd080019b0, name = 0x7efd08001c80 "worker_start         started at [ 1111] threadpool.c worker_thread_start()"}
       __PRETTY_FUNCTION__ = "dummy_start"
#20 0x00007efdb1d5b6ba in start_thread (arg=0x7efc926bc700) at pthread_create.c:333
       __res = <optimized out>
       pd = 0x7efc926bc700
       now = <optimized out>
       unwind_buf = {cancel_jmp_buf = {{jmp_buf = {139623253395200, -5889329925537048689, 0, 139625951886303, 507904, 139627239381456, 6034191787265447823, 6034689402464327567}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
       not_first_call = <optimized out>
       pagesize_m1 = <optimized out>
       sp = <optimized out>
       freesize = <optimized out>
       __PRETTY_FUNCTION__ = "start_thread"
#21 0x00007efdb133541d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
No locals.
{noformat}


{noformat}
(gdb) bt
#0  0x00000000004ee144 in ast_format_get_codec_id (format=format@entry=0x7efd701b9fc8) at format.c:331
#1  0x00000000004f0b36 in format_cap_framed_init (framing=0, format=0x7efd701b9fc8, cap=0x7efd70440b48, framed=0x7efd70589c28) at format_cap.c:155
#2  __ast_format_cap_append (cap=cap@entry=0x7efd70440b48, format=format@entry=0x7efd701b9fc8, framing=framing@entry=0, tag=tag@entry=0x643c9a "ast_format_cap_append", file=file@entry=0x65b9c6 "format_cap.c", line=line@entry=279,
   func=0x65bc10 <__PRETTY_FUNCTION__.10929> "ast_format_cap_append_from_cap") at format_cap.c:213
#3  0x00000000004f1a32 in __ast_format_cap_append (tag=0x643c9a "ast_format_cap_append", file=0x65b9c6 "format_cap.c", func=<synthetic pointer>, line=279, framing=<optimized out>, format=0x7efd701b9fc8, cap=0x7efd70440b48) at format_cap.c:184
#4  ast_format_cap_append_from_cap (dst=dst@entry=0x7efd70440b48, src=0x7efd70348ee8, type=type@entry=AST_MEDIA_TYPE_AUDIO) at format_cap.c:279
#5  0x00007efd363cfd0e in create_outgoing_sdp_stream (session=0x7efd700ef4e0, session_media=0x7efd70419198, sdp=0x7efd701b9938, remote=<optimized out>, stream=0x7efd704324b0) at res_pjsip_sdp_rtp.c:1755
#6  0x00007efd398722a4 in add_sdp_streams (stream=0x7efd704324b0, remote=0x7efd7000a1b8, answer=0x7efd701b9938, session=0x7efd700ef4e0, session_media=0x7efd70419198) at res_pjsip_session.c:4095
#7  create_local_sdp (session=session@entry=0x7efd700ef4e0, offer=0x7efd7000a1b8, inv=<optimized out>, inv=<optimized out>) at res_pjsip_session.c:4266
#8  0x00007efd39878113 in new_invite (invite=<synthetic pointer>) at res_pjsip_session.c:3279
#9  handle_new_invite_request (rdata=0x7efd70062488) at res_pjsip_session.c:3365
#10 session_on_rx_request (rdata=0x7efd70062488) at res_pjsip_session.c:3429
#11 0x00007efdb3be0ad7 in pjsip_endpt_process_rx_data (endpt=<optimized out>, rdata=rdata@entry=0x7efd70062488, p=p@entry=0x7efd3af1b1a0 <param>, p_handled=p_handled@entry=0x7efc926bbd44) at ../src/pjsip/sip_endpoint.c:930
#12 0x00007efd3aceca7f in distribute (data=0x7efd70062488) at res_pjsip/pjsip_distributor.c:955
#13 0x000000000059b98e in ast_taskprocessor_execute (tps=tps@entry=0x354a880) at taskprocessor.c:1237
#14 0x00000000005a3080 in execute_tasks (data=0x354a880) at threadpool.c:1354
#15 0x000000000059b98e in ast_taskprocessor_execute (tps=0x222d410) at taskprocessor.c:1237
#16 0x00000000005a3820 in threadpool_execute (pool=0x222d5c0) at threadpool.c:367
#17 worker_active (worker=0x7efd080019b0) at threadpool.c:1137
#18 worker_start (arg=arg@entry=0x7efd080019b0) at threadpool.c:1056
#19 0x00000000005ab6bc in dummy_start (data=<optimized out>) at utils.c:1249
#20 0x00007efdb1d5b6ba in start_thread (arg=0x7efc926bc700) at pthread_create.c:333
#21 0x00007efdb133541d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
(gdb) frame
#0  0x00000000004ee144 in ast_format_get_codec_id (format=format@entry=0x7efd701b9fc8) at format.c:331
331             return format->codec->id;
(gdb) info frame
Stack level 0, frame at 0x7efc926bb620:
rip = 0x4ee144 in ast_format_get_codec_id (format.c:331); saved rip = 0x4f0b36
called by frame at 0x7efc926bb670
source language c.
Arglist at 0x7efc926bb610, args: format=format@entry=0x7efd701b9fc8
Locals at 0x7efc926bb610, Previous frame's sp is 0x7efc926bb620
Saved registers:
 rip at 0x7efc926bb618
{noformat}







2nd
{noformat}
!@!@!@! thread1.txt !@!@!@!

$1 = {si_signo = 11, si_errno = 0, si_code = 1, _sifields = {_pad = {41846620, 0 <repeats 27 times>}, _kill = {si_pid = 41846620, si_uid = 0}, _timer = {si_tid = 41846620, si_overrun = 0, si_sigval = {sival_int = 0, sival_ptr = 0x0}}, _rt = {si_pid = 41846620, si_uid = 0, si_sigval = {sival_int = 0, sival_ptr = 0x0}}, _sigchld = {si_pid = 41846620, si_uid = 0, si_status = 0, si_utime = 0, si_stime = 0}, _sigfault = {si_addr = 0x27e875c, _addr_lsb = 0, _addr_bnd = {_lower = 0x0, _upper = 0x0}}, _sigpoll = {si_band = 41846620, si_fd = 0}}}
Signal        Stop Print Pass to program Description
SIGSEGV       Yes Yes Yes Segmentation fault

Thread 1 (Thread 0x7faa8a073700 (LWP 6600)):
#0  0x000000000045d738 in __ao2_ref (user_data=0x27e8760, delta=delta@entry=-1, tag=tag@entry=0x63f846 "container_destruct called", file=file@entry=0x63f7a6 "astobj2_container.c", line=line@entry=642, func=func@entry=0x63fb00 <__PRETTY_FUNCTION__.10952> "container_destruct") at astobj2.c:658
       obj = 0x27e8748
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = 0x63f40b "unused"
       __PRETTY_FUNCTION__ = "__ao2_ref"
#1  0x0000000000460034 in __container_unlink_node_debug (func=0x63fb00 <__PRETTY_FUNCTION__.10952> "container_destruct", line=642, file=0x63f7a6 "astobj2_container.c", tag=0x63f846 "container_destruct called", flags=13, node=0x2600e98) at astobj2_container.c:50
       container = 0x2349a50
#2  internal_ao2_traverse (self=self@entry=0x2349a50, flags=flags@entry=7, cb_fn=cb_fn@entry=0x0, arg=arg@entry=0x0, tag=tag@entry=0x63f846 "container_destruct called", file=file@entry=0x63f7a6 "astobj2_container.c", line=642, func=0x63fb00 <__PRETTY_FUNCTION__.10952> "container_destruct", type=AO2_CALLBACK_DEFAULT, data=0x0) at astobj2_container.c:375
       ulflag = 13
       match = 1
       ret = 0x0
       cb_default = 0x45ede0 <cb_true>
       node = 0x2600e98
       traversal_state = 0x7faa8a072800
       orig_lock = AO2_LOCK_REQ_MUTEX
       multi_container = 0x0
       multi_iterator = 0x0
#3  0x0000000000460c3c in __ao2_callback (func=<synthetic pointer>, line=642, file=0x63f7a6 "astobj2_container.c", tag=0x63f846 "container_destruct called", arg=0x0, cb_fn=0x0, flags=7, c=0x2349a50) at astobj2_container.c:414
No locals.
#4  container_destruct (_c=0x2349a50) at astobj2_container.c:641
       c = 0x2349a50
       __PRETTY_FUNCTION__ = "container_destruct"
#5  0x000000000045d6b7 in __ao2_ref (user_data=0x2349a50, delta=delta@entry=-1, tag=tag@entry=0x7faac322118d "", file=file@entry=0x7faac3220c90 "res_rtp_asterisk.c", line=line@entry=3899, func=func@entry=0x7faac3224e70 <__PRETTY_FUNCTION__.36736> "rtp_deallocate_transport") at astobj2.c:614
       obj = 0x2349a38
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = <optimized out>
       __PRETTY_FUNCTION__ = "__ao2_ref"
#6  0x00007faac32121d1 in rtp_deallocate_transport (instance=instance@entry=0x2778220, rtp=rtp@entry=0x26a9560) at res_rtp_asterisk.c:3899
       saved_rtp_s = <optimized out>
       ts = {tv_sec = 1592358754, tv_nsec = 42895000}
       __PRETTY_FUNCTION__ = "rtp_deallocate_transport"
#7  0x00007faac321256c in ast_rtp_destroy (instance=0x2778220) at res_rtp_asterisk.c:3998
       rtp = 0x26a9560
       __PRETTY_FUNCTION__ = "ast_rtp_destroy"
#8  0x0000000000545711 in instance_destructor (obj=0x2778220) at rtp_engine.c:434
       instance = 0x2778220
       __PRETTY_FUNCTION__ = "instance_destructor"
#9  0x000000000045d6b7 in __ao2_ref (user_data=0x2778220, delta=delta@entry=-1, tag=tag@entry=0x63b7ad "", file=file@entry=0x66a0a5 "rtp_engine.c", line=line@entry=460, func=func@entry=0x66c4d0 <__PRETTY_FUNCTION__.19015> "ast_rtp_instance_destroy") at astobj2.c:614
       obj = 0x2778208
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = <optimized out>
       __PRETTY_FUNCTION__ = "__ao2_ref"
#10 0x000000000045da7b in __ao2_cleanup_debug (obj=<optimized out>, tag=tag@entry=0x63b7ad "", file=file@entry=0x66a0a5 "rtp_engine.c", line=line@entry=460, function=function@entry=0x66c4d0 <__PRETTY_FUNCTION__.19015> "ast_rtp_instance_destroy") at astobj2.c:670
No locals.
#11 0x000000000054384e in ast_rtp_instance_destroy (instance=<optimized out>) at rtp_engine.c:460
       __PRETTY_FUNCTION__ = "ast_rtp_instance_destroy"
#12 0x00007faac34576bf in dialog_clean_rtp (p=0x2432f20) at chan_sip.c:5977
No locals.
#13 sip_pvt_dtor (vdoomed=0x2432f20) at chan_sip.c:6735
       p = 0x2432f20
       req = <optimized out>
       __PRETTY_FUNCTION__ = "sip_pvt_dtor"
#14 0x000000000045d6b7 in __ao2_ref (user_data=user_data@entry=0x2432f20, delta=delta@entry=-1, tag=tag@entry=0x7faac34df498 "Stop scheduled items for unlink action", file=file@entry=0x7faac34d6d20 "chan_sip.c", line=line@entry=3355, func=func@entry=0x7faac34f0260 <__PRETTY_FUNCTION__.25005> "__dialog_unlink_sched_items") at astobj2.c:614
       obj = 0x2432f08
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = <optimized out>
       __PRETTY_FUNCTION__ = "__ao2_ref"
#15 0x000000000045da7b in __ao2_cleanup_debug (obj=obj@entry=0x2432f20, tag=tag@entry=0x7faac34df498 "Stop scheduled items for unlink action", file=file@entry=0x7faac34d6d20 "chan_sip.c", line=line@entry=3355, function=function@entry=0x7faac34f0260 <__PRETTY_FUNCTION__.25005> "__dialog_unlink_sched_items") at astobj2.c:670
No locals.
#16 0x00007faac344253b in __dialog_unlink_sched_items (data=0x2432f20) at chan_sip.c:3355
       dialog = 0x2432f20
       __PRETTY_FUNCTION__ = "__dialog_unlink_sched_items"
#17 0x000000000056d218 in ast_sched_runq (con=0x21e7860) at sched.c:791
       current = 0x2609ad0
       numevents = 1
       res = <optimized out>
       __PRETTY_FUNCTION__ = "ast_sched_runq"
#18 0x00007faac34ac0ae in do_monitor (data=data@entry=0x0) at chan_sip.c:30080
       res = <optimized out>
       t = 1592358751
       reloading = <optimized out>
       __PRETTY_FUNCTION__ = "do_monitor"
#19 0x00000000005ab6bc in dummy_start (data=<optimized out>) at utils.c:1249
       __cancel_buf = {__cancel_jmp_buf = {{__cancel_jmp_buf = {35613568, -7060795166432413163, 0, 140722118284815, 140370436897216, 507904, 7013811314954877461, -7060794834994054635}, __mask_was_saved = 0}}, __pad = {0x7faa8a072ef0, 0x0, 0x0, 0x0}}
       __cancel_arg = 0x7faa8a073700
       __not_first_call = <optimized out>
       ret = <optimized out>
       a = {start_routine = 0x7faac34abbb0 <do_monitor>, data = 0x0, name = 0x21f6b80 "do_monitor", ' ' <repeats 11 times>, "started at [30108] chan_sip.c restart_monitor()"}
       __PRETTY_FUNCTION__ = "dummy_start"
#20 0x00007fab380726ba in start_thread (arg=0x7faa8a073700) at pthread_create.c:333
       __res = <optimized out>
       pd = 0x7faa8a073700
       now = <optimized out>
       unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140370436896512, -7060795166432413163, 0, 140722118284815, 140370436897216, 507904, 7013811314942294549, 7013639791417375253}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
       not_first_call = <optimized out>
       pagesize_m1 = <optimized out>
       sp = <optimized out>
       freesize = <optimized out>
       __PRETTY_FUNCTION__ = "start_thread"
#21 0x00007fab3764c41d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
No locals.
{noformat}




3rd
{noformat}
!@!@!@! thread1.txt !@!@!@!

$1 = {si_signo = 11, si_errno = 0, si_code = 128, _sifields = {_pad = {0 <repeats 28 times>}, _kill = {si_pid = 0, si_uid = 0}, _timer = {si_tid = 0, si_overrun = 0, si_sigval = {sival_int = 0, sival_ptr = 0x0}}, _rt = {si_pid = 0, si_uid = 0, si_sigval = {sival_int = 0, sival_ptr = 0x0}}, _sigchld = {si_pid = 0, si_uid = 0, si_status = 0, si_utime = 0, si_stime = 0}, _sigfault = {si_addr = 0x0, _addr_lsb = 0, _addr_bnd = {_lower = 0x0, _upper = 0x0}}, _sigpoll = {si_band = 0, si_fd = 0}}}
Signal        Stop Print Pass to program Description
SIGSEGV       Yes Yes Yes Segmentation fault

Thread 1 (Thread 0x7f1878bcd700 (LWP 30747)):
#0  0x00007f1958c3dedc in _xend () at pthread_rwlock_unlock.c:38
No locals.
#1  __GI___pthread_rwlock_unlock (rwlock=0x106bc20) at pthread_rwlock_unlock.c:38
       ret = 0
#2  0x0000000000506968 in __ast_rwlock_unlock (filename=filename@entry=0x63f401 "astobj2.c", line=line@entry=447, func=func@entry=0x63f798 <__PRETTY_FUNCTION__.10921> "__adjust_lock", t=<optimized out>, name=name@entry=0x63f3f7 "user_data") at lock.c:806
No locals.
#3  0x000000000045cf3a in __ao2_unlock (user_data=user_data@entry=0x106bc78, file=file@entry=0x63f401 "astobj2.c", func=func@entry=0x63f798 <__PRETTY_FUNCTION__.10921> "__adjust_lock", line=line@entry=447, var=var@entry=0x63f3f7 "user_data") at astobj2.c:319
       obj = <optimized out>
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       res = 0
       current_value = <optimized out>
#4  0x000000000045d235 in __adjust_lock (user_data=user_data@entry=0x106bc78, lock_how=lock_how@entry=AO2_LOCK_REQ_WRLOCK, keep_stronger=keep_stronger@entry=1) at astobj2.c:447
       obj = <optimized out>
       obj_rwlock = 0x106bc20
       obj_lockobj = <optimized out>
       orig_lock = AO2_LOCK_REQ_RDLOCK
       __PRETTY_FUNCTION__ = "__adjust_lock"
#5  0x0000000000462026 in hash_ao2_node_destructor (v_doomed=0x7f18880c54a8) at astobj2_hash.c:171
       my_container = 0x106bc78
       bucket = <optimized out>
       doomed = 0x7f18880c54a8
       __PRETTY_FUNCTION__ = "hash_ao2_node_destructor"
#6  0x000000000045d6b7 in __ao2_ref (user_data=0x7f18880c54a8, delta=-1, tag=0x63b7ad "", file=0x65b9c6 "format_cap.c", line=146, func=0x65bc70 <__PRETTY_FUNCTION__.10853> "format_cap_framed_destroy") at astobj2.c:614
       obj = 0x7f18880c5490
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = <optimized out>
       __PRETTY_FUNCTION__ = "__ao2_ref"
#7  0x000000000045d6b7 in __ao2_ref (user_data=0x7f18889931f8, delta=delta@entry=-1, tag=tag@entry=0x63b7ad "", file=file@entry=0x65b9c6 "format_cap.c", line=line@entry=89, func=func@entry=0x65bcc0 <__PRETTY_FUNCTION__.10812> "format_cap_destroy") at astobj2.c:614
       obj = 0x7f18889931e0
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = <optimized out>
       __PRETTY_FUNCTION__ = "__ao2_ref"
#8  0x00000000004f0a3d in format_cap_destroy (obj=0x7f18881fac58) at format_cap.c:89
       framed = <optimized out>
       cap = 0x7f18881fac58
       idx = <optimized out>
       __PRETTY_FUNCTION__ = "format_cap_destroy"
#9  0x000000000045d6b7 in __ao2_ref (user_data=0x7f18881fac58, delta=delta@entry=-1, tag=tag@entry=0x63b7ad "", file=file@entry=0x64f610 "channel_internal_api.c", line=line@entry=653, func=func@entry=0x64f950 <__PRETTY_FUNCTION__.16784> "ast_channel_nativeformats_set") at astobj2.c:614
       obj = 0x7f18881fac40
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = <optimized out>
       __PRETTY_FUNCTION__ = "__ao2_ref"
#10 0x00000000004b7c8c in ast_channel_nativeformats_set (chan=chan@entry=0x2e73360, value=value@entry=0x0) at channel_internal_api.c:653
       __dst___LINE__ = 0x2e73cd0
       __src___LINE__ = 0x0
       __PRETTY_FUNCTION__ = "ast_channel_nativeformats_set"
#11 0x000000000049de62 in ast_channel_destructor (obj=0x2e73360) at channel.c:2339
       chan = 0x2e73360
       vardata = <optimized out>
       f = 0x0
       headp = 0x2e73b40
       datastore = 0x0
       device_name = "PJSIP/mesh0100104930009532000060060060060060067060067000000000000000240065000064031177000000001000000000000000000000311033"X031177000000377377377377000000000000060000000000060000000"
       callid = <optimized out>
       __PRETTY_FUNCTION__ = "ast_channel_destructor"
#12 0x000000000045d6b7 in __ao2_ref (user_data=0x2e73360, delta=delta@entry=-1, tag=tag@entry=0x7f18dc2ae794 "", file=file@entry=0x7f18dc2ae5df "chan_pjsip.c", line=line@entry=2490, func=func@entry=0x7f18dc2ae1a0 <__PRETTY_FUNCTION__.30732> "hangup_data_destroy") at astobj2.c:614
       obj = 0x2e73348
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = <optimized out>
       __PRETTY_FUNCTION__ = "__ao2_ref"
#13 0x00007f18dc2a153d in hangup_data_destroy (obj=0x7f186409ec80) at chan_pjsip.c:2490
       h_data = 0x7f186409ec80
       __PRETTY_FUNCTION__ = "hangup_data_destroy"
#14 0x000000000045d6b7 in __ao2_ref (user_data=user_data@entry=0x7f186409ec80, delta=delta@entry=-1, tag=tag@entry=0x7f18dc2ae794 "", file=file@entry=0x7f18dc2ae5df "chan_pjsip.c", line=line@entry=2541, func=func@entry=0x7f18dc2ae1f1 <__PRETTY_FUNCTION__.30754> "hangup") at astobj2.c:614
       obj = 0x7f186409ec68
       obj_mutex = <optimized out>
       obj_rwlock = <optimized out>
       obj_lockobj = <optimized out>
       current_value = <optimized out>
       ret = <optimized out>
       weakproxy = <optimized out>
       lock_state = <optimized out>
       __PRETTY_FUNCTION__ = "__ao2_ref"
#15 0x000000000045da7b in __ao2_cleanup_debug (obj=obj@entry=0x7f186409ec80, tag=tag@entry=0x7f18dc2ae794 "", file=file@entry=0x7f18dc2ae5df "chan_pjsip.c", line=line@entry=2541, function=function@entry=0x7f18dc2ae1f1 <__PRETTY_FUNCTION__.30754> "hangup") at astobj2.c:670
No locals.
#16 0x00007f18dc2a6544 in hangup (data=0x7f186409ec80) at chan_pjsip.c:2541
       h_data = 0x7f186409ec80
       ast = 0x2e73360
       channel = <optimized out>
       __PRETTY_FUNCTION__ = "hangup"
#17 0x000000000059b98e in ast_taskprocessor_execute (tps=tps@entry=0x258aa50) at taskprocessor.c:1237
       local = {local_data = 0x7f1958c3c4ff <__GI___pthread_mutex_unlock+63>, data = 0x171d9c0}
       t = 0x7f18640a50f0
       __PRETTY_FUNCTION__ = "ast_taskprocessor_execute"
#18 0x00000000005a3080 in execute_tasks (data=0x258aa50) at threadpool.c:1354
       tps = 0x258aa50
#19 0x000000000059b98e in ast_taskprocessor_execute (tps=0x171e220) at taskprocessor.c:1237
       local = {local_data = 0x7ffc60500d50, data = 0x2f1ad9ee87050600}
       t = 0x7f18640c5060
       __PRETTY_FUNCTION__ = "ast_taskprocessor_execute"
#20 0x00000000005a3820 in threadpool_execute (pool=0x171d910) at threadpool.c:367
No locals.
#21 worker_active (worker=0x7f18b00035d0) at threadpool.c:1137
No locals.
#22 worker_start (arg=arg@entry=0x7f18b00035d0) at threadpool.c:1056
       worker = 0x7f18b00035d0
       saved_state = <optimized out>
       __PRETTY_FUNCTION__ = "worker_start"
#23 0x00000000005ab6bc in dummy_start (data=<optimized out>) at utils.c:1249
       __cancel_buf = {__cancel_jmp_buf = {{__cancel_jmp_buf = {139744008743744, -4799612475499294596, 0, 139744716889055, 507904, 139746223338912, 4851688084788793468, -4799613070943924100}, __mask_was_saved = 0}}, __pad = {0x7f1878bccef0, 0x0, 0x7f1958280142 <__libc_thread_freeres+34>, 0x7f1878bcd700}}
       __cancel_arg = 0x7f1878bcd700
       __not_first_call = <optimized out>
       ret = <optimized out>
       a = {start_routine = 0x5a3460 <worker_start>, data = 0x7f18b00035d0, name = 0x7f18b0002b40 "worker_start         started at [ 1111] threadpool.c worker_thread_start()"}
       __PRETTY_FUNCTION__ = "dummy_start"
#24 0x00007f1958c386ba in start_thread (arg=0x7f1878bcd700) at pthread_create.c:333
       __res = <optimized out>
       pd = 0x7f1878bcd700
       now = <optimized out>
       unwind_buf = {cancel_jmp_buf = {{jmp_buf = {139743081584384, -4799612475499294596, 0, 139744716889055, 507904, 139746223338912, 4851688084801376380, 4852321169139748988}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
       not_first_call = <optimized out>
       pagesize_m1 = <optimized out>
       sp = <optimized out>
       freesize = <optimized out>
       __PRETTY_FUNCTION__ = "start_thread"
#25 0x00007f195821241d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
No locals.
{noformat}
Comments:By: Asterisk Team (asteriskteam) 2020-07-03 05:30:22.187-0500

We appreciate the difficulties you are facing, however information request type issues would be better served in a different forum.

The Asterisk community provides support over IRC, mailing lists, and forums as described at http://asterisk.org/community. The Asterisk issue tracker is used specifically to track issues concerning bugs and documentation errors.

If this issue is actually a bug please use the Bug issue type instead.

Please see the Asterisk Issue Guidelines [1] for instruction on the intended use of the Asterisk issue tracker.

Thanks!

[1] https://wiki.asterisk.org/wiki/display/AST/Asterisk+Issue+Guidelines
By: Asterisk Team (asteriskteam) 2020-07-03 05:30:24.026-0500

Thanks for creating a report! The issue has entered the triage process. That means the issue will wait in this status until a Bug Marshal has an opportunity to review the issue. Once the issue has been reviewed you will receive comments regarding the next steps towards resolution. Please note that log messages and other files should not be sent to the Sangoma Asterisk Team unless explicitly asked for. All files should be placed on this issue in a sanitized fashion as needed.

A good first step is for you to review the [Asterisk Issue Guidelines|https://wiki.asterisk.org/wiki/display/AST/Asterisk+Issue+Guidelines] if you haven't already. The guidelines detail what is expected from an Asterisk issue report.

Then, if you are submitting a patch, please review the [Patch Contribution Process|https://wiki.asterisk.org/wiki/display/AST/Patch+Contribution+Process].

Please note that once your issue enters an open state it has been accepted. As Asterisk is an open source project there is no guarantee or timeframe on when your issue will be looked into. If you need expedient resolution you will need to find and pay a suitable developer. Asking for an update on your issue will not yield any progress on it and will not result in a response. All updates are posted to the issue when they occur.