Asterisk
  1. Asterisk
  2. ASTERISK-25852

chan_iax2: Exceptionally long voice queue length with trunking

    Details

    • Type: Bug Bug
    • Status: Open
    • Severity: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 11.21.2
    • Target Release Version/s: None
    • Component/s: Channels/chan_iax2
    • Security Level: None
    • Labels:
      None
    • Environment:
      dell r815 64 core OS gentoo
    • Frequency of Occurrence:
      Frequent

      Description

      randomly this error comes up which creates deadlocks and causes all current sip or iax channels to drop

      channel.c: Exceptionally long voice queue length queuing to

      [2016-03-16 21:55:14] WARNING[44200][C-0000012b] channel.c: Exceptionally long voice queue length queuing to Local/69696969696969696@vicidial-000000cd;1
      [2016-03-16 21:55:14] WARNING[23555] channel.c: Exceptionally long voice queue length queuing to IAX2/safesoft-dialer-trunk-2087813841-797
      [2016-03-16 21:55:14] WARNING[44218][C-0000012d] channel.c: Exceptionally long voice queue length queuing to Local/69696969696969696@vicidial-000000cf;1
      [2016-03-16 21:55:14] WARNING[23555] channel.c: Exceptionally long voice queue length queuing to IAX2/safesoft-dialer-trunk-2087813836-11006
      [2016-03-16 21:55:14] WARNING[8980][C-0000021f] channel.c: Exceptionally long voice queue length queuing to Local/78600093@vicidial-0000014e;2
      [2016-03-16 21:55:15] WARNING[64607][C-0000019a] channel.c: Exceptionally long voice queue length queuing to Local/69696969696969696@vicidial-0000010b;1
      [2016-03-16 21:55:15] WARNING[23557] channel.c: Exceptionally long voice queue length queuing to IAX2/safesoft-dialer-trunk-2087813836-10347
      [2016-03-16 21:55:15] WARNING[17830][C-00000168] channel.c: Exceptionally long voice queue length queuing to Local/69696969696969696@vicidial-000000f1;1
      [2016-03-16 21:55:15] WARNING[5805][C-00000218] channel.c: Exceptionally long voice queue length queuing to Local/78600095@vicidial-0000014a;2
      [2016-03-16 21:55:15] WARNING[23559] channel.c: Exceptionally long voice queue length queuing to IAX2/safesoft-dialer-trunk-2087813841-4706
      [2016-03-16 21:55:16] WARNING[7346][C-0000021a] channel.c: Exceptionally long voice queue length queuing to Local/78600097@vicidial-0000014b;2
      [2016-03-16 21:55:16] WARNING[7876][C-0000021d] channel.c: Exceptionally long voice queue length queuing to Local/78600010@vicidial-0000014d;2
      [2016-03-16 21:55:16] WARNING[3790][C-00000216] channel.c: Exceptionally long voice queue length queuing to Local/78600092@vicidial-00000149;2
      [2016-03-16 21:55:16] WARNING[44200][C-0000012b] channel.c: Exceptionally long voice queue length queuing to Local/69696969696969696@vicidial-000000cd;1
      [2016-03-16 21:55:16] WARNING[23554] channel.c: Exceptionally long voice queue length queuing to IAX2/safesoft-dialer-trunk-2087813841-797
      [2016-03-16 21:55:16] WARNING[23559] channel.c: Exceptionally long voice queue length queuing to IAX2/safesoft-dialer-trunk-2087813836-4657
      [2016-03-16 21:55:16] WARNING[44218][C-0000012d] channel.c: Exceptionally long voice queue length queuing to Local/69696969696969696@vicidial-000000cf;1
      [2016-03-16 21:55:17] WARNING[24068][C-00000172] channel.c: Exceptionally long voice queue length queuing to Local/69696969696969696@vicidial-000000f7;1
      [2016-03-16 21:55:17] WARNING[7872][C-0000021b] channel.c: Exceptionally long voice queue length queuing to Local/69696969696969696@vicidial-0000014c;1
      
      1. backtrace-threads4.txt
        114 kB
        Bobby Hakimi
      2. core-show-locks4.txt
        26 kB
        Bobby Hakimi
      3. full.4.crash
        277 kB
        Bobby Hakimi
      1. damned_call_server.png
        317 kB

        Issue Links

          Activity

          Hide
          Bobby Hakimi added a comment -

          sorry forgot to tell you guys, i also used freepbx but not much traffic was going to the freepbx agi scripts or dial plans

          Show
          Bobby Hakimi added a comment - sorry forgot to tell you guys, i also used freepbx but not much traffic was going to the freepbx agi scripts or dial plans
          Hide
          Adam D Topkek added a comment -

          So with 11.25 it is not crashing near as often but it still crashes at times. It's always on an "apply changes" or "fwconsole reload" involving Freepbx.

          We tested, on another server that had 11.23, during the night when no one was using the system and even while under no load parking while doing an "apply changes" or "fwconsole reload" crashed it. The server had ample memory and CPU resources while the changes were applying.

          I don't think we use DUNDi at all. dundi.conf is completely commented out. We mainly use chan_SIP for our phones. I wonder if there is a parking cache that was expiring...?

          Show
          Adam D Topkek added a comment - So with 11.25 it is not crashing near as often but it still crashes at times. It's always on an "apply changes" or "fwconsole reload" involving Freepbx. We tested, on another server that had 11.23, during the night when no one was using the system and even while under no load parking while doing an "apply changes" or "fwconsole reload" crashed it. The server had ample memory and CPU resources while the changes were applying. I don't think we use DUNDi at all. dundi.conf is completely commented out. We mainly use chan_SIP for our phones. I wonder if there is a parking cache that was expiring...?
          Hide
          Adam D Topkek added a comment - - edited

          In the middle of a freepbx "apply changes" or "fwconsole reload" we got this output then directly after a flood of:

          WARNING... channel.c1310 __ast_queue_fame: Exceptionally long voice queue length queuing to IAX2/ULCR-9530

          Show
          Adam D Topkek added a comment - - edited In the middle of a freepbx "apply changes" or "fwconsole reload" we got this output then directly after a flood of: WARNING... channel.c1310 __ast_queue_fame: Exceptionally long voice queue length queuing to IAX2/ULCR-9530
          Hide
          Abhay Gupta added a comment -

          I am also facing a similar issue , wondering if anything was found for the same and ours is asterisk 13.17.1 and this happens with IAX and PJSIP channels

          Show
          Abhay Gupta added a comment - I am also facing a similar issue , wondering if anything was found for the same and ours is asterisk 13.17.1 and this happens with IAX and PJSIP channels
          Hide
          ADTopkek added a comment -

          The problem was the Max stack size. Its set to 128 by default in asterisk. We were using FreePBX so every parking lot we had took up 1 stack, every outbound route took 1 stack, and modules took up a random amount. All together it went over 128 till it started causing stack errors. We had about 50 parking lots.

          FreePBX seems to be fixing it in their newest version: https://issues.freepbx.org/browse/FREEPBX-15656

          Show
          ADTopkek added a comment - The problem was the Max stack size. Its set to 128 by default in asterisk. We were using FreePBX so every parking lot we had took up 1 stack, every outbound route took 1 stack, and modules took up a random amount. All together it went over 128 till it started causing stack errors. We had about 50 parking lots. FreePBX seems to be fixing it in their newest version: https://issues.freepbx.org/browse/FREEPBX-15656

            People

            • Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:

                Development