Asterisk
  1. Asterisk
  2. ASTERISK-26292

app_confbridge: 3D-Conferencing via Binaural Synthesis

    Details

      Description

      3D-Audio is an interesting for telephone conferencing.
      In a development and research project at TU Berlin, we enhanced Asterisk's
      conferencing bridge with binaural synthesis.

      Technical Details:

      • Modified internal signal processing to be capable handling interleaved audio (channel, translate)
      • Extended confbridge (precisely bridge_softmix) by binaural synthesis (basically added a convolution engine using libfftw3)

      Note: confbridge remains capable to mix for mono channels (default mixing) and binaural synthesis in parallel

      Practical details (can be changed):

      • Required HRTFs are at the moment included as header file
      • Confbridge is at the moment only running with binaural synthesis at 48kHz
      • Only one 3D-Layout per confbridge is rendered (all participants receive the same spatial representation; one's own signal removed)

        Issue Links

          Activity

          No builds found.
          Dennis Guse created issue -
          Hide
          Asterisk Team added a comment -

          Thanks for creating a report! The issue has entered the triage process. That means the issue will wait in this status until a Bug Marshal has an opportunity to review the issue. Once the issue has been reviewed you will receive comments regarding the next steps towards resolution.

          A good first step is for you to review the Asterisk Issue Guidelines if you haven't already. The guidelines detail what is expected from an Asterisk issue report.

          Then, if you are submitting a patch, please review the Patch Contribution Process.

          Show
          Asterisk Team added a comment - Thanks for creating a report! The issue has entered the triage process. That means the issue will wait in this status until a Bug Marshal has an opportunity to review the issue. Once the issue has been reviewed you will receive comments regarding the next steps towards resolution. A good first step is for you to review the Asterisk Issue Guidelines if you haven't already. The guidelines detail what is expected from an Asterisk issue report. Then, if you are submitting a patch, please review the Patch Contribution Process .
          frahaase <fra.haase@googlemail.com> committed c4558236573ac599e6664c47e4db19d8a8eb953e (3 files)
          Reviews: none

          Binaural synthesis (confbridge): interleaved two-channel audio.
          Asterisk only supports mono audio at the moment.
          This patch adds interleaved two-channel audio to Asterisk's channels.

          ASTERISK-26292

          Change-Id: I7a547cea0fd3c6d1e502709d9e7e39605035757a

          frahaase <fra.haase@googlemail.com> committed dd6fc1bb7da290ccebdeff2a934a1824a7d8b099 (5 files)
          Reviews: none

          Binaural synthesis (confbridge): Adds libfftw3 as dependency.
          Adds libfftw3 to the build chain that is is going to be used for binaural
          synthesis by bridge_softmix.

          ASTERISK-26292

          Change-Id: Iedc2f174e4ccb39ae5d9e698e339c6a17155867b

          frahaase <fra.haase@googlemail.com> committed dce31f90ba3a61846e8b04250484a437e33d51e2 (2 files)
          Reviews: none

          Binaural synthesis (confbridge): On/off setting for binaural synthesis.
          Adds setting to confbridge.conf (binaural_active) that determines if binaural
          synthesis can be available in bridge_softmix.

          ASTERISK-26292

          Change-Id: I59dfcb8e55fe1df4ef32045882fea5bb58fc71db

          frahaase <fra.haase@googlemail.com> committed 094c26aa689664177e156d17bf5e9ab67c442a53 (21 files)
          Reviews: none

          Binaural synthesis (confbridge): Adds binaural synthesis to bridge_softmix.
          Adds binaural synthesis to bridge_softmix (via convolution using libfftw3).
          Binaural synthesis is conducted at 48kHz.
          For a conference, only one spatial representation is rendered.
          The default rendering is applied for mono-capable channels.

          ASTERISK-26292

          Change-Id: Iecdb381b6adc17c961049658678f6219adae1ddf

          frahaase <fra.haase@googlemail.com> committed 5b1796f59d01f399c68b05b31fe173fc7ede16dc (4 files)
          Reviews: none

          Binaural synthesis (confbridge): DTMF conference management.
          DTMF configuration options for the binaural softmix bridge:
          toggle binaural rendering (per channel).

          ASTERISK-26292

          Change-Id: Ibfe708b9fe26097c1798fcbfcc4dc461267d8af8

          Joshua Colp made changes -
          Field Original Value New Value
          Summary 3D-Conferencing via Binaural Synthesis app_confbridge: 3D-Conferencing via Binaural Synthesis
          Joshua Colp made changes -
          Assignee Dennis Guse [ dennis.guse ]
          Joshua Colp made changes -
          Status Triage [ 10000 ] Open [ 1 ]
          frahaase <fra.haase@googlemail.com> committed b2b5f9d897d1534f366b1b96fb10ad1de4f9ba5d (3 files)
          Reviews: none

          ast_format: Adds an identifier for interleaved audio formats to the ast_format
          Adds an identifier (with a getter and setter) to detect channels with
          interleaved audio.
          This is needed by the binaural bridge_softmix patch (ASTERISK-26292) and
          was already discussed here:
          http://lists.digium.com/pipermail/asterisk-dev/2016-October/075900.html
          The identifier can be set during fmtp parsing (to be seen in the
          res_format_attr_opus.c change).

          ASTERISK-26292

          Change-Id: I359801cc5f98c35671c48dabc81a7f4ee1183d63

          Friendly Automation made changes -
          Status Open [ 1 ] Closed [ 6 ]
          Resolution Fixed [ 1 ]
          Hide
          Friendly Automation added a comment -

          Change 4322 merged by Joshua Colp:
          ast_format: Adds an identifier for interleaved audio formats to the ast_format

          https://gerrit.asterisk.org/4322

          Show
          Friendly Automation added a comment - Change 4322 merged by Joshua Colp: ast_format: Adds an identifier for interleaved audio formats to the ast_format https://gerrit.asterisk.org/4322
          Dennis Guse <dennis.guse@alumni.tu-berlin.de> committed b58de2fab71ad53b5a385476620dc7b45970cfb6 (8 files)
          Reviews: none

          Binaural synthesis (confbridge): Adds utils/conf_bridge_binaural_hrir_importer
          Adds the import tool for converting a HRIR database to hrirs.h

          ASTERISK-26292

          Change-Id: I51eb31b54c23ffd9b544bdc6a09d20c112c8a547

          Hide
          Friendly Automation added a comment -

          Change 4654 merged by Joshua Colp:
          Binaural synthesis (confbridge): Adds utils/conf_bridge_binaural_hrir_importer

          https://gerrit.asterisk.org/4654

          Show
          Friendly Automation added a comment - Change 4654 merged by Joshua Colp: Binaural synthesis (confbridge): Adds utils/conf_bridge_binaural_hrir_importer https://gerrit.asterisk.org/4654
          Rusty Newton made changes -
          Link This issue causes ASTERISK-26807 [ ASTERISK-26807 ]
          Hide
          Friendly Automation added a comment -

          Change 3524 merged by Joshua Colp:
          Binaural synthesis (confbridge): Adds binaural synthesis to bridge_softmix.

          https://gerrit.asterisk.org/3524

          Show
          Friendly Automation added a comment - Change 3524 merged by Joshua Colp: Binaural synthesis (confbridge): Adds binaural synthesis to bridge_softmix. https://gerrit.asterisk.org/3524
          Hide
          Friendly Automation added a comment -

          Change 3525 merged by zuul:
          Binaural synthesis (confbridge): DTMF conference management.

          https://gerrit.asterisk.org/3525

          Show
          Friendly Automation added a comment - Change 3525 merged by zuul: Binaural synthesis (confbridge): DTMF conference management. https://gerrit.asterisk.org/3525
          George Joseph made changes -
          Target Release Version/s 15.0.0 [ 13592 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Triage Triage Open Open
          2d 18h 59m 1 Joshua Colp 15/Aug/16 5:11 AM
          Open Open Closed Closed
          105d 4h 46m 1 Friendly Automation 28/Nov/16 8:58 AM

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development