CN102543087A - Audio mixing method applied to multi-point mobile audio communication system - Google Patents
Audio mixing method applied to multi-point mobile audio communication system Download PDFInfo
- Publication number
- CN102543087A CN102543087A CN2011104454353A CN201110445435A CN102543087A CN 102543087 A CN102543087 A CN 102543087A CN 2011104454353 A CN2011104454353 A CN 2011104454353A CN 201110445435 A CN201110445435 A CN 201110445435A CN 102543087 A CN102543087 A CN 102543087A
- Authority
- CN
- China
- Prior art keywords
- audio
- mixing
- data stream
- communication system
- audio mixing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses an audio mixing method applied to a multi-point mobile audio communication system. Audio data stream is acquired by means of network acquisition and server local acquisition, the acquired audio data stream is subjected to linear superposition, and audio data are attenuated by dynamically modifying variation factors. Using the method can guarantee integral sound intensity not to be attenuated too fast and guarantee low distortion, noise is avoided within a multi-channel audio mixing range, and audio effects can meet the requirements. The method is widely applicable to multi-point mobile audio communication command systems or multimedia online video conference systems.
Description
Technical field
The present invention relates to voice communication method, particularly a kind ofly be applied to the sound mixing method that multiple spot moves audio communication system.
Background technology
Develop rapidly along with mobile field; The real-time reception and registration of work realizes team unity, increases work efficiency and to the field condition transmission; Guarantee that the higher level has problem such as clear understanding to display gradually to subordinate's working condition, multiple spot moves the voice communication command system to be needed thus and produces.And in multiple spot moves voice communication commander, talk simultaneously as many people; Traditional mode is to use the method for control right to speak; Be only to allow people's speech a certain moment, need before the speech, discharge right to speak after speech finishes to center request floor power; This method has limited the interchange between the member, has also brought a lot of inconvenience to mobile communication.Therefore audio mix is an indispensable characteristic.
And general software audio mixing algorithm all is that the voice data of importing is carried out linear superposition now:
Or average after the stack:
Wherein, M is the number of input audio frequency number; N is the number of samples of a frame;
is
individual sample in the frame;
is
individual audio stream; So
is
individual sample in the frame behind the audio mixing,
is
individual sample of
individual input audio stream present frame.Common speech data position 16bit, i.e. short type in the algorithm, span is-32768≤sampled value≤32767 that the direct linear superposition of a plurality of audio streams just might be overflowed later, overflows the generation noise so the last the possibility of result of formula (1) has; Formula (2) is right;
averages; Solved overflow problem; The volume after but audio mixing is handled is very little, and effect is very undesirable.Noise that this patent method then can occur above the fine solution and audio frequency effect problem.
Summary of the invention
The purpose of this invention is to provide a kind of sound mixing method that multiple spot moves audio communication system that is applied to, it can guarantee the effect and the validity of voice playing to greatest extent in carrying out the audio mixing processing procedure.Thereby realize the normal operation of moving speech communication.
The objective of the invention is to realize like this, its sound mixing method comprises following steps:
1 receives from the audio data stream of network-termination device and decodes.
2 pairs of local audio data streams of server are gathered.
The voice data of 3 elimination destinations oneself.
4 carry out audio mixing with the audio data stream of the network audio data stream that receives and server this locality operates.
How many roads the current audio mixing passage that the current audio mixing processing module of 5 system-computed need be handled has.
A) configure the initial value of audio frequency changed factor, and a frame voice data that begins to get in each audio mixing passage carries out the linear superposition operation.
B) big or small to the multiply each other audio mixing that calculates after multiplying each other of audio mixing value and changed factor after the stack.
C) the audio mixing size of step (b) being calculated is judged, if size exceeds preset maximal value and minimum value, then obtains the changed factor size that satisfies in the preset range value through the step-length of regulating changed factor.
D) will satisfy audio mixing value that step (c) draws audio mixing data as output.
The changed factor that e) will satisfy step (d) as initial changed factor size and the voice data that begins to carry out next frame handle.
The audio data stream that f) will satisfy the output in (e) is carried out post-processed, if the destination is a server itself, then directly plays, if will be transmitted to terminal device, then encodes and transmits.
Technique effect of the present invention is: audio mixing processing procedure of the present invention is applicable to that not only multiple spot moves the voice communication command system, equally also goes in the multi-media network video conferencing system.Audio mixing is handled back undistorted phenomenon in the multichannel scope, and audio frequency effect is good, can satisfy the voice communication requirement of system.
Description of drawings
Fig. 1 flows to the flow process of server for terminal device audio frequency acquiring data of the present invention.
Fig. 2 for server of the present invention receive after the network audio data stream with the audio data stream of server own after concrete treatment scheme.
Fig. 3 carries out the realization flow of concrete audio mixing algorithm for server of the present invention.
Embodiment
According to accompanying drawing this patent is done further explanation below
As shown in Figure 1; Slave unit terminal audio frequency acquiring data stream is also encoded to data stream; Give server through network with transmission of flow media data; Receive the sound signal of terminal device when server after, earlier the audio data stream that receives is decoded, and give relevant processing module and handle.
Shown in Figure 2, then be the specific descriptions that Fig. 1 is handled.On the basis of original terminal device audio data stream that collects, the local audio data stream of server is gathered; Then audio data stream being filtered, mainly is the voice data that filters out destination oneself, will be transmitted to terminal device A such as the data stream behind the audio mixing; Then to pass the voice data of coming to A and give filtration; Only keep B, C, and the voice data that collects of server this locality; If on server, play, then to keep A, B, the voice data of the terminal device of C, and the voice data that server this locality collects need filter out.Fig. 3 handles implementation process for the audio mixing of voice data after filtering, and implementation step is following:
A) how many roads the current audio mixing passage that need handle of the current audio mixing processing module of system-computed has.
B) configure initial value f=1 of the changed factor of audio frequency, and a frame voice data that begins to get in each audio mixing passage carries out the linear superposition operation.
C) big or small to the multiply each other audio mixing that calculates after multiplying each other of audio mixing value and changed factor after the stack.
D) the audio mixing data stream size of step (c) being calculated is judged, if size exceeds preset maximal value and minimum value, then obtains the changed factor size that satisfies in the preset range value through the step-length of regulating changed factor.
E) will satisfy audio mixing data stream size that step (d) draws audio mixing data as output
The changed factor that f) will satisfy step (e) as initial changed factor size and the voice data that begins to carry out next frame handle.
After the audio mixing processing procedure finishes, then to handle the data of audio mixing, if the destination is a server itself, then only need the data behind the audio mixing are directly play in server this locality.Be transmitted to terminal device if desired, save the network bandwidth, before forwarding, carry out audio coding (the main G.723 coding that adopts), give corresponding terminal device through forwarded at last, when terminal device receives the audio frequency letter to the data of audio mixing
After number, the decodes and plays operation of being correlated with.
The above has described the whole communication process that multiple spot moves the voice communication command system, and the audio mixing processing procedure has been done concrete detailed description.By describe know that this audio mixing processing procedure is applicable to that not only multiple spot moves the voice communication command system, go for equally in the multi-media network video conferencing system.Audio mixing is handled back undistorted phenomenon in the multichannel scope, and audio frequency effect is good, can satisfy the voice communication requirement of system.
Anyly be familiar with this technological people in the technical scope that the present invention disclosed, the variation that can expect easily or replacement all should be encompassed within protection scope of the present invention.
Claims (6)
1. one kind is applied to the sound mixing method that multiple spot moves audio communication system, it is characterized in that:
Reception is from the audio data stream of network-termination device and decode;
Audio data stream to server is local is gathered;
Eliminate the voice data of destination oneself;
Network audio data stream that receives and the local audio data stream of server are carried out the audio mixing operation;
1.5 how many roads the current audio mixing passage that the current audio mixing processing module of system-computed need be handled has;
Configure the initial value of audio frequency changed factor, and a frame voice data that begins to get in each audio mixing passage carries out the linear superposition operation;
Big or small to the multiply each other audio mixing that calculates after multiplying each other of audio mixing value and changed factor after the stack;
Audio mixing size to step (b) is calculated is judged, if size exceeds preset maximal value and minimum value, then obtains the changed factor size that satisfies in the preset range value through the step-length of regulating changed factor;
To satisfy audio mixing value that step (c) draws audio mixing data as output;
The changed factor that will satisfy step (d) as initial changed factor size and the voice data that begins to carry out next frame handle;
The audio data stream that f) will satisfy the output in (e) is carried out post-processed, if the destination is a server itself, then directly plays, if will be transmitted to terminal device, then encodes and transmits.
2. according to right 1 described a kind of sound mixing method that multiple spot moves audio communication system that is applied to, gather when it is characterized in that having realized network audio data stream and server local audio data stream.
3. according to right 1 described a kind of sound mixing method that multiple spot moves audio communication system that is applied to, it is characterized in that the linear superposition mode has been adopted in the mixing of voice signal.
4. according to right 1 described a kind of sound mixing method that multiple spot moves audio communication system that is applied to, it is characterized in that in the audio mixing processing procedure, having eliminated the voice data of destination oneself.
5. according to right 1 described a kind of sound mixing method that multiple spot moves audio communication system that is applied to, it is characterized in that the audio mixing processing procedure is that accomplish at the center, backstage at server end all, is transmitted to each mobile terminal device by server end then.
6. according to right 1 described a kind of sound mixing method that multiple spot moves audio communication system that is applied to, it is characterized in that the control of dynamic smoothing, sound signal changes does not have jump phenomena, and noiselessness occurs.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104454353A CN102543087A (en) | 2011-12-28 | 2011-12-28 | Audio mixing method applied to multi-point mobile audio communication system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011104454353A CN102543087A (en) | 2011-12-28 | 2011-12-28 | Audio mixing method applied to multi-point mobile audio communication system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102543087A true CN102543087A (en) | 2012-07-04 |
Family
ID=46349825
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011104454353A Pending CN102543087A (en) | 2011-12-28 | 2011-12-28 | Audio mixing method applied to multi-point mobile audio communication system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102543087A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968995A (en) * | 2012-11-16 | 2013-03-13 | 新奥特（北京）视频技术有限公司 | Sound mixing method and device of audio signal |
| CN103021419A (en) * | 2012-12-26 | 2013-04-03 | 大唐移动通信设备有限公司 | Processing method and device for mixed audio |
| CN103067221A (en) * | 2012-12-24 | 2013-04-24 | 广东威创视讯科技股份有限公司 | Voice-frequency telephony testing system |
| CN107818790A (en) * | 2017-11-16 | 2018-03-20 | 苏州麦迪斯顿医疗科技股份有限公司 | A kind of Multi-channel audio sound mixing method and device |
| CN110299144A (en) * | 2018-03-21 | 2019-10-01 | 腾讯科技（深圳）有限公司 | Audio mixing method, server and client |
| CN112637627A (en) * | 2020-12-18 | 2021-04-09 | 咪咕互动娱乐有限公司 | User interaction method, system, terminal, server and storage medium in live broadcast |
| CN113257257A (en) * | 2021-07-14 | 2021-08-13 | 统信软件技术有限公司 | Method, device and equipment for processing mixed sound of multiple paths of voice signals and storage medium |
| CN114974273A (en) * | 2021-08-10 | 2022-08-30 | 中移互联网有限公司 | Conference audio mixing method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1805006A (en) * | 2006-01-24 | 2006-07-19 | 北京邮电大学 | Quick and real-time sound mixing method for multimedia conference |
| CN101674450A (en) * | 2008-09-10 | 2010-03-17 | 深圳市邦彦信息技术有限公司 | Sound mixing method in video directing and scheduling system |
| CN102005206A (en) * | 2010-11-16 | 2011-04-06 | 上海华平信息技术股份有限公司 | Audio mixing method of multiple-channel audio frequency |
| US20110150200A1 (en) * | 2009-12-23 | 2011-06-23 | Sun Microsystems, Inc. | Web guided collaborative audio |
| US20110161836A1 (en) * | 2009-12-31 | 2011-06-30 | Ruicao Mu | System for processing and synchronizing large scale video conferencing and document sharing |
-
2011
- 2011-12-28 CN CN2011104454353A patent/CN102543087A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1805006A (en) * | 2006-01-24 | 2006-07-19 | 北京邮电大学 | Quick and real-time sound mixing method for multimedia conference |
| CN101674450A (en) * | 2008-09-10 | 2010-03-17 | 深圳市邦彦信息技术有限公司 | Sound mixing method in video directing and scheduling system |
| US20110150200A1 (en) * | 2009-12-23 | 2011-06-23 | Sun Microsystems, Inc. | Web guided collaborative audio |
| US20110161836A1 (en) * | 2009-12-31 | 2011-06-30 | Ruicao Mu | System for processing and synchronizing large scale video conferencing and document sharing |
| CN102005206A (en) * | 2010-11-16 | 2011-04-06 | 上海华平信息技术股份有限公司 | Audio mixing method of multiple-channel audio frequency |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102968995A (en) * | 2012-11-16 | 2013-03-13 | 新奥特（北京）视频技术有限公司 | Sound mixing method and device of audio signal |
| CN102968995B (en) * | 2012-11-16 | 2018-10-02 | 新奥特（北京）视频技术有限公司 | A kind of sound mixing method and device of audio signal |
| CN103067221A (en) * | 2012-12-24 | 2013-04-24 | 广东威创视讯科技股份有限公司 | Voice-frequency telephony testing system |
| CN103067221B (en) * | 2012-12-24 | 2016-08-03 | 广东威创视讯科技股份有限公司 | A kind of voice-frequency telephony test system |
| CN103021419A (en) * | 2012-12-26 | 2013-04-03 | 大唐移动通信设备有限公司 | Processing method and device for mixed audio |
| CN107818790A (en) * | 2017-11-16 | 2018-03-20 | 苏州麦迪斯顿医疗科技股份有限公司 | A kind of Multi-channel audio sound mixing method and device |
| CN110299144A (en) * | 2018-03-21 | 2019-10-01 | 腾讯科技（深圳）有限公司 | Audio mixing method, server and client |
| CN110299144B (en) * | 2018-03-21 | 2021-05-28 | 腾讯科技（深圳）有限公司 | Audio mixing method, server and client |
| CN112637627A (en) * | 2020-12-18 | 2021-04-09 | 咪咕互动娱乐有限公司 | User interaction method, system, terminal, server and storage medium in live broadcast |
| CN112637627B (en) * | 2020-12-18 | 2023-09-05 | 咪咕互动娱乐有限公司 | User interaction method, system, terminal, server and storage medium in live broadcast |
| CN113257257A (en) * | 2021-07-14 | 2021-08-13 | 统信软件技术有限公司 | Method, device and equipment for processing mixed sound of multiple paths of voice signals and storage medium |
| CN114974273A (en) * | 2021-08-10 | 2022-08-30 | 中移互联网有限公司 | Conference audio mixing method and device |
| CN114974273B (en) * | 2021-08-10 | 2023-08-15 | 中移互联网有限公司 | Conference audio mixing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102543087A (en) | Audio mixing method applied to multi-point mobile audio communication system | |
| CN101502089B (en) | Method for carrying out an audio conference, audio conference device, and method for switching between encoders | |
| EP2898508B1 (en) | Methods and systems for selecting layers of encoded audio signals for teleconferencing | |
| JP3948904B2 (en) | Teleconference bridge with edge point mixing | |
| US20060013416A1 (en) | Stereo microphone processing for teleconferencing | |
| CN103384235B (en) | Data are presented during multi-conference method, server and system | |
| DE60129072T2 (en) | Multimodal speech coding and noise cancellation | |
| EP1763241A2 (en) | Spatially correlated audio in multipoint videoconferencing | |
| CN1411256A (en) | Telecommunication conference arrangement | |
| WO2010074583A1 (en) | Elevated toroid microphone apparatus and method | |
| CN103141076A (en) | Echo control optimization | |
| CN108259857A (en) | A kind of two-way intercommunication integral system of video monitoring public broadcasting and its control method | |
| CN104167210A (en) | Lightweight class multi-side conference sound mixing method and device | |
| CN102915736A (en) | Sound mixing processing method and system | |
| CN102118523A (en) | Mixing control method for centralized teleconference | |
| CN110024029A (en) | Audio Signal Processing | |
| WO2022193473A1 (en) | Pipeline-based audio broadcasting method | |
| CN101502043B (en) | Method for carrying out a voice conference, and voice conference system | |
| EP2514218A1 (en) | Toroid microphone apparatus | |
| CN101316122A (en) | Automatic gain control method and apparatus thereof | |
| JP2007251501A (en) | Teleconference system and teleconferencing method | |
| CN106603877A (en) | Collaborative conference voice collection method and apparatus | |
| JP2014096732A (en) | Voice collection device, and telephone set | |
| WO2009060498A1 (en) | Inter-multipoint voice conversation apparatus | |
| CN102436818A (en) | Routing and overdubbing method for server end based on priority of energy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C05 | Deemed withdrawal (patent law before 1993) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120704 |