| 研究生: |
蘇培智 Pei-Chih Su |
|---|---|
| 論文名稱: |
基於藉語音再取樣萃取共振峰變化之聲調調整技術 Pitch-Scale Modification Based on Formant Extraction from Resampled Speech |
| 指導教授: |
張寶基
Pao-Chi Chang |
| 口試委員: | |
| 學位類別: |
碩士 Master |
| 系所名稱: |
資訊電機學院 - 通訊工程學系 Department of Communication Engineering |
| 畢業學年度: | 92 |
| 語文別: | 中文 |
| 論文頁數: | 89 |
| 中文關鍵詞: | 共振峰 、再取樣 、語音分析/合成 、聲調調整 、基頻諧波 、基頻週期同步 、線性預測編碼 |
| 外文關鍵詞: | dual-resampling, pitch harmonic, Pitch-scale modification, analysis-synthesis, formant extraction |
| 相關次數: | 點閱:16 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
語音聲調調整(pitch-scale modification)可以改變語音的音色以及聲調高低,讓原本平凡單調的聲音變得豐富有趣,也可以做為保密隱私之應用,或是結合其他語音分析/合成(analysis-synthesis)技術,讓語音處理的應用變得更多元化。
使用線性預測編碼(Linear Prediction Coding,LPC)的分析/合成方式,能夠獲得語音重要的基本組成,包括LPC係數及殘餘訊號;前者與語音訊號的頻譜包絡線(spectral envelope)有關,一般也稱之為共振峰(formant),而後者主要為語音頻譜上的基頻諧波(pitch harmonic)成分。藉由調整這些特徵,可以有效地改變合成語音的特性。然而一般由LPC極點調整共振峰的方式,容易破壞原本的共振峰結構,進而造成語音品質下降。因此本論文提出利用兩組不同比例之再取樣,分別萃取語音訊號的共振峰變化以及基頻週期改變後的殘餘訊號,經LPC合成濾波器得到調整過的語音,最後結合基頻週期同步(pitch synchronization)及音框邊界補償機制,確保合成語音的品質。經由模擬實驗的結果證實,藉由不同之再取樣比例能夠有效地控制語音的音色及聲調高低變化,而合成語音的品質亦令人滿意。
Pitch-scale modification that can change the tone and the prosody of speech is useful in privacy protection and entertainment. One of the approaches for pitch-scale modification is the analysis-synthesis method. It has the freedom for synthesizing arbitrary voice once the speech parameters such as LPC coefficients and residual signal are obtained.
In this paper we propose a pitch-scale modification method based on formant extraction from resampled speech. The formant, which is the spectrum envelope of speech signal, can be extracted by LPC analysis, and this procedure, so-called de-formant, eliminates the short-term correlation incurred by vocal tract filter. The frequency response of LPC synthesis filter determines the timbre of synthesized speech. The residual signal mainly consists of long-term components, the pitch harmonic, which determines the tone of speech and can be easily modified by using the resampling technique. A dual-resampling mechanism is used to obtain the modified formant and modified pitch harmonic, respectively. The pitch-scale modification mentioned above is only performed in voiced frames because they have high energy and are relatively stable. And the cross-correlation coefficients are calculated to locate the synchronization point, i.e., the pitch mark. Experimental results show that the speech can be successfully modified to different timbre and tone with high quality.
[1] J. Makhoul, "Linear Prediction: a tutorial review," Proceedings of the IEEE, vol. 63, pp. 561-580, 1975.
[2] G. Fant, Acoustic Theory of Speech Production, Morton, S-Gravenhage, 1960.
[3] Dongbing Wei and C. C. Goodyear, "Experiments in Female Voice Speech Synthesis Using A Parametric Articulatory Model," ICASSP, vol. 3, pp. 1631 –1634, April 1997.
[4] L. R. Rabiner and R. W. Schafer, Digital Prediction of Speech Signals, Prentice Hall, 1978.
[5] F. F. Lee, "Time Compression and Expansion of Speech by the Sampling method, " J. Audio Eng. Soc. 20: 738-742, 1972.
[6] R. J. Scott and S. E. Gerber, "Pitch Synchronous Time Compression of Speech, " in Proc. Conf. Speech Commun. Process., Newton, Mass., 63-65, 1972.
[7] F. Charpentier and M. Stella, "Diphone synthesis using an overlap-add technique for speech waveform concatenation," Proc. ICASSP Tokyo, pp. 2015-2018, 1986.
[8] H. Valbret, E. Moulines, and J.P. Tubach, "Voice transformation using PSOLA technique," ICASSP, vol. 1, pp. 145 –148, 1992.
[9] 王鴻彬, 國語聲訊處理, 碩士論文, 國立交通大學, 1995
[10] G. J. Lin, S. G. Chen, and T. Wu, "High Quality and Low Complexity Pitch Modification of Acoustic Signals," ICASSP, vol. 5, pp. 2987-2990, 1995.
[11] B. Gold and N. Morgan, Speech and Audio Signal Processing, Wiley, 2000
[12] F. Thomas and J. Robert, "Shape Invariant Time-Scale and Pitch Modification of Speech," IEEE Transactions on Signal Processing, vol. 40, No. 3, March 1992.
[13] J. L. Flanagan and R. M. Golden, "Phase Vocoder, " Bell Syst. Tech. J. 45: 1493-1509, 1966.
[14] M. R. Portnoff, "Time-Scale Modification of Speech Based on Short-Time Fourier Analysis, " IEEE Trans. ASSP, pp. 374-390, 1986.
[15] A. S. Spanias, "Speech Coding: A Tutorial Review," Proceedings of the IEEE, vol. 82, no. 10, pp. 1541-82, October 1994.
[16] A. M. Kondoz, Digital Speech Coding for Low Bit Rate Communications Systems, Wiley, 1994.
[17] H. Kobayashi and T. Shimamura, "A Weighted Autocorrelation Method for Pitch Extraction of Noisy Speech," Proc. ICASSP, vol.3, pp. 1307 –1310, June 2000.
[18] M. J. Ross et al, "Average Magnitude Difference Function Pitch Extractor," IEEE Trans. ASSP, vol.22, pp. 353-362, 1974.
[19] W. Hess, Pitch Determination of Speech Signals, Springer-Verlag, New York, 1983.
[20] L. Gu and R. Liu, "High-Performance Mandarin Pitch Estimation," Journal of Electronics, vol.27, pp. 8-11, 1999.
[21] D. G. Childers, Speech processing and Synthesis toolboxes, Wiley, New York, 2000.
[22] W. Zhang, G. Xu, and Y. Wang, "Pitch Estimation Based on Circular AMDF," ICASSP, pp. I-341-344, 2002.
[23] F. M. Gimenez de los Galanes, M. Savoji, and J. M. Pardo, "Speech synthesis system based on a variable decimation/interpolation factor," ICASSP, pp. 636-639, 1995.
[24] R. Vergin, D. O’Shaughnessy, and A. Farhat, "Time Domain Technique for Pitch Modification and Robust Voice Transformation," Proc. ICASSP, pp. 947-950, April 1997.
[25] R. Muralishankar, A. G. Ramakrishnan, and P. Prathibha, "Modification of pitch using DCT in the source domain," Speech Communication, vol. 42, pp.143-154, 2004.
[26] Ahmed, N., Rao, K.R., Orthogonal Transforms for Digital Signal Processing, Springer, New York, 1975.
[27] H. Fujisaki and T. Kawashima, "The Roles of Pitch and Higher Formants in the Perception of Vowels," IEEE Trans. on Audio and Electroacoustics, vol. AU-16, No. 1, pp. 73-77, March 1968.
[28] A. Acero, "Formant Analysis and Synthesis using Hidden Markov Models," Proc. of the Eurospeech Conference, Budapest, 1999.
[29] C. H. Ho, D. Rentzos, and S. Vaseghi, "Formant Model estimation and transformation for Voice Morphing," Proc. ICSLP, pp. 2149-5151, 2002.
[30] E. Turajlic, D. Rentzos, S. Vaseghi, and C. H. Ho, "Evaluation of methods for parametric formant transformation in voice conversion," ICASSP, pp. I-724-727, 2003.
[31] J. Slifka and T. R. Anderson, "Speaker Modification with LPC Pole Analysis," ICASSP, vol. 1, pp. 644 –647, May 1995.
[32] 楊東敏, 基於線性預測編碼及音框週期同步之高品質語音變換技術, 碩士論文, 國立中央大學, 2003
[33] H. Wakita, "Normalization of Vowels by Vocal-Tract Length and Its Application to Vowel Identification," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 25, pp. 183 –192, April 1977.
[34] R. Ansari, D. Kahn, and M. Macchi, "Pitch Modification of Speech Using a Low-Sensitivity Inverse Filter Approach," IEEE Signal Processing Letters, pp. 60-62, vol. 5, no. 3, March 1998.
[35] B. Atal and L. Rabiner, "A Pattern Recognition Approach to Voiced-Unvoiced-Silence Classification with Applications to Speech Recognition," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 24, pp. 201 –212, Jun 1976.
[36] ITU-T Recommendation G.729, "Coding of speech at 8 kbit/s using Conjugate-Structure Algebraic-Coded-Excited Linear-Prediction (CS-ACEP)," March 1996.
[37] Jr. A. Gray and J. Markel, "A Spectral-Flatness Measure for Studying the Autocorrelation Method of Linear Prediction of Speech Analysis," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 22, pp. 207 –217, Jun 1974.
[38] B. Yegnanarayana and P. Satyanarayana Murthy, "Enhancement of Reverberant Speech Using LP Residual Signal," IEEE Transactions on Speech and Audio Processing, vol. 8, no.3, pp. 267-281, May 2000.