语音驱动虚拟说话人的自然头动生成

来源 :清华大学学报(自然科学版) | 被引量 : 0次 | 上传用户:wsz2228507
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
从语音信号预测伴随头动时,基于隐Markov模型(hidden Markov model,HMM)的头动合成方法的效果依赖于头动模式的划分和头动模式的正确识别。该文尝试了不同头动模式划分方法的头动合成效果。由于语音和头动之间是非确定性的多对多的映射关系,很难用固定的类别描述清楚,因此该类方法的头动模式识别率不高,头动合成效果受限。该文尝试采用逆传播(back-propagation,BP)神经网络的非线性回归方法,通过学习语音与头动之间的映射关系,实现语音信号到头动参数之间的直接连续映射,避免了HMM方法中头动模式不明确、头动模式识别错误带来的负面影响。实验表明,基于BP神经网络的回归方法有效地提高了语音到头动预测的准确度和头动合成的自然度。 From the perspective of speech signal prediction, the effect of head motion synthesis based on hidden Markov model (HMM) relies on the classification of head motion mode and the correct recognition of head motion mode. This paper attempts to analyze the head-and-tail combination of different head-and-head modes. Due to the nondeterministic many-to-many mapping relationship between speech and head movements, it is hard to describe clearly in fixed categories. Therefore, the head recognition rate of this kind of method is not high, and the effect of head movement synthesis is limited. This paper attempts to use the non-linear regression method of back-propagation (BP) neural network to learn the direct and continuous mapping between speech signals and head motion parameters by learning the mapping relationship between speech and head motion, avoiding the problem of HMM method In the first move mode is not clear, the first move the wrong pattern to identify the negative impact. Experiments show that the regression method based on BP neural network can effectively improve the accuracy of speech to head motion prediction and the naturalness of head motion synthesis.
其他文献
冷轧带铝的开卷绝大多数采用筒式开卷机,其设备配置较为简单,主要由筒及其传动系统,压紧辊,活动支撑和推卷、卸卷等装置组成。小型冷带铝开卷机仅用来开卷,有时还用来卷取。
本文从微机继电保护的发展史入手,论述了电力系统对微机继电保护的要求、微机保护的优点及其微机继电保护装置的维护
The growth performance of pakchoi (Brassica chinensis L.) in relation to soil cadmium (Cd) fractionations was investigated to evaluate the remediating effect of
‘越蒲1号’为早熟瓠瓜一代杂种。商品瓜棒形,淡绿色,表面密生白色短茸毛,粗细均匀,长25~35cm,直径5~7cm,脐部较平,果肩微凸,单瓜质量350~500g,肉质致密,口感糯,味微甜。从播种
目的探讨甲状软骨外膜与胸骨舌骨肌用于声门型喉癌喉部分切除喉功能重建的疗效及可行性。方法回顾分析38例声门型喉癌喉部分切除术应用甲状软骨外膜和胸骨舌骨肌进行喉功能重
(本刊讯蔡静霞)由香港首席地产开发商长江实业(集团)有限公司在广州东部发展的首个豪宅项目——御湖名邸,继首批320-530平方米大宅开售受捧后,为回应市场需求,开发商首度推出
唐朝王继于《春桂问答》中诗日:“问春桂:桃李正芳华,年光随处满,何事独无花?春桂答:春华讵能久,风霜摇落时,独秀君知否!”《三余赘笔》载:“曾端伯以岩桂为仙友,张敏叔以桂
<正>知名别墅十年收官·低密度居住价值凸显轨道效应提振惠南,迪士尼颠覆格局大花园·全临水·纯别墅藏品【屿墅】全现房发售枫丹白露·屿墅位于大浦东腹地惠南新镇、南六公
宁金富是我们于1985年用金冠作母本、富士作父本杂交育成的苹果晚熟耐贮新品种。果实卵圆形;平均单果重200.0g,最大单果重300.0g;浓红色,色相为条纹;果肉乳黄色,肉质细、紧、
Papaya leaf curl China virus (PaLCuCNV) was previously reported as a distinct begomovirus infecting papaya in southern China. Based on molecular diagnostic surv