【2】Audio Content Generation Building digitalized human and humanized AI CUHK-SZ.pdf

1、1AUDIO CONTENT GENERATION:BUILDINGDIGITALIZED HUMAN AND HUMANIZED AIWei XueDivision of Emerging Interdisciplinary AreasThe Hong Kong University of Science and Technology2STEPPING INTO THE VIRTUAL WORLDThe pandemic has changed the way of living,and the value of building an online virtual community is

2、 recognized.3STEPPING INTO THE VIRTUAL WORLDMetaverse and Web 3.0 are being built which define new paradigms of communication,perception and interactionDigitalized Human and Humanized AI Human and AI become Indistinguishable(Perception,emotion and creation)AI-generated contents enabling co-inspiring

3、 and co-creation between human and AI4NEXT-GENERATION AUDIOSWe have been working to build the next generation of audio content generation and the interaction between humans,machines and environmentsEndless beautiful audio contents will be generated in the virtual world.We take the music as a researc

4、h focus.Music is a symbol of human creativity and is the basis of modern entertainment industry.My team focuses on Virtual singers with realistic and emotional singing voicesDigital twin and virtual human Music composition with aesthetic feelings Co-creation,noveltyAudio Content Generation5NEXT-GENE

5、RATION AUDIOSOur goal is to ultimately create a new hybrid of real and virtual environments where humans and AIcan inspire,appreciate and interact through audios.Can we create an AI superstar among the top 10 singers?Can ordinary people with little music knowledge express themselves through music?Ca

6、n we talk,sing,and write songs with our idols?6OUTLINE AI Choir:Audio Generation CoMoSpeech:One Step Speech and Singing Voice Synthesis via Consistency Model7HOW TO MAKE AN AI CHOIR?8HUMAN-AI SYMPHONY ORCHESTRAThe worlds first human-AI collaborative symphony orchestra9FACTS OF THE AI CHOIRThe AI cho