学生论坛-机器翻译技术在大模型研究中的新机遇-中国科学院计算技术研究所.pdf

1、机器翻译技术在大模型研究中的新机遇!#$%&()*+,-./1!#$%&()2!#$!#$!#$%&()*+&,*+-./+0123()*+456()*+!#$%&()3!#$!#$!#$%&()*+&,*+-./+0123()*+456()*+LLMLLM forfor *+,-.%!#$4WhatsWhats nextnext?!#$%/0125!#$!#$!#$%&()*+&,*+-./+0123()*+456()*+789:!#$;?ABC!DEFGHIJKLMN9:OPQRST9:TransformerUBPEUNATUDual LearningUBARTUR-DropUWait-k

2、UGQAURMSNormURoPE1!#$%AI&()*+,-./-CCMT 20230123AI/NLP&()*1!#$345,-.6%786 6789:!#$;?ABC!DEFGHIJKLMN9:OPQRST9:V!#$%&V!&,V!GHV!V!W(SXV!OPQYZ9%&:;7%&()#$%&%&#$*+%&#$STEMM ACL22CMOT ACL23CRESS ACL23BT4ST ACL23DASpeech NeurIPS23CTC-S2UT ACL24ComSpeech ACL24StreamSpeech ACL24NAST-S2x ACL24&,9:GH&,RS&,_&,9:

3、ab9:;GPT-4o8n2024!5#OpenAI$%&GPT-4o#()*+,-.)/0123#456789:/;?AB,-.?LLM?AB,-.LLaMA-Omnin01EFG?Whisper-large-v3n01XYG?Z+MLPn045?Llama-3.1-8B-Instruct101 Qingkai Fang,Shoutao Guo,Yan Zhou,Zhengrui Ma,Shaolei Zhang,and Yang Feng.LLaMA-Omni:Seamless Speech Interaction with Large Language Models.arXiv 2024

4、.n01KFG?_ Transformer./CTC?ABC%&DEFGHI=?AB,-.?AB,-.?AB,-.?AB,-.LLaMA-OmninTUa01VWPQRS141 Qingkai Fang,Shoutao Guo,Yan Zhou,Zhengrui Ma,Shaolei Zhang,and Yang Feng.LLaMA-Omni:Seamless Speech Interaction with Large Language Models.arXiv 2024.7829:;&,29?AB?AB 7829C&,29-D?EFG?EFGLLaMA-Omni CDE!#$F%GH34I

5、n01bK%&JKLMN%&#$O%&JKP!#$348QR%&STLMN%&#$OUVW%&HIXYZ8151 Seamless Communication.SeamlessM4T:Massively Multilingual&Multimodal Machine Translation.arXiv 2023.SeamlessM4T45671LLaMA-Omni CDE!#$F%GH34In01RSY_DEFGabcdefg%&hiY_./DEFG8vocoderjCkl&m161 Ann Lee,Peng-Jen Chen,Changhan Wang,Jiatao Gu,Sravya Po

6、puri,Xutai Ma,Adam Polyak,Yossi Adi,Qing He,Yun Tang,Juan Pino,and Wei-Ning Hsu.Direct Speech-to-Speech Translation With Discrete Units.ACL 2022.89:;?#$1LLaMA-Omni CDE!#$F%GH34In01RSMN%&%&#$O8nop34()qKBC()=%&qK./()hiBC%&171 Hirofumi Inaguma,Sravya Popuri,Ilia