人工智能前沿专题-大语言模型基础导论-研究生课程-Honggang Zhang-2025 .docx

人工智能前沿专题第0页

–大语言模型基础导论

TheFrontierTopicsinArtificialIntelligence

-FoundationsofLargeLanguageModelsGenerativePretrainedTransformer

HonggangZHANG張宏綱

CityUniversityofMacau

January-June,2025,Macau

Outline

①TheBackgroundandBasicsofData-DrivenScalingLaw,Transformer,andFoundationModels(LLMs/LMMs-LargeLanguage/MultimodalModels)

②KeyMechanismsandMethodsinData-DrivenLLMs/LMMs-Prompt,Fine-

Tuning,LoRA,MixtureofExperts(MoE),ChainofThoughts(CoT)andRAG

③EmbodiedAIAgentsandData-DrivenLLMs/LMMs

④Mutual-PlaybetweenData-DrivenLLMs/LMMsandReinforcementLearning

⑤TheMathematicalBasicsofGenerativePretrainedTransformer(GPT)andData-DrivenLLMs/LMMs

⑥DiffusionModels,AlgorithmsandData-DrivenLLMs/LMMs

⑦TelecomLLMs/LMMs,NetworkedGPT(NetGPT)andotherKeyApplications

⑧Summary

1

1

1

The

TheBackgroundandBasicsofData-DrivenScalingLaw,

Transformer,andFoundationModels(Large

Language/MultimodalModels)

2

①TheBasicsofFoundationModels(LargeLanguage/MultimodalModels,LLMs/LMMs)andTransformer(e.g.ChatGPT/GPT-4)

Pictureisdownloadedfromon-linewebsite.Thankstotheauthors.

3

Pictureisdownloadedfromon-linewebsite.Thankstotheauthors.A.

Pictureisdownloadedfromon-linewebsite.Thankstotheauthors.

A.VaswaniAllYou

Information2017),

---------------------------------------》

4

,N.Shazeer,etal.,“AttentionIsNeed,”31stConferenceonNeural

ProcessingSystems(NIPSCA,USA,2017.

Pictureisdownloadedfromon-linewebsite.Thankstotheauthors.

A.Vaswani,N.Shazeer,etal.,“AttentionIsAllYouNeed,”31stConferenceonNeuralInformationProcessingSystems(NIPS

2017),CA,USA,2017.

Pictureisdownloadedfromon-linewebsite

5

5

6

6

Pictureisdownloadedfromon-linewebsite.Thankstotheauthors.

2023年5月，中国科学技术信息研究

2023年5月，中国科学技术信息研究所、科技部新一代人工智能发展研究中心联合编写《中国人工智能大模型地图研究报告》发布