人工智能前沿专题-大语言模型基础导论-研究生课程-Honggang Zhang-2025 .pdf

人工智能前沿专题第0页

–大语言模型基础导论

TheFrontierTopicsinArtificial

Intelligence

-FoundationsofLargeLanguageModels

GenerativePretrainedTransformer

HonggangZHANG張宏綱

CityUniversityofMacau

January-June,2025,Macau

Outline

①TheBackgroundandBasicsofData-DrivenScalingLaw,Transformer,and

FoundationModels(LLMs/LMMs-LargeLanguage/MultimodalModels)

②KeyMechanismsandMethodsinData-DrivenLLMs/LMMs-Prompt,Fine-

Tuning,LoRA,MixtureofExperts(MoE),ChainofThoughts(CoT)andRAG

③EmbodiedAIAgentsandData-DrivenLLMs/LMMs

④Mutual-PlaybetweenData-DrivenLLMs/LMMsandReinforcementLearning

⑤TheMathematicalBasicsofGenerativePretrainedTransformer(GPT)and

Data-DrivenLLMs/LMMs

⑥DiffusionModels,AlgorithmsandData-DrivenLLMs/LMMs

⑦TelecomLLMs/LMMs,NetworkedGPT(NetGPT)andotherKeyApplications

⑧Summary

1

1

TheBackgroundandBasicsof

Data-DrivenScalingLaw,

Transformer,andFoundation

Models(Large

Language/MultimodalModels)

2

①TheBasicsofFoundationModels(LargeLanguage/MultimodalModels,

LLMs/LMMs)andTransformer(e.g.ChatGPT/GPT-4)

Pictureisdownloadedfromon-linewebsite.Thankstotheauthors.

3

Pictureisdownloadedfromon-linewebsite.Thankstotheauthors.

A.Vaswani,N.Shazeer,etal.,“AttentionIs