大模型Technical Report2025
GLM-4: Zhipu AI Language Model
GLM Team, Zhipu AIZhipu AI
摘要
GLM-4 advances the GLM architecture with improved pre-training and alignment techniques. The model shows strong performance across diverse language tasks.
GLM architecturepre-trainingalignmentlanguage tasksZhipu
技术细节
数据集
GLM-4 Corpus (Chinese + English10T+ tokens)
模型骨架
GLM-4 (General Language Model)
编码器
Transformer Encoder with GLM Architecture
解码器
Autoregressive Decoder (40+ layers)