当前位置:首页 >英文主页 >中英对照 > 中译版报告详情

DeepSeek Coder V2技术报告(中译版)(19页).pdf

上传人: 淘*** 编号:650880 2025-04-07 19页 387.03KB

下载:

1、DeepSeek-Coder-V2:Breaking the Barrier of Closed-SourceModels in Code IntelligenceQihao Zhu*,Daya Guo*,Zhihong Shao*,Dejian Yang*,Peiyi Wang,Runxin Xu,Y.WuYukun Li,Huazuo Gao,Shirong Ma,Wangding Zeng,Xiao Bi,Zihui Gu,Hanwei Xu,Damai DaiKai Dong,Liyue Zhang,Yishi Piao,Zhibin Gou,Zhenda Xie,Zhewen Hao

2、,Bingxuan WangJunxiao Song,Deli Chen,Xin Xie,Kang Guan,Yuxiang You,Aixin Liu,Qiushi Du,Wenjun GaoXuan Lu,Qinyu Chen,Yaohui Wang,Chengqi Deng,Jiashi Li,Chenggang ZhaoChong Ruan,Fuli Luo,Wenfeng LiangDeepSeek-AIhttps:/ present DeepSeek-Coder-V2,an open-source Mixture-of-Experts(MoE)code languagemodel

3、that achieves performance comparable to GPT4-Turbo in code-specific tasks.Specifically,DeepSeek-Coder-V2 is further pre-trained from an intermediate checkpoint of DeepSeek-V2with additional 6 trillion tokens.Through this continued pre-training,DeepSeek-Coder-V2substantially enhances the coding and m

4、athematical reasoning capabilities of DeepSeek-V2,while maintaining comparable performance in general language tasks.Compared to DeepSeek-Coder-33B,DeepSeek-Coder-V2 demonstrates significant advancements in various aspects ofcode-related tasks,as well as reasoning and general capabilities.Additional

5、ly,DeepSeek-Coder-V2 expands its support for programming languages from 86 to 338,while extending the contextlength from 16K to 128K.In standard benchmark evaluations,DeepSeek-Coder-V2 achievessuperior performance compared to closed-source models such as GPT4-Turbo,Claude 3 Opus,and Gemini 1.5 Pro i

6、n coding and math benchmarks.HumanEvalMBPP+MATHGSM8K5060708090100Accuracy(%)90.276.275.794.988.272.273.493.783.574.667.790.884.972.060.195.081.769.050.493.081.168.2AiderLiveCodeBenchSWE-Bench0102030405060708073.743.412.763.945.718.357.134.118.768.434.611.749.228.751.131.02.7DeepSeek-Coder-V2GPT-4-Tu

word格式文档无特别注明外均可编辑修改,预览文件经过压缩,下载原文更清晰!
三个皮匠报告文库所有资源均是客户上传分享,仅供网友学习交流,未经上传用户书面授权,请勿作商用。
本文介绍了DeepSeek-Coder-V2,这是一个开源的混合专家(MoE)代码语言模型,其性能可与GPT4-Turbo相媲美。具体来说,DeepSeek-Coder-V2从DeepSeek-V2的中间检查点进一步预训练,并增加了6万亿个标记的数据。通过继续预训练,DeepSeek-Coder-V2显著提高了DeepSeek-V2的编码和数学推理能力,同时保持了在通用语言任务中的可比性能。与DeepSeek-Coder-33B相比,DeepSeek-Coder-V2在代码相关任务、推理和通用能力方面取得了显著的进步。此外,DeepSeek-Coder-V2支持编程语言从86种增加到338种,并将上下文长度从16K扩展到128K。在标准基准评估中,DeepSeek-Coder-V2在编码和数学基准测试中优于封闭源模型,如GPT4-Turbo、Claude 3 Opus和Gemini 1.5 Pro。
"DeepSeek-Coder-V2如何超越GPT4-Turbo?" "开源代码模型如何缩小与闭源模型之间的差距?" "DeepSeek-Coder-V2在编程语言支持上有哪些突破?"
客服
商务合作
小程序
服务号
折叠