Sonatype 是一家软件供应链管理公司。我们帮助组织在竞争激烈的市场中更快地创新。我们行业领先的平台使工程师能够无所畏惧地开发软件,并专注于构建支持业务的产品。Sonatype 研究人员分析了超过 1.2 亿个开源组件(比其竞争对手多 40 倍),Sonatype 平台已自动阻止超过 115,000 个恶意组件攻击软件开发管道。启用高质量、安全的软件有助于组织满足其业务需求以及客户和合作伙伴的业务需求。超过 2,000 个组织(包括 70% 的财富 100 强企业和 1500 万软件开发人员)依靠我们的工具和指导来实现雄心勃勃、快速行动和安全地完成任务。要了解有关 Sonatype 的更多信息,请访问 www.sonatype.com。
摘要 - Sonatype的2023年报告发现,有97%的开发人员和安全性领导了生成人工智能(AI),尤其是大语言模型(LLMS),纳入其开发过程。对这一趋势的安全含义的担忧已经提出。开发人员现在正在权衡LLM的好处和风险与其他依赖信息来源(例如Stackoverflow(SO)),需要经验数据以告知他们的选择。在这项工作中,我们的目标是在选择代码stippetsby经验比较chatgpt和stackoverflow的脆弱性时,提高软件开发人员对安全性的意识。为了实现这一目标,我们将现有的Java数据集与与安全有关的问题和答案中进行了。然后,我们问了同样的问题,所以我们收集了生成的代码以进行比较。策划数据集后,我们使用CodeQL分析了每个平台中108个摘要的共同弱点枚举(CWE)漏洞的数量和类型。ChatGpt生成的代码包含248个漏洞,产生的漏洞减少了20%,具有统计学上的显着差异。此外,Chatgpt产生了19种CWE类型,少于SO中的22种。我们的发现表明,开发人员对两个平台的不安全代码传播的教育程度不足,因为我们发现了274个独特的漏洞和25种CWE。由AI或人类创建的任何复制和粘贴的代码都不能盲目信任,需要良好的软件工程实践来降低风险。未来的工作可以帮助最大程度地减少任何平台的不安全代码传播。关键字:软件工程安全,实证研究,大语言模型,软件供应链,代码生成
3P Solutions Inc. BUNDLAR, LLC DOMA Technologies LLC Intuitive Research and Technology NGC ServiceNow A. Harold and Associates, LLC CAE USA Doron Precision Systems, Inc JANUS Research Group Norseman Defense Technologies SIMETRI Abacus Solution Group Cape Henry associates Dynepic, Inc. JHNA NSIN Sonatype Accenture Federal Services CDWG Eduworks Corporation JRM Technologies NVIDIA SOS International LLC Acumentrics, Inc. Cisco Systems Inc Engineering Support Personnel, Inc. Juniper Networks Oceus Specialty Systems Inc Ad hoc Research Clarity Cyber Envision Innovative Solutions, Inc. KBR ODU/VMAS Strategic Operational Solutions, Inc. STOPSO Aechelon Technology CloudBees Ephibian Keysight Technologies Odyssey Systems Consulting Group, Ltd. Super Systems, Inc. Aero Simulation, Inc. Cole Engineering Services, Inc Epic Games Krush Acquistions/Ensley. Inc Okta System Innovation Group, LLC AITC, Inc. Collins Aerospace FlightSafety International Kyrus Tech Omni Federal Technical Systems Integration Inc. Akima Colossal FN America Leidos Ops Tech Alliance TEK Systems Alan Anderson Aerospace Consulting LLC COLSA Corporation Frontier Technology Lockheed Martin Outcome One Textron Algoptimal Computer World Services CWS GaN Corporation Lockheed Martin RMS Par Government The Coe Group Alluvionic Inc. Constant Technologies GDIT Loyal Source Government Services Parsons TReX NSTXL Amazon CRANK Marketing Group LLC General Atomics LSI PCI Technology V3 Strategies and Solutions, LLC American Systems Cubic General Dynamics Mission Systems MAG Aerospace PeopleTec Valiant Applied Research Associates cubic CMPS Google Makai LLC Pinnacle Solutions Inc Valkyrie Enterprises AT&T Darley Defense Grid Raster Inc. Malama Kai Technologies LLC Plateau GRP Varjo AT&T Public Sector Data Machines Corp. Hewlett Packard Enterprise Marathon Targets Inc Program Manager Training Systems PMM 130 Vertex 技术和培训解决方案 ATS Davis Strategic Innovations, Inc. DSI HII - Mission Technologies Maxon Inc. Radiance Technologies VMASC/ODU Battelle DCI Solutions Hodges Transportation - NATC MFGS Inc. Ravenswood Solutions Vmware BeyondTrust Dell Federal IBM Microsoft Real-Time Innovations RTI Worldwide Technology Bohemia Interactive Simulations Dell Technologies, Inc. Improbable Millennium Corporation Red River Xator Corporation Booz Allen Hamiilton Dignitas Technologies Infinitas engineering Inc. Miracle Systems RSGS LLC Yorktown Systems Group Boston Consulting Group DirectViz Solutions Info-Matrix Corporation MITRE R-Squared Solutions Zachary Piper Solutions Boston Engineering Discovery Machine, Inc iNovate Solutions, Inc. MSBAI S2 Analytical Solutions BSC Technology LLC DiSTI InterImage, Inc. NEXGEN FEDERAL SYSTEMS SAIC