Home / Companies / GitHub / Blog / Post Details
Content Deep Dive

Evolving GitHub Copilot’s next edit suggestions through custom model training

Blog post from GitHub

Post Details
Company
Date Published
Author
Kevin Merchant, Yu Hu
Word Count
1,870
Company Posts That Month
18
Language
English
Hacker News Points
-
Post removed?
No
Summary

Next Edit Suggestions (NES) is a custom model integrated into GitHub Copilot to predict logical code edits, enhancing developer productivity within Visual Studio Code. Since its debut, NES has undergone significant updates, driven by challenges in predicting edits, which demand understanding developer intent without explicit prompts and maintaining a balance between suggestion speed and quality. The development of NES required a shift from relying on pull request data to collecting real-time editing behavior, facilitating the creation of a more accurate dataset. Utilizing supervised fine-tuning and reinforcement learning, NES achieved improved model quality by addressing the limitations of traditional training methods and leveraging unlabeled data. The continuous refinement process, influenced by developer feedback, has led to releases that reduce latency, improve suggestion quality, and adjust model eagerness based on user interactions. Future enhancements aim to offer cross-file suggestions, faster responses, and smarter edits by anticipating context and dependencies. The development of NES exemplifies an "AI-native" approach, emphasizing end-to-end integration and collaboration between model training, UX design, and the VS Code team to prioritize the developer experience.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
AI Coding Assistant 8 951 205 85 -2%
Developer Experience 3 481 252 98 -36%
LLM 3 5,556 752 184 +14%
Real-time 2 4,542 1,005 235 -31%
Reinforcement learning 2 293 55 27 +98%
AI Model Fine-tuning 1 558 140 61 -27%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.