August 2023 Summaries

Codeium has achieved SOC 2 Type I compliance, confirming through a third-party audit by Prescient Assurance that it adheres to stringent security and privacy practices. SOC 2, a critical audit for companies managing customer data, evaluates five Trust Service Criteria: security, availability, confidentiality, processing integrity, and privacy. This compliance reinforces Codeium's dedication to data protection, including encryption and not using user data for training their models. While other AI tools like GitHub Copilot, Amazon CodeWhisperer, and Sourcegraph Cody have varying levels of security measures, they lack SOC 2 compliance. Codeium stands out by ensuring robust security measures and plans to pursue further compliance with SOC 2 Type II attestation, solidifying its position as a secure generative AI tool for software developers.

Updating your JetBrains IDE, which includes popular options like IntelliJ, PyCharm, and Webstorm, now grants access to a ChatGPT-like experience directly within the IDE, offering full codebase awareness. Initially developed for Visual Studio Code, the integration process involved refining user experience features such as diff view and insertions. Recognizing that not all IDEs have built-in space for a chat panel like Visual Studio Code, developers created a browser-based system to facilitate integration across the 40+ IDEs supported by Codeium. This development has now been extended to JetBrains' suite of IDEs, providing a seamless in-IDE chat experience for users.

GitHub Copilot for Business is a SaaS tool that sends code snippets to GitHub/OpenAI servers for model inference, ensuring zero data retention and encryption during transit, similar to other AI-powered code assistants like Codeium Teams. While GitHub plans to conduct a penetration test in late 2023, the tool currently lacks real-time analytics for administrators, unlike Codeium, which provides comprehensive dashboards for monitoring and optimizing tool usage. GitHub Copilot is notable for its low latency in suggestions, crucial for developer productivity, but it offers limited out-of-the-box support and training, often leaving enterprises to navigate fragmented online resources. Despite these limitations, GitHub Copilot remains influential in the AI tooling landscape, but enterprises should carefully consider security, legal, and functionality aspects before adoption.

In July, efforts were concentrated on enhancing the functionality of Codeium for both new and existing users by integrating support for popular IDEs like Visual Studio and Eclipse, responding to significant demand from developers. The improvements include advanced context awareness, which personalizes autocomplete and chat results based on the user's existing codebase, reducing inaccuracies. In anticipation of August, the team is preparing to launch larger and more capable autocomplete models, promising better performance without increased latency due to enhanced inferencing infrastructure. Additionally, a new JetBrains Chat feature is set to be announced, aiming to expand its availability across other supported IDEs. The ongoing positive feedback from the developer community encourages the continuous development of powerful, free generative AI tools.

Codeium has developed an advanced context-aware system for its enterprise AI code assistant tool, surpassing competitors like GitHub Copilot and Amazon Codewhisperer by effectively integrating real-time context retrieval. This system addresses challenges such as cross-domain context retrieval, context fragmentation, entity rarity, and latency constraints by employing methods like multi-key retrieval, hybrid retrieval, and two-stage retrieval processes. Unlike other solutions, Codeium operates entirely locally, ensuring privacy and eliminating the need for additional subscriptions or configurations. The initiative, "Context Aware Everything," aims to enhance Codeium's generative AI capabilities by making it an expert on users' codebases. This is the first in a series of features designed to improve Codeium's performance, with more technical insights and developments planned.