Home / Companies / CircleCI / Blog / September 2025

September 2025 Summaries

12 posts from CircleCI

Filter
Month: Year:
Post Summaries Back to Blog
The text details a comprehensive tutorial on building an AI-powered email automation system using Next.js, Nodemailer, MongoDB, and AI text generation services like RapidAPI. The system automates sending personalized welcome emails and newsletters to subscribers, incorporating AI to generate relevant content. The tutorial guides users through setting up a Next.js application, connecting it to a MongoDB database, and configuring an SMTP service for email delivery. It also explains the integration of AI for crafting email content and the use of CircleCI for continuous integration and deployment, ensuring automated scheduling and deployment. Finally, the project is deployed on Vercel, making it publicly accessible. The tutorial concludes by highlighting potential enhancements such as tracking email engagement and offering content preferences to users, positioning the project as a robust foundation for advanced email automation tasks.
Sep 30, 2025 4,285 words in the original blog post.
Retrieval-Augmented Generation (RAG) is a transformative approach for enhancing interactions with Large Language Models (LLMs) by grounding responses in external knowledge to improve accuracy and reduce errors. Traditional RAG systems are limited to text processing, but multimodal RAG overcomes this by integrating text, images, and potentially audio, creating a more comprehensive understanding similar to human sensory integration. This tutorial guides the construction of a multimodal RAG application using Google’s Gemma 3 model served via Ollama, which processes PDF documents containing both text and images. The application employs Qdrant as a vector store, creates an interactive UI with Streamlit, and is deployed to Google Kubernetes Engine (GKE) using CircleCI, resulting in a scalable system that allows users to query document content irrespective of format. The process involves setting up a GKE cluster, creating Docker containers, and deploying services using Kubernetes, while CircleCI automates the build and deployment pipeline to ensure a streamlined workflow.
Sep 29, 2025 5,207 words in the original blog post.
The text outlines a comprehensive tutorial for building a CI/CD-driven ETL (Extract, Transform, Load) pipeline that processes cryptocurrency data using the CoinGecko API, with the final output being a Markdown file showcasing the top 10 cryptocurrencies by market cap. This file is automatically uploaded to an AWS S3 bucket using CircleCI for continuous integration and delivery. The guide covers the setup of necessary accounts and dependencies, detailed coding instructions for the ETL process—comprising data extraction, transformation, validation, and loading—along with the CircleCI configuration to automate these tasks. It also includes steps for configuring AWS identity and environment variables to facilitate secure data uploads. By following this tutorial, users can efficiently create a live cryptocurrency report that is maintained entirely through code and cloud infrastructure, offering opportunities for further customization such as email alerts, HTML dashboards, and trend charts.
Sep 26, 2025 2,935 words in the original blog post.
The guide provides a comprehensive walkthrough on building and deploying a serverless data processing workflow using AWS Step Functions and AWS Lambda, enhanced by CircleCI for continuous integration and deployment. The approach involves creating discrete Lambda functions for specific tasks in a data pipeline, orchestrated by AWS Step Functions, which allows for visual or JSON-based workflow logic definition. The guide emphasizes automating the testing and deployment process using CircleCI, which validates code through unit tests, enforces code quality standards, and facilitates automatic deployment on every push to the main branch. It details the prerequisites needed, including setting up an AWS account, configuring the AWS CLI, and understanding AWS Step Functions. The tutorial covers setting up the project environment, implementing and deploying three AWS Lambda functions, creating IAM roles, and configuring S3 triggers, culminating in a fully functioning CI/CD pipeline that ensures the data processing pipeline remains up-to-date and reliable.
Sep 26, 2025 3,974 words in the original blog post.
The text is a comprehensive guide for developers on building a query routing agent that can intelligently direct questions to either a SQL database or a document repository, such as Wikipedia, based on the nature of the query. This system allows users to ask natural language questions about U.S. states and receive accurate answers, whether they are factual data like population or descriptive content like historical attractions. The tutorial covers setting up the development environment, including necessary tools and accounts, creating and managing data sources and indices, and implementing the ReAct agent pattern for intelligent query routing. It also guides on building a user interface using Streamlit, containerizing the application with Docker, and setting up a CI/CD pipeline with CircleCI for deployment on Google Cloud Run. Additionally, it discusses monitoring using Google Cloud's built-in tools and emphasizes best practices for security and performance. The tutorial aims to provide a flexible framework that can be extended with additional data sources and enhanced routing logic for a seamless and comprehensive user experience.
Sep 25, 2025 4,318 words in the original blog post.
Security and compliance teams often face challenges in identifying suspicious activities in their development pipelines promptly, leading to vulnerabilities and delayed incident responses. Manual audit log requests can create bottlenecks and gaps in visibility, which leave organizations susceptible to insider threats and compliance violations. Automated audit log streaming offers a solution by providing a direct pipeline from CI/CD platforms to security infrastructures, ensuring real-time delivery of audit events to tools like Amazon S3. This method allows for immediate threat detection, automated compliance, faster incident responses, and seamless integration with existing security systems. Successful implementation involves setting up an S3 bucket, configuring CircleCI streaming, integrating with security tools, and focusing on high-impact monitoring. By doing so, organizations can reduce manual efforts, enhance compliance, and respond to security incidents more efficiently.
Sep 25, 2025 1,156 words in the original blog post.
The software development industry is experiencing a transformative shift as teams leverage AI to enhance code generation speed, resulting in increased complexity that presents both challenges and opportunities. The key lies not in eliminating complexity but in developing intelligent validation systems that can keep pace with AI's rapid output without dragging down productivity. Traditional continuous integration/continuous deployment (CI/CD) methods are proving inadequate for managing the volume and complexity of AI-generated code, prompting the need for autonomous validation systems like Chunk. Chunk is an innovative solution that optimizes CI/CD workflows by learning from a team’s unique development practices and automating the maintenance of software delivery processes, ultimately freeing developers to focus on more critical tasks. This proactive approach to validation helps prevent disruptions and enhances productivity by identifying and fixing issues autonomously, thereby reducing the time and effort traditionally spent on manual interventions.
Sep 23, 2025 988 words in the original blog post.
The rapid integration of AI in software development has significantly expedited code generation, yet it has not necessarily improved the overall software delivery lifecycle (SDLC), according to recent industry observations. While AI tools enhance the speed of coding, they have also exposed existing bottlenecks in integration, testing, and release processes, leading to stagnation or even a decline in delivery throughput, as reported by Google's DORA research and CircleCI. This mismatch results in either code stagnation, where work piles up waiting for validation, or risky releases that bypass necessary checks, increasing the risk of production issues. The challenge lies in rebalancing the equation where the cost of safely shipping code has increased, despite the cost of writing it decreasing. CircleCI is addressing these bottlenecks by developing autonomous agents and intelligent automation systems to streamline validation, optimize configurations, and enhance CI/CD processes, suggesting that the next frontier for AI is in improving validation, orchestration, and release stages of the SDLC to maintain trust and accelerate delivery.
Sep 19, 2025 1,179 words in the original blog post.
The text discusses the importance of password hashing for online security, emphasizing the balance between security and performance in hashing algorithms. It highlights three popular algorithms—Argon2, BCrypt, and SCrypt—and their respective strengths and weaknesses. Argon2 is praised for its adaptability and strong resistance to modern hardware attacks, BCrypt for its long-standing reliability, and SCrypt for its resistance to specialized hardware attacks. The document details a benchmarking process using Java and CircleCI to evaluate these algorithms' performance across different operating systems (Linux, Windows, macOS) and Java versions (17 and 21). The results show Argon2BouncyCastle as the most balanced performer, SCrypt as fastest on Linux, and BCrypt as consistent across platforms, while Argon2SpringSecurity is noted for its inefficiencies. The study recommends algorithm choice based on specific operational needs, aided by CircleCI's capabilities to automate and streamline the testing process.
Sep 19, 2025 5,424 words in the original blog post.
In Kotlin development, effective dependency management is crucial for maintaining clean and scalable code, often achieved through Dependency Injection (DI), a design pattern that promotes modularity by decoupling class behavior from dependency creation. Dagger is a powerful DI framework used in Kotlin applications to simplify object lifecycle and dependency management. This guide illustrates how DI can be applied in a subscription-based SaaS product, emphasizing contract testing to ensure components meet expected interactions through injected dependencies. It provides a step-by-step tutorial on setting up a project with Dagger, implementing a subscription system with billing and subscription services, and automating contract testing using CircleCI. The guide also includes instructions for configuring the project's environment, defining data models, designing business logic for subscription management, and setting up a CI pipeline on CircleCI to automate testing, ensuring consistency and reliability. This approach enhances code modularity and testability, offering a foundation for integrating additional services or features in the future.
Sep 18, 2025 4,462 words in the original blog post.
CircleCI has expanded its support to include GitLab SaaS and self-managed code repositories, enhancing its offerings for AI-driven workflows and machine learning security automation through continuous integration and delivery (CI/CD) processes. The platform provides tools for improving developer velocity with governance features, resources for iOS and MacOS development, and solutions to prevent pipeline collisions. It also offers comprehensive guides on container security, dynamic application security testing, and zero trust security for CI/CD pipelines. Additionally, CircleCI explores the business value of software delivery, the creation of internal developer portals with Backstage, and provides insights into improving developer experience.
Sep 14, 2025 243 words in the original blog post.
Vector databases, such as Pinecone, enable efficient storage and querying of high-dimensional data, which can be used to enhance language model responses through Retrieval-Augmented Generation (RAG) systems. This tutorial guides readers through building a RAG-powered question-answering application using the Pinecone Python SDK, Flask REST APIs, and Langchain to interface with OpenAI and the Pinecone database. It includes setting up a Python development environment, creating a Pinecone index, and using CircleCI for automated testing and deployment. The tutorial details the process of ingesting documents into the database, querying with a language model, and integrating with Flask to expose functionality via HTTP endpoints. Additionally, it covers deploying the application on Heroku and using CircleCI to automate the testing and deployment pipeline, ensuring a streamlined and efficient workflow for maintaining the QA system.
Sep 02, 2025 2,614 words in the original blog post.