GitHub - modular/max-agentic-cookbook: MAX Agentic Cookbook

The MAX Agentic Cookbook is a modern full-stack application designed to showcase the agentic AI capabilities of the Modular MAX as a comprehensive LLM serving solution. Built using FastAPI for the backend in Python and React with TypeScript for the frontend, the app is structured for developer familiarity and flexibility, featuring a modular architecture with distinct recipe components for functionalities like multi-turn chat and image captioning. It requires Python 3.11 or higher and Node.js 22.x or higher, with a setup that includes cloning the repository, configuring LLM endpoints, installing dependencies, and running the app using either VS Code or Docker. The backend leverages FastAPI and uvicorn, and includes various endpoints for health checks, listing recipes and models, and executing chat or image captioning tasks. The frontend utilizes React 18, Vite, and a range of technologies like React Router and Mantine for UI development, supporting features such as lazy loading and automatic data fetching. The app is designed to be run with a compatible GPU for optimal performance, and the repository includes guides for contributing, architecture, and Docker deployment, all under the Apache-2.0 WITH LLVM-exception license.