Home / Companies / New Relic / Blog / Post Details
Content Deep Dive

Deploy DeepSeek models locally and monitor with New Relic AI Monitoring

Blog post from New Relic

Post Details
Company
Date Published
Author
Lavanya Chockalingam, Principal Product Marketing Manager
Word Count
1,288
Language
English
Hacker News Points
-
Summary

Advancements in AI models, such as DeepSeek-R1 and DeepSeek-V3, are democratizing AI development by providing cost-effective, high-performing solutions accessible to developers globally. These models, distinguished by innovative architectures like the mixture-of-experts (MoE), offer efficient performance in tasks like reasoning while minimizing computational costs. New Relic's AI monitoring now supports DeepSeek models, enhancing developers' ability to track performance, quality, and costs in real-time, thus facilitating informed transitions between models. The integration with New Relic allows for comprehensive visibility into application performance, offering tools for real-time monitoring, deep tracing, and model comparison to aid in selecting the most suitable AI model for specific needs. The open-source nature of DeepSeek models and their compatibility with tools like Ollama for local deployment further bolster their attractiveness, providing scalable solutions without significant expenses.