Home / Companies / Confident AI / Blog

Confident AI Blog

76 posts indexed since 2023

Blog URL
Posts YTD
35 ↑ vs 14 last year
Avg Posts/Month
1.6 since 2023
Monthly Post Volume
Monthly post counts
MonthPosts
1-20230
2-20230
3-20230
4-20230
5-20230
6-20230
7-20230
8-20230
9-20230
10-20230
11-20230
12-20230
1-20240
2-20240
3-20240
4-202412
5-20240
6-20243
7-20244
8-20242
9-20241
10-20243
11-20241
12-20240
1-20254
2-20251
3-20251
4-20252
5-20251
6-20251
7-20250
8-20252
9-20251
10-20251
11-20250
12-20251
1-20261
2-20260
3-20262
4-20266
5-20260
6-202613
7-20260
8-20261
9-20266
10-20266
11-20260
Post Details

76 matching posts

Title Author Published Words HN Pts
How to Evaluate LLM Applications: The Complete Guide Jeffrey Ip 2024-04-06 2,312 --
What is Retrieval Augmented Generation (RAG)? Jeffrey Ip 2024-04-06 1,200 1
How to build a PDF QA chatbot using OpenAI and ChromaDB Jeffrey Ip 2024-04-06 1,275 --
Why we replaced Pinecone with PGVector Jeffrey Ip 2024-04-06 1,016 3
Building a customer support chatbot using GPT-3.5 and lLamaIndex Jeffrey Ip 2024-04-06 1,329 --
Generating synthetic data with LLMs - Part 1 Jeffrey Ip 2024-04-06 793 --
A Gentle Introduction to LLM Evaluation Jeffrey Ip 2024-04-06 1,883 --
A Step-By-Step Guide to Evaluating an LLM Text Summarization Task Jeffrey Ip 2024-04-06 1,443 3
Become a Prompt Artist: Understanding the Midjourney LLM Jeffrey Ip 2024-04-06 1,700 --
Why OpenAI Assistants is a Big Win for LLM Evaluation Jeffrey Ip 2024-04-06 1,169 --
RAG Evaluation: The Definitive Guide to Unit Testing RAG in CI/CD Jeffrey Ip 2024-04-14 1,722 4
The Ultimate Guide to Fine-Tune LLaMA 3, With LLM Evaluations Jeffrey Ip 2024-04-19 1,691 --
Using LLMs for Synthetic Data Generation: The Definitive Guide Kritin Vongthongsri 2024-06-11 1,744 1
How to Build an LLM Evaluation Framework, from Scratch Jeffrey Ip 2024-06-24 2,342 2
LLM Testing in 2024: Top Methods and Strategies Jeffrey Ip 2024-06-24 1,958 1
LLM Evaluation Metrics: The Ultimate LLM Evaluation Guide Jeffrey Ip 2024-07-09 4,321 1
An Introduction to LLM Benchmarking Jeffrey Ip 2024-07-17 2,911 --
Evaluating LLM Systems: Essential Metrics, Benchmarks, and Best Practices Jeffrey Ip 2024-07-17 3,747 --
An Introduction to LLM Red Teaming Kritin Vongthongsri 2024-07-30 2,365 --
LLM Benchmarks: Everything on MMLU, HellaSwag, BBH, and Beyond Kritin Vongthongsri 2024-08-19 2,266 1
The Comprehensive Guide to LLM Security Kritin Vongthongsri 2024-08-19 2,366 1
Leveraging LLM-as-a-Judge for Automated and Scalable Evaluation Jeffrey Ip 2024-09-24 2,508 --
LLM Chatbot Evaluation Explained: Top Metrics and Testing Techniques Jeffrey Ip 2024-10-05 2,365 3
How to Jailbreak LLMs One Step at a Time: Top Techniques and Strategies Kritin Vongthongsri 2024-10-30 2,206 --
What is LLM Observability? - The Ultimate LLM Monitoring Guide Kritin Vongthongsri 2024-10-30 2,694 --
The Comprehensive LLM Safety Guide: Navigate AI regulations and Best Practices for LLM Safety Kritin Vongthongsri 2024-11-03 2,342 --
The People's Choice of Top LLM Evaluation Tools in 2025 Jeffrey Ip 2025-01-18 1,829 --
OWASP Top 10 2025 for LLM Applications: What’s new? Risks, and Mitigation Techniques Kritin Vongthongsri 2025-01-19 3,590 --
LLM Guardrails: The Ultimate Guide to Safeguard LLM Systems Jeffrey Ip 2025-01-26 3,024 --
LLM Agent Evaluation: Assessing Tool Use, Task Completion, Agentic Reasoning, and More Kritin Vongthongsri 2025-01-31 2,702 --
How I Built Deterministic LLM Evaluation Metrics for DeepEval Jeffrey Ip 2025-02-09 2,335 --
How I raised Confident AI's $2.2M seed round in 5 days Jeffrey Ip 2025-03-20 1,962 4
Top LLM Evaluators for Testing LLM Systems at Scale Jeffrey Ip 2025-04-22 3,227 --
The G-Eval Guide to LLM Evaluation: Simply Explained Kritin Vongthongsri 2025-04-30 3,925 --
The Ultimate LLM Evaluation Playbook: Why It Didn't Work For You Jeffrey Ip 2025-05-03 3,973 1
RAG Evaluation Metrics: Assessing Answer Relevancy, Faithfulness, Contextual Relevancy, And More Jeffrey Ip 2025-06-04 2,552 --
Confident AI vs OpenLayer: Head-to-Head Comparison Jeffrey Ip 2025-08-29 2,460 --
LLM Arena-as-a-Judge: LLM-Evals for Comparison-Based Regression Testing Deep 2025-08-30 2,299 --
Top LangSmith Alternatives and Competitors, Compared Jeffrey Ip 2025-09-02 3,106 --
AI Agent Evaluation: The Definitive Guide to Testing AI Agents Jeffrey Ip 2025-10-08 5,729 2
The Step-By-Step Guide to MCP Evaluation -- 2025-12-30 3,042 --
Confident AI vs LangSmith: Head-to-Head Comparison -- 2026-01-06 2,719 --
Multi-Turn LLM Evaluation in 2026: What You Need to Know -- 2026-03-22 3,425 --
Announcing Launch Week Q1 '26! Day 1: Automated Error Analysis -- 2026-03-31 908 --
Launch Week Day 2 (2/5): Scheduled Evals -- 2026-04-01 855 --
Launch Week Day 3 (3/5): Auto-Ingest Traces into Datasets & Annotation Queues -- 2026-04-02 958 --
Launch Week Day 4 (4/5): Auto-Categorize Traces & Threads -- 2026-04-03 1,116 --
Launch Week Day 5 (5/5): Generate Datasets from Your Data Sources -- 2026-04-04 1,417 --
Your AI Agent Passed Evals. That’s the Problem. -- 2026-04-06 1,505 --
Three Ways AI Systems Fail Even When Evals Pass -- 2026-04-07 2,856 --
Plushcap, by Matt Makai. 2021-2026.