Home / Companies / Gretel.ai / Blog / Post Details
Content Deep Dive

Measure the utility and quality of GPT-generated text using Gretel’s new text report

Blog post from Gretel.ai

Post Details
Company
Date Published
Author
Marjan Emadi & Nicole Pang
Word Count
806
Company Posts That Month
6
Language
English
Hacker News Points
-
Summary

Gretel has introduced a Synthetic Text Data Quality Report that measures semantic and structural similarity between AI-generated text and training text in 50 languages. The report includes the Text SQS, which estimates how well the generated synthetic data maintains the same semantic and structural properties as the original dataset. This score can be viewed as a utility or confidence score for drawing scientific conclusions from the synthetic dataset. The report compares Amazon product reviews with synthetic text from Gretel's GPT-x model. It provides recommendations based on the Text SQS, helping users understand its implications and how to improve it if necessary.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
AI Model Fine-tuning 1 440 79 49 +160%
Vector Search 1 1,477 156 68 +31%