Home / Companies / Dagster / Blog / Post Details
Content Deep Dive

A Dagster-Powered Spam Filter

Blog post from Dagster

Post Details
Company
Date Published
Author
James Timmins
Word Count
3,388
Company Posts That Month
8
Language
English
Hacker News Points
-
Post removed?
No
Summary

A Dagster-powered spam filter was built using a Bag of Words model, which uses lists of spam and non-spam messages to determine whether a message is spam or not. The model was trained on an SMS spam dataset from Kaggle and used to score new messages against a test dataset. A job was created in Dagster to rebuild the model every month by integrating user messages from the application and comparing it to the previous month's model. The updated model was saved to a file and stored in a database table to keep track of the current model, which is compared to the previous model to promote the new one if it scores better. The API endpoint was created using Flask to expose the spam filter to users, and testing was done using cURL to try different messages to see if they get flagged as spam.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 1 2,134 271 94 -26%
Serverless 1 395 102 60 -55%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.