Building Hacker News Trends with Upstash Redis Search

Hacker News Trends is a tool that visualizes the frequency of terms discussed on Hacker News over time, similar to Google Trends, by leveraging a Redis database to store and analyze 45 million posts and comments. The tool uses Upstash Redis Search to create trend lines and perform full-text searches, with the data ingested from monthly Parquet dumps of the Hacker News dataset on Google BigQuery. The process involves creating an index with a schema, querying data using specific filters, and ordering results by relevance based on a custom scoring function that considers text matches, upvotes, and comments. This setup allows for an efficient and global search experience, powered by Upstash Redis, which operates across multiple regions without requiring dedicated infrastructure. The tool's code and underlying processes are open source, enabling others to replicate or build upon the system, with additional resources provided through the Upstash Redis Search documentation and the live demonstration available on hackernewstrends.com.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.