June 2022 Summaries

The author describes their experience with r/place, a collaborative pixel-art project created by Reddit in 2017 and again in April. They were inspired to leverage the power of Algolia's fast indexing and browsing capabilities to create a real-time experiment similar to r/place. Using Algolia's search client, they built an interactive canvas where each record represented a pixel with attributes such as objectID, id, and bg_color (background color). The author used Vercel to host the project and implemented features like user counter, optimistic UI, and real-time collaboration using socket.io. They also addressed security concerns by moving indexing code within NextJS API routes to keep sensitive data secure. The canvas was initially 4020 pixels but later expanded to 36,180 pixels to accommodate more drawings and increase playfulness. The author enjoyed working on this creative project and learned a lot in the process.

A year ago, the Hacker News search engine was launched by Algolia. Since then, it has grown significantly, expanding from 20 million to 25 million indexed items and serving from 900,000 to 30 million searches a month. Alongside hn.algolia.com, the HN Search API is also provided, which has been used by many users to build various readers or monitor tools. The community was active on GitHub, contributing improvements and catching bugs. This motivated Algolia to release a new experimental version of HN Search with enhanced UI best practices for readability and usability. Advanced features such as sorting and filtering results, reading comments directly from the search result page, customizing ranking settings, searching hot stories & comments through a discreet menu item, and starring stories for later searches have been added. The source code of the HN Search website is open-source and hosted on GitHub, with Algolia encouraging contributions via pull requests. User testing and feedback are crucial to making this search engine the favorite among users.

This article delves into three historical attempts at creating cross-platform, fully-featured rich text formats - XML, Markdown, and JSON - and three modern takes on the problem - Notion, ExtraMark, and Sanity's Structured Content. The author discusses the pros and cons of each format, highlighting their flexibility or limitations in representing various types of content. They also provide insights into how these formats have evolved over time and how they are being used today. The article concludes by recommending ExtraMark for Markdown-based projects and Portable Text for everything else.

Natural Language Processing (NLP) and Natural Language Understanding (NLU) are technologies that make search more intelligent by enabling users to find relevant information without typing the exact words found on a page or in a product. NLP processes natural language into a format that computers can understand, while NLU aims to "understand" what a block of natural language is communicating. These technologies help improve recall and precision in search results. Some common NLP techniques include text normalization, stemming, lemmatization, and handling plurals. NLU tasks like named entity recognition (NER) and intent detection can also enhance search quality by identifying key items within a text and determining the user's desired action. Overall, NLP and NLU play crucial roles in improving search experiences for users.

Angular's component-based architecture is useful for developing complex search user interfaces (UIs) tailored to specific needs. The modular design of Angular apps, built with independent components, helps prevent code from becoming messy and confusing. This framework also supports third-party libraries, such as Algolia's InstantSearch library, which can be quickly implemented into the rest of a web app. These libraries are based on widgets that serve as building blocks for search UIs and can be customized to fit specific use cases.