Company
Date Published
Author
Meghan Gill
Word count
535
Language
English
Hacker News points
None

Summary

PublishThis, a company that crawls the internet for content and scores it based on relevancy, uses MongoDB Management Service (MMS) to optimize its big data workload. The company's crawler indexes 300,000 web sources daily, pulling data into a sharded MongoDB deployment. To manage performance, PublishThis' Director of Data Services, Dr. Chris Lane, uses MMS to monitor the system and identify bottlenecks. He reduced chunk size as a quick fix while waiting for a SAN, which improved performance significantly. With MMS, PublishThis delivers real-time content at scale by managing massive volumes with its industry-leading relevancy engine. The company offers tips on monitoring with MMS, including setting up simple dashboards and running multiple agents on different hosts. MMS provides valuable insights into infrastructure and is free to use, allowing users to visualize performance within minutes.