We operate 30,000 job boards across every US state and geography, serving 300 million job seekers in 150 countries. Our business model relies on search results and domain ties, making it critical to ensure Google's web-crawler bot can process our sites quickly and thoroughly to index all content. However, we previously didn't know that Google was missing subsequent pages of jobs due to a crawlability issue. After deploying New Relic, we gained insights into Google bot traffic, realized other bots were generating high amounts of traffic impacting infrastructure costs, and could now log everything without enormous costs or logging less to save money. This led to discovering the crawlability issue, fixing it, generating 20% more revenue in a month, reducing cloud infrastructure costs by 30%, and sharing data across the company for decision-making purposes.