AWS provides best practices documentation that outlines numerous services like Lambda, Glue, Quicksight, and Athena, but users must tie these services together to gain insights into their data, which can be challenging due to the lack of ability to search across data. To overcome this challenge, customers are moving their logs out of Amazon S3 using tools like Elasticsearch and the ELK Stack, but they soon realize that managing large volumes of data becomes expensive in terms of both capital and human resources. A new solution called CHAOSSEARCH offers a fully managed service that integrates with S3 buckets, indexes data back into the account, and provides highly compressed storage, allowing users to derive value from their data without having to move it out of S3. This approach enables users to continue using existing tools like Kibana, as CHAOSSEARCH extends the Elasticsearch API on top of the user's data on Amazon S3.