Datadog Observability Pipelines provides an on-prem solution to automatically redact sensitive information within your infrastructure, helping you protect confidentiality and comply with data protection laws. The Sensitive Data Scanner integration detects and redacts standard patterns in logs, including secrets and credentials, credit card numbers, personally identifiable information, and network and device information. To improve accuracy, users can define keyword dictionaries and configure secondary validations for credit card numbers. Additionally, custom scanning rules can be created to identify unique sensitive data not covered by OOTB rules. The Observability Pipelines Worker runs inside your infrastructure, scrubbing logs in real-time, allowing you to safely ship redacted logs to external destinations.