Presented by AWS: Bringing Clarity to GenAI Operations: Tackling Scale and Compliance Challenges with Datadog and AWS

Managing GenAI workloads across multiple AWS accounts and regions presents unique challenges, particularly in regulated industries where visibility and accountability are critical. In this session, we’ll discuss how AWS worked alongside a regulated industry customer to build and scale their adoption of Generative AI. By leveraging distributed tracing and LLM observability with Datadog, the customer gained increased visibility into usage patterns and real-time activity, enabling them to understand what was happening, when, and at what cost. See how AWS and Datadog together help organizations establish accountability and support compliance for complex GenAI workflows.