AI World 5 · Serve and Secure · Stage 1

Pick the Endpoint

Loan decisions in 100 ms, a 40 MB scan that takes 20 minutes, 30 million rows overnight, five calls an hour, a GPU model and 400 tenants: one endpoint type each.

Real-time, serverless, asynchronous
Batch transform
Multi-model endpoints

Domain: AI and machine learning
World: AI World 5: Serve and Secure (Associate)
Game type: Solution board: Drop services into each row's slots, then run records through them.
Time: About 15 minutes on a first attempt (estimated)
Exam guides: AIF-C01Task 1.1: Explain basic AI concepts and terminologies; Task 1.3: Describe the AI/ML development lifecycle
MLA-C02Skill 3.1.1: Select appropriate compute environments and deployment targets; Skill 3.1.3: Select model inference strategies (for example, real-time and batch processing); Skill 3.1.7: Configure FM deployment, model hosting, and resource allocation
AIP-C01Skill 2.2.1: Deploy FMs based on specific application needs and performance requirements (for example, by using Lambda functions for on-demand invocation, Amazon Bedrock provisioned throughput configurations, SageMaker AI endpoints to implement hybrid solutions); Skill 2.2.2: Deploy FM solutions by addressing unique challenges of large language models (LLMs) that differ from traditional ML deployments (for example, by implementing container-based deployment patterns that are optimized for memory requirements, GPU utilization, and token processing capacity, by following specialized model loading strategies)