Play free

Data World 6 · Pipeline Detective · Stage 2

Watch the Pipes

A rule for the state, a timeout for the hang, an alarm for the lag, and logs you can read while it runs.

  • Glue job events
  • Job timeouts
  • CloudWatch alarms
  • Continuous logging and the Spark UI
  • SNS
Domain
Data engineering
World
Data World 6: Pipeline Detective (Associate)
Game type
Lake tuner: Tune a lake's tables until the queries fit their limit and budget.
Time
About 25 minutes on a first attempt (estimated)
Exam guides
  • DEA-C01Skill 3.3.2: Deploy logging and monitoring solutions to facilitate auditing and traceability; Skill 3.3.3: Use notifications during monitoring to send alerts; Skill 3.3.7: Use Amazon CloudWatch Logs to log application data (with a focus on configuration and automation); Skill 3.3.4: Troubleshoot performance issues; Skill 1.3.4: Use notification services to send alerts (for example, Amazon SNS, Amazon SQS); Skill 3.1.9: Manage events and schedulers (for example, Amazon EventBridge)