Data World 6 · Pipeline Detective · Stage 5

Stream Is Lagging

Four tickets on one stream: read the metrics and the logs, then the shard, the sink, the record and the buffer.

  • IteratorAge
  • Read throttling
  • DynamoDB write capacity
  • Poison records
  • Firehose freshness
Domain
Data engineering
World
Data World 6: Pipeline Detective (Associate)
Game type
Evidence desk: Each ticket is the reporter's words: find its cause in the evidence.
Time
About 25 minutes on a first attempt (estimated)
Exam guides
  • DEA-C01Skill 1.1.7: Call a Lambda function from Kinesis; Skill 1.1.9: Implement throttling and overcoming rate limits (for example, DynamoDB, Amazon RDS, Kinesis); Skill 1.1.10: Manage fan-in and fan-out for streaming data distribution; Skill 1.4.2: Configure Lambda functions to meet concurrency and performance needs; Skill 3.3.4: Troubleshoot performance issues; Skill 3.3.8: Analyze logs with AWS services (for example, Athena, Amazon EMR, Amazon OpenSearch Service, CloudWatch Logs Insights, big data application logs)