Data World 3 · Streams in Motion · Stage 1

Pick the Stream

Five flows, five shapes: a log many read, a pipe into S3, Kafka as it is, a window, a queue.

  • Kinesis Data Streams
  • Amazon Data Firehose
  • Amazon MSK
  • Managed Service for Apache Flink
  • Amazon SQS
Domain
Data engineering
World
Data World 3: Streams in Motion (Associate)
Game type
Solution board: Drop services into each row's slots, then run records through them.
Time
About 15 minutes on a first attempt (estimated)
Exam guides
  • SAA-C03Task 3.5: Determine high-performing data ingestion and transformation solutions; Task 2.1: Design scalable and loosely coupled architectures
  • DEA-C01Skill 1.1.1: Read data from streaming sources (for example, Amazon Kinesis, Amazon Managed Streaming for Apache Kafka [Amazon MSK], Amazon DynamoDB Streams, AWS DMS, AWS Glue, Amazon Redshift); Skill 1.1.10: Manage fan-in and fan-out for streaming data distribution; Skill 1.1.11: Describe replayability of data ingestion pipelines; Skill 1.2.9: Define volume, velocity, and variety of data (for example, structured data, unstructured data); Skill 2.1.1: Implement the appropriate storage services for specific cost and performance requirements (for example, Amazon Redshift, Amazon EMR, AWS Lake Formation, Amazon RDS, Amazon DynamoDB, Amazon Kinesis Data Streams, Amazon Managed Streaming for Apache Kafka [Amazon MSK])
  • MLA-C02Skill 1.1.4: Use AWS streaming data sources to ingest data (for example, by using Amazon Kinesis, Apache Flink, Apache Kafka)