IntermediateAWS Data Engineer Associate project · about 14 hours

Streaming events on AWS

Stream click or delivery events, process them and show near real-time results.

The real-world brief

A logistics company wants delivery status within seconds.

What you will build

  • An event producer
  • A streaming job
  • An output table
  • A live dashboard

Skills you will practise

StreamingWindows and aggregationsLate dataDashboards

Tools

Amazon Kinesis Data StreamsAmazon Managed Service for Apache FlinkAmazon DynamoDB or Amazon RedshiftAmazon QuickSight

Project tasks

The detailed steps, checklists and trainer review open in the SOTT student portal for enrolled students.

1Produce Steps in portal
2Process Steps in portal
3Store Steps in portal
4Show Steps in portal

How companies use AWS Data Engineer Associate

Retail: One view of sales. Sales, stock and online data sat in separate systems. Pipelines load all sources into one warehouse with cleaned, modelled tables. Everyone uses the same numbers.

Logistics: Live delivery tracking. Delivery status updated once a day. Streaming events land in the data platform within seconds and feed dashboards. Customer service sees each parcel in real time.

Healthcare: Governed patient data. Analysts copied sensitive data into spreadsheets. Access controls, masking and lineage in a governed platform. Analysts get the data they need without uncontrolled copies.

Questions

Can I add the Streaming events on AWS project to my resume?

Yes. Once your trainer approves it, list it under Projects with the tools you used, one line on the problem it solves and a link to your repository and demo video.

How long does this project take?

About 14 hours of hands-on work, and it fits best after week 8 of the AWS Data Engineer Associate (DEA-C01) course.

Where do I get the step-by-step tasks?

Enrolled students get every task with steps, "done when" checks, the submission form and a trainer review in the SOTT student portal.