Data Engineer · Step 1 of 8 · 6 min
What a data engineer does
Tell the data engineer, analyst and scientist apart, and know which one you want to be.
The plumbing behind every dashboard
Every chart in a company sits on top of data that someone collected, cleaned and stored. That someone is the data engineer. You build the systems that move data from where it is created, like apps, sales tools and sensors, to where it is used.
When you do the job well, nobody notices. The numbers are there each morning, they are correct, and they arrive on time. When it goes wrong, everyone notices at once.
Three roles, one team
A data analyst answers business questions with data: why did sales drop, which product sells best. A data scientist builds models that predict or classify: who is likely to cancel, what to recommend next.
A data engineer makes both possible. You own the pipelines, the storage and the reliability. In small companies one person may do all three. In larger ones the lines are sharper, and the engineer is closest to software engineering.
What a normal week looks like
You write SQL and Python. You add a new data source, fix a pipeline that failed overnight, speed up a slow query, and agree with an analyst on what a column really means. You spend more time on data quality and naming than on clever code.
The tools change every few years. The ideas in this track do not: model data clearly, move it reliably, test it, and make failures loud.
What you need to start
Basic SQL, some Python, comfort with the command line, and patience with messy data. You do not need a degree in computer science. You do need to enjoy finding out why two numbers that should match do not.
Try it
Trace one number to its source
- 1.Pick a number you see often, such as your monthly phone bill or a sales total at work.
- 2.Ask a chatbot the prompt below, filling in your example.
- 3.Read the answer and circle the steps where a data engineer would be involved.
I see this number regularly: [describe it]. Walk me through, step by step, how the data behind it was probably created, moved, stored and calculated before it reached me. Mark which steps a data engineer, a data analyst and a data scientist would own.