Data Engineer
What checks would you put on a new data source before analysts start relying on it?
What the interviewer is looking for
- This question tests data quality & testing. Lists concrete checks such as freshness, uniqueness, row counts and schema tests, wired into the pipeline with someone alerted on failure.
- Strong answers: Freshness, row count, null and uniqueness checks, accepted values and schema tests run automatically with alerts to an owner.
- Likely follow-up: When one of those checks fails at three in the morning, what should happen?
Another way it may be asked: A new sales feed is about to go live and people will build reports on it. How would you make sure the data can be trusted?
A structure to follow: Answer, explain, example, limits
- Step 1
Answer
Give your direct answer in the first sentence so the interviewer knows where you are going.
- Step 2
Explain
Say how it works or why you would do it that way, in plain words before jargon.
- Step 3
Example
Anchor it in something you have actually done or seen, with the detail that shows hands-on experience.
- Step 4
Limits
Say when your approach would not be the right one. It shows judgement.
This is guidance on shape, not a script. Use your own real experience and facts; never invent details to fill a gap. See the STAR guide and answer frameworks.
Common slips
- Reciting a definition without showing you have applied it.
- Using terms you cannot explain if asked a level deeper.
- Claiming experience beyond what you can discuss in detail.
How to practise it
Say the answer in 90 seconds, then answer the follow-up as if it were a new question.
Related questions
- How do you deal with upstream application teams changing their database schema and breaking your pipelines?
- Can you explain the difference between a fact table and a dimension table, and when you would use each?
- If you had to load a daily file from a partner into a warehouse, how would you make sure running the job twice doesn't create duplicate rows?
- Tell me about a time a Spark or similar distributed job was slow or failing. How did you find the cause and what did you change?
- How do you structure dependencies and retries in an orchestration tool like Airflow or Dagster so that one failure doesn't cascade into a mess?