AI Engineer
Tell me about a time you had to tell a stakeholder that an AI feature wasn't reliable enough to launch. How did you handle it?
What the interviewer is looking for
- This question tests product & user focus. Ties AI features to real user problems, is honest about reliability and pushes back on launches that would hurt users.
- What to bring out: Shows evidence from evaluation, explains user impact, offers alternatives like a narrower scope or human review, and agrees a path.
- Expect a follow-up like: What did the eventual launch look like?
Another way it may be asked: Leadership wants the AI feature live for a big announcement, but it's wrong too often. What do you say and do?
A structure to follow: STAR, with the weight on Action and Result
- Step 1
Situation
One or two sentences: where, when and what was at stake. Pick a real example you were close to.
- Step 2
Task
What you personally were responsible for. Say "I", not only "we", so the product & user focus you showed is visible.
- Step 3
Action
The two or three things you did and why you chose them over the alternatives. This should be about half your answer.
- Step 4
Result
What changed, in your own measure of it, and what you would do differently. Only use numbers you can stand behind.
This is guidance on shape, not a script. Use your own real experience and facts; never invent details to fill a gap. See the STAR guide and answer frameworks.
Common slips
- Describing what the team did without saying what you did.
- Choosing an example with no clear outcome, or one you cannot answer detailed questions about.
- Ending on the action and skipping the result and what you learned.
How to practise it
Write two bullet points for each STAR letter, then say the answer aloud in about two minutes.
Related questions
- In simple terms, what is retrieval augmented generation, and why would you use it instead of just asking a language model directly?
- A chatbot you built keeps giving long rambling answers. What would you change first?
- What is prompt injection, and how might it affect an assistant that reads customer emails?
- Your document search assistant often answers using the wrong document. How would you debug and improve retrieval?
- How do you evaluate whether a change to a prompt or model actually made your application better?