Models and tools in this field change every few months. How do you decide which new things are worth adopting?

What the interviewer is looking for

• This question tests learning agility. Keeps up with a fast-moving field through hands-on testing and adopts new tools based on evidence rather than hype.
• What to bring out: Tests new options against their own evaluation set, weighs switching costs, and avoids chasing every release.
• Expect a follow-up like: Tell me about something you tried recently and dropped.

Another way it may be asked: A new model or framework comes out every week. How do you choose what to actually try in your work?

A structure to follow: STAR, with the weight on Action and Result

1. Step 1

   Situation

   One or two sentences: where, when and what was at stake. Pick a real example you were close to.

2. Step 2

   Task

   What you personally were responsible for. Say "I", not only "we", so the learning agility you showed is visible.

3. Step 3

   Action

   The two or three things you did and why you chose them over the alternatives. This should be about half your answer.

4. Step 4

   Result

   What changed, in your own measure of it, and what you would do differently. Only use numbers you can stand behind.

This is guidance on shape, not a script. Use your own real experience and facts; never invent details to fill a gap. See the STAR guide and answer frameworks.

Common slips

• Describing what the team did without saying what you did.
• Choosing an example with no clear outcome, or one you cannot answer detailed questions about.
• Ending on the action and skipping the result and what you learned.

How to practise it

Write two bullet points for each STAR letter, then say the answer aloud in about two minutes.

Related questions

• In simple terms, what is retrieval augmented generation, and why would you use it instead of just asking a language model directly?
• A chatbot you built keeps giving long rambling answers. What would you change first?
• What is prompt injection, and how might it affect an assistant that reads customer emails?
• Your document search assistant often answers using the wrong document. How would you debug and improve retrieval?
• How do you evaluate whether a change to a prompt or model actually made your application better?

Browse all questions