Describe a search test you ran where the result surprised you. What did you do next?

What the interviewer is looking for

• This question tests curiosity & experimentation. Describes tests they designed, what they measured, and how they changed course based on results instead of relying on assumptions.
• What to bring out: Describes a clear hypothesis, a controlled test, honest interpretation of the surprise, and how it shaped later work.
• Expect a follow-up like: How did you make sure the result was not just noise or seasonality?

Another way it may be asked: Think of a time you changed something on a site expecting one result and got another. What happened and how did you react?

A structure to follow: STAR, with the weight on Action and Result

1. Step 1

   Situation

   One or two sentences: where, when and what was at stake. Pick a real example you were close to.

2. Step 2

   Task

   What you personally were responsible for. Say "I", not only "we", so the curiosity & experimentation you showed is visible.

3. Step 3

   Action

   The two or three things you did and why you chose them over the alternatives. This should be about half your answer.

4. Step 4

   Result

   What changed, in your own measure of it, and what you would do differently. Only use numbers you can stand behind.

This is guidance on shape, not a script. Use your own real experience and facts; never invent details to fill a gap. See the STAR guide and answer frameworks.

Common slips

• Describing what the team did without saying what you did.
• Choosing an example with no clear outcome, or one you cannot answer detailed questions about.
• Ending on the action and skipping the result and what you learned.

How to practise it

Write two bullet points for each STAR letter, then say the answer aloud in about two minutes.

Related questions

• How do you keep up with changes to how search engines rank pages, and what is something you learned recently?
• How would you figure out which search terms a small local bakery should try to rank for?
• If you were handed a product page that gets no search traffic, what are the first things you would check on the page itself?
• Organic traffic drops by thirty percent overnight across the whole site. Walk me through how you would investigate.
• Tell me about a time you had to prove the value of your search work to someone who only cared about revenue.

Browse all questions