Data Analytics interview prep.

Behavioural questions to expect

1. Walk me through your CV.
2. Tell me about the analysis or experiment you're proudest of.
3. Tell me about a weakness, a failure, or feedback you've received and worked on.
4. Why data analytics at an AI firm vs data science or analytics engineering elsewhere?
5. Which team or analytics area would you want to focus on - product, growth, ML, business analytics?
6. Why the firm?
7. How would you describe the firm's data + analytics setup in your own words?
8. How does analytics actually create value at an AI-product firm?

Technical concepts to master

• SQL + warehouse fluency

  Window functions · CTEs + query structure · Joins + edge cases · Warehouse + dbt

• Experimentation rigor

  Hypothesis + primary metric · Power + MDE + sample size · Guardrails · Validity threats - novelty, interference, contamination

• Metric design + diagnosis

  North Star + input metrics · Leading vs lagging metrics · Metric decomposition · Confound elimination

• AI-product analytics specifics

  Eval methodology · LLM-as-judge · Quality drift + monitoring · Token economics + cost analytics

Practical drills

• Walk me through the SQL to compute weekly retention cohorts for the last 12 weeks, segmented by signup channel, with a rolling 4-week active rate per cohort.
• Design the A/B test for the firm shipping a new model variant in the assistant. Walk me through hypothesis, metrics, power, validity threats, decision.
• the firm's daily active users dropped 5% week-over-week. Walk me through how you'd diagnose, in 15 minutes.

Smart-question anchors

• Data stack + tooling - warehouse, transformation, BI, experimentation platform
• Experimentation maturity - sample-size policy, guardrail framework, novelty + interference handling
• AI-product metrics + eval - quality measurement, LLM-as-judge, drift monitoring, abuse signals
• Cross-functional partnership - analyst + PM + ML + GTM working model
• Decision culture - data-driven vs intuition, how analytics influences strategy + roadmap

Sourced from

Interview Query - Data Analyst Interview Guide · DataLemur - SQL + Analytics Interview Questions · Ronny Kohavi - Trustworthy Online Controlled Experiments · Statsig + Eppo - Experimentation Platform Documentation · LangSmith + Arize - LLM Evaluation Documentation · Bessemer + a16z - AI Product Metrics Playbook