Using AI for testing

// 21 QUESTIONS · UPDATED MAY 2026

Interview questions on AI-assisted testing workflows: using language models to generate and scaffold tests, prompt engineering for test authoring, self-healing selectors, agentic and autonomous testing tools, AI for failure triage and flaky-test detection, test maintenance at scale, and the critical judgment skill — spotting when AI's output is wrong.

Level

Showing 21 of 21 questions

  1. How do you use AI to help generate test cases from a user story?Junior

    Provide the user story and acceptance criteria to a language model and ask it to list test scenarios covering happy path, negatives, and…

  2. What is a self-healing selector in AI-powered test automation?Junior

    A self-healing selector uses AI to recover a broken locator at runtime — when the original selector fails, it searches the DOM using fall…

  3. How do you use AI to generate realistic test data?Junior

    Describe the schema and constraints to a language model and ask it to generate sample records — names, addresses, realistic numeric range…

  4. What are the main risks of using AI-generated tests without reviewing them?Junior

    AI produces plausible-looking tests that may assert the wrong thing, miss real coverage, or bake in bad patterns — hard waits, brittle se…

  5. How do you use AI to help write automated tests, and where does it fall short?Mid

    AI is useful for scaffolding test structure from acceptance criteria, generating test data, explaining failure stack traces, and drafting…

  6. What is prompt engineering for test authoring and how do you structure an effective test-generation prompt?Mid

    Prompt engineering for tests means giving the model enough context to produce useful output: the system under test, the acceptance criter…

  7. How do you use AI to help triage a failing test or analyse a stack trace?Mid

    Paste the test output, stack trace, and relevant test code into a language model and ask it to explain the failure and suggest likely cau…

  8. How would you use AI to migrate a test suite from one framework to another?Mid

    Use AI to do the mechanical conversion — Selenium to Playwright, for example — at a file-by-file level. Provide the source file, the targ…

  9. What are agentic testing tools and how do they differ from traditional automation frameworks?Mid

    Agentic testing tools use an AI agent to plan actions, execute them against a live browser or API, and evaluate outcomes — without a pre-…

  10. How do you use AI for visual regression testing?Mid

    AI-powered visual regression tools compare screenshots using a vision model rather than pixel diff, so they ignore expected rendering var…

  11. How do you use AI to improve test coverage without generating hundreds of redundant tests?Mid

    Use AI to analyse your existing coverage reports and identify untested paths, then generate targeted tests for those specific gaps — not…

  12. How do you use AI to convert manual test cases into automated scripts?Mid

    Feed the manual test case steps to a language model alongside the target framework, existing Page Objects, and locator conventions. The m…

  13. What is the plan-act-verify loop in agentic testing and when would you adopt it?Mid

    Plan-act-verify is the core cycle of AI testing agents: the agent plans the next action based on current state, executes it, then observe…

  14. How do you use AI during code review of test code?Mid

    Use AI to flag common anti-patterns — hard waits, incomplete assertions, shared mutable state between tests, missing negative cases — and…

  15. How do you use AI to detect and diagnose flaky tests?Mid

    Feed per-test result history to an AI model to classify flakiness patterns and rank likely root causes. AI speeds up pattern identificati…

  16. You've adopted an AI test-generation tool — how do you measure whether it's actually helping?Senior

    Measure time-to-first-runnable-test, defect escape rate in AI-covered areas, the correction rate per generated test, and false-confidence…

  17. How do you prevent AI from baking bad patterns into your test suite?Senior

    Define and enforce your conventions before adding AI to the workflow: a style guide for the test suite, lint rules for common anti-patter…

  18. How do you use AI for test maintenance at scale — keeping a large suite current as the application evolves?Senior

    Use AI to identify stale tests (selectors that no longer match the DOM, assertions on removed features), draft updates when you provide t…

  19. What is the difference between AI-assisted testing and agentic/autonomous testing, and how do you decide which to adopt?Senior

    AI-assisted testing uses AI to help engineers write and maintain deterministic scripts. Agentic testing replaces the script with an AI th…

  20. How do you handle AI hallucinations in test-generation output?Senior

    Treat all AI-generated test output as a draft that requires verification against the real system. Hallucinations in tests manifest as ass…

  21. How do you build a team culture that uses AI as a force multiplier without losing engineering judgment?Lead

    Define the mandatory review layer — every AI output must be read and understood by the engineer who commits it. Invest in the skills that…

// Continue exploring

Testing AI systems

How do you test something that never behaves the same way twice? Evaluating LLM and agent features.

Mobile QA

Appium architecture, real devices vs emulators, locator strategies, gestures, CI for mobile.

Accessibility

WCAG, ARIA, screen readers, contrast, keyboard navigation, axe-core, CI integration.