Insights on Continuous Testing: Test‑First Mindset, Automation, Culture, and AI/ML

When adopting a continuous testing (CT) approach, good design is essential; testing is no longer an afterthought.

Alan Page, former Microsoft engineering director and current Unity Technologies director, emphasizes a test‑first mindset and discusses the importance of test‑driven development, common CT challenges, principles, and the future of AI/ML in testing.

Advice for developers:

Test‑first mindset. Considering tests while writing code leads to more testable code.

Hire test experts. Employ specialists who can guide and influence testing culture within development teams.

Automate 100% of feasible tests. Identify which tests can be automated, especially unit and integration tests.

Avoid flaky tests. Unstable tests produce inconsistent results.

Keep it simple. Complex code is hard to test; establish clear quality responsibilities.

One major challenge is talent shortage; Page dissolves traditional test teams, embedding test expertise within development to improve efficiency.

Regarding automation vs. manual testing, he advocates automating all tests that can be automated and minimizing manual effort, designing software for easy automation.

To overcome cultural barriers, he stresses clear developer responsibilities and involving a few test experts to champion quality.

Common mistakes include over‑automating UI tests, dealing with flaky tests, and writing overly clever test code that becomes unmaintainable.

AI/ML currently excels in UI testing, but future opportunities lie in generating large numbers of test cases from real user behavior data.

Looking ahead, continuous testing, integration, and deployment aim to tighten feedback loops and accelerate delivery.