Systems | Development | Analytics | API | Testing

AI was supposed to be the game-changer for developer productivity, but reality isn’t living up to the hype. GPT-4 took 50x the resources of GPT-3.5, yet the improvement? Barely noticeable. AI-generated code isn’t saving time—it’s creating more debugging, security headaches, and compliance risks. The real issue? It’s not the AI—it’s how we’re using it. AI isn’t freeing up developers for innovation—it’s adding more noise. So, what’s the fix? Catch the full conversation on the latest Test Case Scenario.

AI is reshaping development, but is it meeting expectations? In this episode of Test Case Scenario, Jason Baum and Marcus Merrell explore the evolving role of AI in software development, drawing insights from recent industry reports. They discuss whether AI tools are living up to their promise of reducing burnout and boosting productivity while examining the complexities of debugging, security risks, and governance gaps.

AI is being treated as a shortcut for quality. Is that a dangerous gamble? There are a few industry-wide experiments happening right now: Developers are being pushed to own quality, but without dedicated testers, gaps are forming. AI is being used as a crutch for testing, but can it actually replace critical thinking? The real risk? We won’t know how badly this approach fails until it’s too late.

AI isn’t a shortcut to perfect testing. It won’t magically fix your processes or write flawless code. But if used right, it will push testers and developers to think more critically. Instead of asking if AI should be part of testing, the real question is how to make it a true collaborator. That means: Using AI to highlight gaps, not blindly trusting its output Treating it as a thought partner, not an automation machine.

According to Cristiano Caetano, VP of Product Management at Katalon, human intuition is irreplaceable in this field. It is better to leverage AI for repetitive and labor-intensive tasks while using the freed up bandwidth to focus on strategy - things machines can't replicate. Stay tuned for upcoming episodes in our series!

AI isn’t replacing testers—it’s becoming an extension of how they think. Here’s how @Maaret Pyhäjärvi sees it: Applications make us more creative, acting as an “external imagination.” Testers do the same for developers—when devs anticipate tester feedback, their testing improves. AI, when used right, serves a similar role: it challenges us to refine and rethink, not just automate. The real power of AI in testing?Doing the work for usPushing us to think better.