STAREAST 2025 - AI/ML

Wednesday, April 30

Kevin Pyles
FamilySearch
W1

AI/ML SDET: A Title Change or a New Role?

Wednesday, April 30, 2025 - 11:30am to 12:30pm

Artificial Intelligence/Machine Learning Software Development Engineer in Test. What a title! But what does that person even do? Are they using AI/ML to test software? Are they testing AI or ML? This isn’t just a title change for a software tester, this is really a mind shift and tool change. What if you don’t even have a UI in which to test your product? What if you don’t ship a UI or even a product? The world of software is changing with advancements in AI/ML and it is time to make sure we level up our testing abilities to match the revolution. Join Kevin as he walks you through his...

W7

Is Your Playbook for Generative AI in Test Automation on Point?

Wednesday, April 30, 2025 - 1:30pm to 2:30pm

Generative AI allows us to create test automation scripts really fast, but how can we be sure the outcome is truly complete? In this talk, Julio will discuss the critical process of how to define your prompts and evaluate if the results from AI-driven test automation creation cover all the necessary bases. He will bring a playbook for GenAI in test automation created based on the results of research that collected advice and feedback from dozens of test automation engineers. In the session, Julio will discuss practical examples of the mindset, a set of steps to be followed when using...

Thursday, May 1

Otis Elevator Co
T13

Automating the Testing of AI/ML Models: Tools, Skills, and Best Practices

Thursday, May 1, 2025 - 1:30pm to 2:30pm

As AI and ML models become integral to software systems, ensuring their accuracy and reliability through effective testing is paramount. Traditional testing approaches often fall short in addressing the unique challenges posed by these models, such as handling large datasets, verifying model predictions, and maintaining robustness against data drift. This presentation explores Otis Elevator's journey in automating the testing of AI/ML models using cutting-edge tools and techniques. Ayisha Tabbassum's team faced significant hurdles in manually testing their AI models, from the sheer volume...