AI Leadership Insights: Testing Large Language Models
Techstrong.ai, Wednesday, March 13th, 2024
In this Techstrong AI Leadership Insights video, CircleCI CTO Rob Zuber explains why there is a need for a free short online course on how to automate evaluations of large language models (LLMs).
Mike Vizard: Hello and welcome to the latest edition of the Techstrong AI Leadership Insights series. I'm your host, Mike Vizard. Today we're with Rob Zuber, who's CTO for CircleCI, and we're talking about a course that they have created in conjunction with deeplearning.ai to help people figure out how to test all these large language models that are floating around out there. Rob, welcome the show.
Rob Zuber: Thanks for having me. Happy to be here.
Mike Vizard: What is the challenge exactly with testing these things? I mean, you would think they're just another type of software artifact. We should be able to test them easily, but I'm assuming there's a lot of nuances here.