Jacob Visovatti and Conner Goodrum of Deepgram communicate with host Kanchan Shringi about testing ML fashions for enterprise use and why it’s essential for product reliability and high quality. They talk about the challenges of testing machine studying fashions in enterprise environments, particularly in foundational AI contexts. The dialog notably highlights the variations in testing wants between corporations that construct ML fashions from scratch and those who depend on present infrastructure. Jacob and Conner describe how testing is extra advanced in ML techniques because of unstructured inputs, various information distribution, and real-time use circumstances, in distinction to conventional software program testing frameworks such because the testing pyramid.
To deal with the problem of making certain LLM high quality, they advocate for iterative suggestions loops, strong observability, and production-like testing environments. Each company underscore that testing and high quality assurance are interdisciplinary efforts that contain information scientists, ML engineers, software program engineers, and product managers. Lastly, this episode touches on the significance of artificial information technology, fuzz testing, automated retraining pipelines, and accountable mannequin deployment—particularly when dealing with delicate or regulated enterprise information.
Dropped at you by IEEE Laptop Society and IEEE Software program journal.
Associated Episodes
