HomeSoftware EngineeringScaling Agent Workloads at Vercel

Scaling Agent Workloads at Vercel


Scaling Agent Workloads at Vercel

Most AI agent setups at present are constructed round a single session, the place one person interacts with one agent at a time. Nevertheless, that mannequin breaks down when an agent has to serve a enterprise, the place 1000’s of requests can arrive directly and every session must be remoted, sturdy, and recoverable. Getting brokers to run reliably at that scale has meant numerous hand-rolled infrastructure beneath the agent itself.

eve is an open supply, cloud-native agent framework from Vercel that removes a lot of the agent scaling burden. Within the eve framework, an agent is outlined declaratively via configuration information and these information compile into infrastructure as code so the platform provisions solely what the agent really makes use of.

Andrew Barba is a Member of Technical Employees at Vercel, and Shar Dara is the Product Lead for eve at Vercel. On this episode, they be part of Kevin Ball to debate what it means for an agent framework to be cloud-native, why they selected to specific brokers in plain English, and their view that firm constructing is changing into agent constructing.

Sponsorship inquiries:
[email protected]

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

- Advertisment -
Google search engine

Most Popular

Recent Comments