Most #AI eval tests focus on an app with AI, but here we are, deep into the AI transition, and no one has developed a ba...

Most #AI eval tests focus on an app with AI, but here we are, deep into the AI transition, and no one has developed a baseline eval for the coding environment itself.Is everyone just vibe checking and trusting the #LLM provider?That seems like a bad plan.I'm making one for my #localAI #webdev setup.Some of it will be reusable, some will be bespoke. Hopefully we can develop a standard.Stay tuned.

Read Original

Related