Why adding an LLM changes the security model of an ordinary applicationAdding an LLM to an existing application can look...

Why adding an LLM changes the security model of an ordinary applicationAdding an LLM to an existing application can look deceptively simple.A user sends a request. The application sends it to a model. The model returns an answer.From a software architecture perspective, it can feel like adding another API integration.But the security model has changed.A traditional application usually treats data as data and instructions as instructions. An LLM works with both through the same medium: language.Once the model can read emails, search documents, access customer records, or call business tools, information from those sources can influence what the model decides to do next.The attack surface is no longer limited to the user's request.Content entering the model can become part of the decision-making process.The User Is No Longer the Only InputConsider an AI assistant that helps employees work with customer information.The user asks:“Why is the March invoice still open?”The system might retri...

Read Original

Related