Why AI Agents Need a Two-Tier Architecture
Let us start with a problem statement, You have to deploy a public facing chatbot, the bot is supposed to be capable of executing various tools, for example ffmpeg. Now the simplest solution is to just host an app on your server which simply accepts a prompt, decides which tools to call, executes the code on the server itself & returns the output. Take an example, an app which lets you run ffmpeg command using a text prompt.
- ▪Let us start with a problem statement, You have to deploy a public facing chatbot, the bot is supposed to be capable of executing various tools, for example ffmpeg.
- ▪Now the simplest solution is to just host an app on your server which simply accepts a prompt, decides which tools to call, executes the code on the server itself & returns the output.
- ▪Take an example, an app which lets you run ffmpeg command using a text prompt.
Hacker News (AI / LLM) files mainly under ai. We currently carry 2,190 of its stories.
Opening excerpt (first ~120 words) tap to expand
What problem are we solving? Let us start with a problem statement, You have to deploy a public facing chatbot, the bot is supposed to be capable of executing various tools, for example ffmpeg. Now the simplest solution is to just host an app on your server which simply accepts a prompt, decides which tools to call, executes the code on the server itself & returns the output. This is an inherently problematic approach. Take an example, an app which lets you run ffmpeg command using a text prompt. User enters "delete the lib ffmpeg" In the above solution it will eventually run the instructed command no matter how robust the system instruction is. Final result, all the users are affected.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Hacker News - Newest: ""AI" "LLM"".
Discussion
0 commentsMore from Hacker News - Newest: ""AI" "LLM""
