Thinking of migrating to the cloud? Here are some key benefits, challenges, and methods for planning out a process that will work for your organization.
A few weeks ago Amazon released the Preview of Amazon Q for Business, and after looking at it I found a data exfiltration angle via rendering markdown/hyperlinks and reported it to Amazon.
Amazon reacted quickly and mitigated the problem. This post shares further details and how it was fixed.
The Problem An Indirect Prompt Injection attack can cause the LLM to return markdown tags. This allows an adversary who’s data makes it into the chat context (e.