DLP for LLM's

Question

DLP for LLM's

Mohamed Chorfa 0

Hello,
Is there some sort of DLP for LLM models? For a prompt life cycle, we want to apply DLP for all prompts/completions in/out. PS: I already looked into Azure Content Safety and Azure Purview.
Thanks

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-01-15T22:58:45.47+00:00

@Mohamed Chorfa - Just checking in to see if the below answer provided by @David Broggy helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-01-19T05:28:11.3966667+00:00

@Mohamed Chorfa - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

1 answer

Your answer

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-01-15T22:58:45.47+00:00

@Mohamed Chorfa - Just checking in to see if the below answer provided by @David Broggy helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-01-19T05:28:11.3966667+00:00

@Mohamed Chorfa - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

Hi Mohamed, I've also been watching for such a feature but I'm not satisfied with what I've seen so far.

That said...

Defender for Cloud Apps has a new feature for blocking unapproved llm activity: https://learn.microsoft.com/en-us/defender-cloud-apps/release-notes

However if you're building an LLM solution I'd suggest including a logging layer so all requests are logged.

If you can send those logs to Sentinel (eg. syslog or logic app api to your app) then you can use KQL to query for patterns of interest. Hope that helps.

Share via

DLP for LLM's

1 answer

Your answer