How to use Azure Content Safety to find scammer using the chat communications

Suresh Rajamani 20 Reputation points
2024-02-28T13:04:24.1533333+00:00

Hi Team, I want to build a Gen AI tool find scammers in dating platform based on their communications and profiles. So i tried to use Azure Content Safety - Text Moderation. To test the content safety , i used the following sample communication data which is actually a scam kind of content. Even Azure AI chat Completions api responds like that. But Content Safety - Text Moderation api says all safe. Am i missing anything to configure. Because it is just simple conversation text. In the below conversation, User A is a scammer based on the conversation. Kindly advise.

User A : Hi there! 😊 I came across your profile, and I must say you seem like an amazing person!> User B : Thank you! 😊 I appreciate the compliment. How are you doing?> User A : I'm doing great! Just enjoying my day and stumbled upon your profile. Your pictures caught my eye! 😍> User B : That's sweet of you to say! I enjoyed reading your profile too. What brings you to this dating platform?> User A : I've been looking for someone special, and your profile really stood out. I feel a strong connection already. 😊> User B : Wow, that's flattering! I'm here to meet new people too. It's nice to chat with someone who shares similar interests.> User A :I totally agree! By the way, I've been facing a little financial trouble lately. Would you mind helping me out with a small amount? I'll pay you back, I promise.>

Thanks, Suresh Rajamani

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,793 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.