Hi @Apoorv ,
There are two possible authentications for MS SQL server, windows authentication and SQL server authentication. There is no AWS IAM Authentication for MS SQL server. Refer to MS document Choose an Authentication Mode to get more.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".