@Milind
Thanks for your question. Since you have added the account as a guest user you should be able to assign roles to the user scoped to the container level. This is covered through our documentation Authorize access to blobs using Azure Active Directory. If the user needs access to the container through the portal you will need to assign the Reader role scoped to the storage account. Alternatively you can have the user access the container through Storage Explorer. This blog walks through setting up access through Storage Explorer.
Hope this helps! Let me know if you have further questions or need further assistance.
-------------------------------
Please don’t forget to "Accept the answer" and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Disclaimer: This response contains a reference to a third-party World Wide Web site. Microsoft is providing this information as a convenience to you. Microsoft does not control these sites and has not tested any software or information found on these sites; therefore, Microsoft cannot make any representations regarding the quality, safety, or suitability of any software or information found there.
There are inherent dangers in the use of any software found on the Internet, and Microsoft cautions you to make sure that you completely understand the risk before retrieving any software from the Internet.