Hey @Anirud Thapliyal ,
Is is not possible to directly query an On prem table in Azure SQL database but vice versa is possible.
Azure SQL database doesn't support the linked server property so you wont be able to access on prem tables in Azure SQL database and the elastic query in Azure SQL database is to query tables between 2 Azure SQL databases and not On prem.
But the vice versa of querying the Azure SQL database table in On prem is possible via the concept of linked server .
In case if you want the on prem table in Azure SQL, you can either use the concept of data sync to sync data between on prem and cloud or you can use Azure data factory to copy from on prem to Azure SQL.
But unfortunately based on my understanding as of now, it is not directly possible to have your requirement