@Mahandru, Nidhi Can you please confirm if you are using Azure SFTP SSH connector or built in SFTP SSH connector as the IP address will change. If you are using the Azure SFTP SSH connector, then the communication will be your workflow --> SFTP connector --> Your SFTP server so in this case you need to whitelist the IP address as per the regions listed here at your SFTP server end. In case if you are using the Build in SFTP connector then the communication will be logic app --> your sftp server so you need to whitelist the outbound IP address of your standard logic app. To find the outbound IP address you can refer to this document.
Please confirm if you have whitelisted the right IP address as per your Azure or built-in connectors. For more details on connector categories please refer to this document.