I was able to find the additional Outbound IP addresses for the function app and got them whitelisted on the destination server. After that the SFTP connectivity is working fine.
Just for reference, I was able to locate the additional Outbound IP addresses (which were not listed in the microsoft documentation of IP ranges by regions) under Function App --> Settings --> Networking (preview) --> Outbound Traffic (Outbound addresses).