Azure Data Factory or Logic App x Blob Storage

clouddataquest 91 Reputation points
2023-01-24T09:49:32.07+00:00

Hello,

i made some Apps which move Files to a SFTP Server, the Problem is that the Connectors exceed the Max File Size Limit, so I can only transfer files which are smaller than like 50mb. Should I user Data Factory for my Jobs? Or can i use Azura Blob Storage in Logic Apps as alternative Connectors to move the Files. Which would better and has no limitations?

Basically I just need a Solution to move Big Files/Many Files from on-premise to SFTP and to another on-premise path. And i should be able to rename the fails or add timestamps to the name (like Logic app expressions)

Thank you very much :)!

best reg.

Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,854 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,603 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Nandan Hegde 29,891 Reputation points MVP
    2023-01-24T10:09:16.3833333+00:00

    Hey,

    Since there is On premises and SFTP involved, you would need some gateways (either power bi gateway for logic apps or Integration run time for ADFs)

    And both have support for SFTP and file path as source and sink with dynamic properties. So ideally both can work but based on huge data, would suggest to work with ADF over logic app where in you can increase the DTUs in case of copy activities etc:

    similar thread: [https://learn.microsoft.com/en-us/answers/questions/45299/pros-and-cons-between-logic-apps-and-azure-data-fa

    0 comments No comments