File-upload-module in iot edge device

Question

Is there any standard modules available to pull the data from ftp client and send to iothub.

Actually my application needs to pull data from ftp client running on edge device and send to azure blob storage.
Used readily available APIs for blob storage like from azure.storage.blob import BlobServiceClient . I can able to push data to azure blob storage.

But for maintainability issues i wanted to convert same to a azure module will get data from ftp client running on gateway and send to blob.(What i read from docs, that sending data from module only possible to iothub and from there if required we can redirect to blob storage.am I correct????). Is it possible to create a custom module if no readymade modules are available for file upload.

If so how to define routes for that.

Will iothub accept data as files ..Could you provide some inputs on it????

Answer 1

Hello @Ligiya Kurien ,

I'm not sure about a full solution to read files using FTP and pushing them to Azure blob storage but this can be done in parts using both custom code and standard modules.

Let's start with the last part, sending blobs to the cloud.

Microsoft offers a standard module that acts like a local Azure blob storage account. The files are actually stored on the local file system.

The great thing is that it also provides a sync mechanism to a blob storage account in the cloud. You only need to configure that.

So, you have do to two things:

1. deploy the standard blob storage module and configure the sync mechanism
2. create a custom module that van get files over FTP and add more code to program against the local blob storage

See this blog post showing how to set up that sync mechanism and this blog post showing how to program against the local storage.

Keep in mind there are two storage accounts, one locally and one in the cloud.

So you will have two access keys: one for the cloud storage account and one for the local storage account (see the second blog on how to create one).

----------

If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. By doing so, all community members who have a similar issue will benefit. Your contribution is highly appreciated.