Azure function - Python - Detail logging (Stream)

Question

Azure function - Python - Detail logging (Stream)

Bhanuprasad 121

Azure Function - ~3 with Python

I would like to capture detail log out of SFTP connection from azure function, how can we achieve this?

PySFTP : pysftp.html
pysftp.Connection(host, username=None, private_key=None, password=None, port=22, private_key_pass=None, ciphers=None, log=False)

--From Documentation--

log (bool|str) – Default: False - log connection/handshake details? If set to True, pysftp creates a temporary file and logs to that. If set to a valid path and filename, pysftp logs to that. The name of the logfile can be found at .logfile

We are able to connect to SFTP and able to get the function working successfully, when we have log=True we need to detail logging when the application fails, could you please advise how we can get the detail log to our log analytics

1 answer

Your answer

Answer 1

MughundhanRaveendran-MSFT 12,506

@Bhanuprasad ,

Thanks for reaching out to Q&A.

Azure Functions offers built-in integration with Azure Application Insights to monitor functions : https://learn.microsoft.com/en-us/azure/azure-functions/functions-monitoring

You can log information to App insights and then view the detailed logs in Log analytics workspace using Kusto queries. To be specific, the "Traces" , "FunctionappLogs" and "requests" table would give you more detailed logs.

Python Functions with App insights : https://learn.microsoft.com/en-us/azure/azure-functions/functions-reference-python?tabs=azurecli-linux%2Capplication-level#logging

Live stream : https://learn.microsoft.com/en-us/azure/azure-functions/streaming-logs#live-metrics-stream

Querying Logs: https://learn.microsoft.com/en-us/azure/azure-functions/functions-monitor-log-analytics?tabs=python#querying-the-logs

I hope this helps!

Please 'Accept as answer' and ‘Upvote’ if it helped so that it can help others in the community looking for help on similar topics.

Bhanuprasad 121 Reputation points

2022-01-25T03:37:28.41+00:00
Thanks for the response @MughundhanRaveendran-MSFT , we are already using log analytics to monitor and review our logs

This specific scenario, we need to write the log into a temporary location as we are not able to post into the log analytics directly:

Code: Where we can write the LOG_FILE_NAME?

LOG_FILE_NAME= "log_" + datetime.datetime.now().strftime('%Y%m%d'+"_"+'%H%M%S.%f') + "_debug.txt" pysftp.Connection(host=hostname.xxx.com, username=test_user, private_key=test_key, log=True) as sftp: ... ... ...

We want to write the log into a temproray file, is there any temporary location we should be using and then writing into the log analytics. Need advise on how we can write into the temporary location?
MughundhanRaveendran-MSFT 12,506 Reputation points

2022-01-25T07:34:52.287+00:00

@Bhanuprasad , temporary files can be written to the file system : https://github.com/projectkudu/kudu/wiki/Understanding-the-Azure-App-Service-file-system#temporary-files

%SYSTEMDRIVE%\local\Temp , the SystemDrive may be "C:\" or "D:\" , you can check this by opening the kudu site of the function app and clicking on "debug console-> cmd"

Please note that , the files will be automatically deleted from this location automatically after certain period of time , I think its less than 12 hours.
Bhanuprasad 121 Reputation points

2022-01-25T08:39:21.547+00:00

We are using Linux, will look at using /tmp

Thank you
MughundhanRaveendran-MSFT 12,506 Reputation points

2022-02-01T04:50:36.557+00:00

@Bhanuprasad , Just wanted to know if the above answer was helpful or not. Please 'Accept as answer' and ‘Upvote’ if it helped so that it can help others in the community looking for help on similar topics.

Share via

Azure function - Python - Detail logging (Stream)

log (bool|str) – Default: False - log connection/handshake details? If set to True, pysftp creates a temporary file and logs to that. If set to a valid path and filename, pysftp logs to that. The name of the logfile can be found at .logfile

1 answer

Your answer