Retrieving Azure Storage Blob Data
This topic shows you how to access and load data into Message Analyzer version 1.3 and later from log files that exist in Azure Storage binary large object (BLOB) containers. For Message Analyzer to successfully load and display this log data, you will need to provide some input connection information in order to access the BLOB repositories where the log data is saved. To access these repositories, you will use the File Selector dialog to select the files that contain the data you want to work with. After you specify such files and you exit the dialog, you must select a particular configuration file in your Data Retrieval Session for parsing the log data. If the AzureStorageLog configuration file does not exist in the Text Log Configuration drop-down list in your Data Retrieval Session configuration, you will need to download it through the Message Analyzer sharing infrastructure, as described in Using the AzureStorageLog Parser, and then restart Message Analyzer.
Go to Procedure
To proceed directly to a detailed procedure that you can follow to retrieve log data from Azure Storage BLOB containers, see To access, load, and view log data from Azure storage BLOB containers. Otherwise, you can review the Workflow Overview.
Accessing Log Data in Azure Storage BLOB Containers
To connect with the Azure Storage BLOB repositories, you will need an Account name and Account key, which you should be able to obtain from your Azure portal. To input this information, you will need to open the File Selector dialog, which is accessible by clicking Open from the Message Analyzer File menu and then selecting From Other File Sources. Thereafter, the File Selector dialog enables you to enter the connection information in the Add Azure Storage Connection dialog that displays when you click the Add Azure Connection button. After you specify the input connection data, you can navigate to the Azure Storage BLOB containers and select one or more log files from which to load data into Message Analyzer.
Note
It is necessary to specify the input connection information only once for access to Azure logs, as long as you are still running the same Message Analyzer session where you initially specified such connection information. Otherwise, for security purposes, Azure account access is not persisted across Message Analyzer sessions.
The user interface for the File Selector dialog is shown in the figure that follows.
Figure 32: Azure File Selector dialog
Using the AzureStorageLog Parser
To load log file data into Message Analyzer from Azure Storage BLOB containers, a Text Log Configuration file is required for parsing the log data. After you target specific log files for input data and you click OK to exit the File Selector dialog, Message Analyzer displays the New Session dialog for a Data Retrieval Session, where the logs you specified are listed on the Files tab. In the session configuration, you will need to select the AzureStorageLog configuration file in the Text Log Configuration drop-down list to parse your Azure logs. If this file does not exist in the list, you will need to download it through the Message Analyzer sharing infrastructure.
The Azure parsers are available in the Azure Storage Parsers Version x.x asset collection that is accessible by clicking the Message Analyzer Tools menu and then selecting the Asset Manager command to display the Asset Manager dialog. To acquire the parsers in this collection, click the download icon (with the down-arrow indicator) to the right of the Azure Storage Parsers package on the Downloads tab of the Asset Manager dialog and then select the auto-sync option that appears in the Item Download Options dialog. When you click OK to exit this dialog, the Azure parser collection is downloaded to your Message Analyzer installation. Thereafter, you will receive automatic collection updates as they become available, as described in Downloading Assets and Auto-Syncing Updates.
You can now select the AzureStorageLog configuration file in the Text Log Configuration drop-down list during Data Retrieval Session configuration.
Analyzing Azure Data
After Message Analyzer loads your Azure data, you can analyze and correlate the fields from the parsed input log file data by viewing it in Analysis Grid viewer columns. You can also make use of the Field Chooser Tool Window to display additional Azure data fields of interest, by adding them as columns to the Analysis Grid viewer for further analysis. The additional fields appear under the AzureStorageLog node when it is expanded in the Field Chooser window.
Workflow Overview
The following procedure outlines the general steps you can follow when configuring a Data Retrieval Session to load log data from Azure Storage BLOB containers into Message Analyzer:
Ensure that you have the AzureStorageLog parser before you get started. If you need this parser, follow the general instructions in Using the AzureStorageLog Parser to obtain it.
Open the File Selector dialog from the Message Analyzer File menu by highlighting Open and then selecting the From Other File Sources command.
In the Add Azure Storage Connection dialog, specify Account name and Account key information, as described in Accessing Log Data in Azure Storage BLOB Containers.
In the Add Azure Storage Connection dialog, ensure that the Use HTTPS (Recommended) option is selected as the Connection protocol.
Expand the nodes in the File Selection dialog until you expose the Blobs container and subfolders, so you can navigate to the log data you want to retrieve.
Select one or more .log files and then click OK to exit the File Selector dialog, at which time the New Session dialog displays to enable additional configuration of your Data Retrieval Session.
Select the AzureStorageLog configuration file in the Text Log Configuration drop-down list for each Azure log file in the files list of the New Session dialog.
Optionally, configure a Time Filter in the New Session dialog to narrow the scope of data retrieval, as described in Applying an Input Time Filter to a Data Retrieval Session.
Optionally, if you have the Azure Storage Filter asset package downloaded, select a predefined Azure filter from the Azure Storage category in the Filter Expression Library to create a resulting data set that focuses on specific information, as described in Applying a Session Filter to a Data Retrieval Session.
Ensure that the Analysis Grid viewer is selected in the Start With drop-down list and click Start to exit the New Session dialog and begin data retrieval.
Observe that the log data displays in the Analysis Grid viewer.
Optionally, use the Field Chooser window to enhance the view layout for the log data by adding one or more Analysis Grid viewer columns based on other fields of the parsed Azure log data.
Optionally, if you have the Azure Storage View Layouts asset package downloaded, change the Analysis Grid viewer column layout by selecting the Storage Log item in the Layout drop-down list. This layout is specifically designed to include key data fields for analysis of Azure storage logs.
More Information
To learn more about downloading and auto-syncing Message Analyzer assets, see Managing Asset Collection Downloads and Updates.
To learn more about the Field Chooser, see the Field Chooser Tool Window topic.