How to download an html page using powershell and keep it in storage account using powershell

Question

How to download an html page using powershell and keep it in azure storage account using powershell.

Answer 1

Hello @Deepaklal-FT ,
Try out the below complete script for your 2 requirements: (First part is using Invoke-webrequest as suggested by Rich and later part is using azure powershell cmdlets)
Before running the script try to set the current susbcription context using : az account set --subscription <subid>

$filename="bing.html"
(Invoke-webrequest -URI "http://www.bing.com").Content > $filename
$uploadstorage=Get-AzStorageAccount -ResourceGroupName "forsharing" -Name "forsharing"
$storcontext=$uploadstorage.Context
Set-AzStorageBlobContent -Container "test2" -File $filename -Context $storcontext

Answer 2

The "download an html page" part of your question is answered by using the Invoke-WebRequest cmdlet.

I don't use Azure so I can't answer the 2nd part. This might help you: upload-file-to-blob-storage-with-azure-functions-in-powershell-using-azure-modul

Answer 3

@shiva patpi see the below script complete.

$filename="terms.html"
(Invoke-webrequest -URI "https://www.google.com/index.html").Content > $filename
$uploadstorage=Get-AzStorageAccount -ResourceGroupName "rgname" -Name "storagename"
$storcontext=$uploadstorage.Context
Set-AzStorageBlobContent -Container "`$web" -File $filename -Context $storcontext -Properties @{"ContentType" = "text/html"} -Force

(Invoke-webrequest -URI "https://www.google.com/index.html").Content > $filename1
(Invoke-webrequest -URI "https://storageaccounturl/index.html").Content > $filename2

Compare-Object (Get-Content $filename1) (Get-Content $filename2)

Coparison result is not "=="

And after uploading the spaces are coming in between the content it looks.

Answer 4

@shiva patpi @SaiKishor-MSFT @Dharshinika-FT

Below is the answer for my problem statement. Working fine as expected. you can accept answer if possible.

Replace in code:
this---> (Invoke-webrequest -URI $uri).Content > $filename1
with this ----> Invoke-webrequest -URI $uri -OutFile $filename1

Answer 5

Hi Deepaklal-FT,

If you would like to download the azure app service contents to on-prem server and restore back to azure app service using powershell script, you can refer following steps.

First, we can use KUDU Zip REST API download the folders as ZIP files.

GET /api/zip/{path}/

Since we need to use automated method way to do this, we can use service principal to connect azure account, then generate the token to call REST API.

For service principal, you can refer following document to create service principal.

https://learn.microsoft.com/en-us/azure/active-directory/develop/howto-create-service-principal-porta...

In order to call REST API, powershell usually use the Invoke-RestMethod module to call API.

However, Invoke-RestMethod may have some problem when the site contains a lot of files.

There is a workaround posted in above link you can refer.

It looks like it's tied to Invoke-RestMethod and Invoke-WebRequest though, it seems to work fine when using System.Net.WebClient instead, so that can be a workaround for this.

So the final script would be as following:

$resourceGroupName = "henryapprg"
$webAppName = "freewinhe"
$slotName = ""
$localPath = "c:\test\henry.zip"
$ClientSecret = "serviceprincipalclientsecret"
$ApplicationID = "serviceApplicationID"
$TenantID = "tenantid"

use service principal to connect Azure Account

$passwd = ConvertTo-SecureString $ClientSecret -AsPlainText -Force
$pscredential = New-Object System.Management.Automation.PSCredential($ApplicationID, $passwd)
Connect-AzAccount -Credential $pscredential -Tenant $TenantID -ServicePrincipal

generate token with Azure Account.

$azProfile = [Microsoft.Azure.Commands.Common.Authentication.Abstractions.AzureRmProfileProvider]::Instance.Profile
$context =Get-AzContext
$profileClient = New-Object Microsoft.Azure.Commands.ResourceManager.Common.RMProfileClient($azProfile)
Write-Debug ("Getting access token for tenant" + $currentAzureContext.Subscription.TenantId)
$token = $profileClient.AcquireAccessToken($context.Subscription.TenantId)
$token.AccessToken
$kuduApiAuthorisationToken = 'Bearer {0}' -f $token.AccessToken

if ($slotName -eq ""){  
    $kuduApiUrl = "https://$webAppName.scm.azurewebsites.net/api/zip/site/wwwroot/"  
}  
else{  
    $kuduApiUrl = "https://$webAppName`-$slotName.scm.azurewebsites.net/api/zip/site/wwwroot/"  
}  
$virtualPath = $kuduApiUrl.Replace(".scm.azurewebsites.", ".azurewebsites.").Replace("/api/zip/site/wwwroot", "")  
Write-Host " Downloading File from WebApp. Source: '$kuduApiUrl'. Target: '$localPath'..." -ForegroundColor DarkGray  

Call zip Rest API to download the Zip file from webapp.

`
$WebClient = New-Object System.Net.WebClient
$WebClient.Headers.Add('Authorization', $kuduApiAuthorisationToken)
$WebClient.Headers.Add('ContentType', 'multipart/form-data')
$WebClient.DownloadFile($kuduApiUrl, $localPath)

Second, there is a document that introduce a powershell command to zip deploy.

https://learn.microsoft.com/en-us/azure/app-service/deploy-zip#with-powershell

Publish-AzWebapp -ResourceGroupName <group-name> -Name <app-name> -ArchivePath <zip-file-path>

So the restore script would be like this:

$localPath = "c:\test\henry.zip"
$ClientSecret = "serviceprincipalclientsecret"
$ApplicationID = "serviceApplicationID"
$TenantID = "tenantid"

use service principal to connect Azure Account

$passwd = ConvertTo-SecureString $ClientSecret -AsPlainText -Force
$pscredential = New-Object System.Management.Automation.PSCredential($ApplicationID, $passwd)
Connect-AzAccount -Credential $pscredential -Tenant $TenantID -ServicePrincipal

Publish-AzWebapp -ResourceGroupName "henryapprg" -Name "phpwinhenry" -ArchivePath $localPath -Force

---

Thanks.

--If the reply is helpful, please Upvote and Accept as answer--