poweshell sc with arabic support

Question

I am trying to convert xml file into UTF8 unicode. this xml contains arabic characters which appear as ???????? after conversion.

can anyone support please how to convert file to UTF without loosing arabic

when i convert it to usinng -ecoding UTF8 , still converts as UTF8-BOM

this is my syntax

gc e:\testxml\abc.xml | sc E:\testxml\upload.xml

it converts file to UTF8 but arabic appears as ?????????

Thanks for your support

Imran

Answer 1

Try this if you want to write a UTF file with no BOM: using-powershell-to-write-a-file-in-utf-8-without-the-bom

$MyRawString = Get-Content -Raw c:\junk\bom.txt  
$Utf8NoBomEncoding = New-Object System.Text.UTF8Encoding $False  
[System.IO.File]::WriteAllLines("c:\junk\NewNoBOM.txt", $MyRawString, $Utf8NoBomEncoding)  

I used the same content as MotoX80:45436-bom.txt
I used a very handy tool (HxD: hxd) to examine the two files and exported the results from HxD as "Editor view". The BOM isn't present on the file EXPORT-NewNoBOM.
45494-export-bom.txt
45330-export-newnobom.txt

Answer 2

What is the encoding of the source file? Wouldn't the file already have to be in UTF8 format in order for Powershell to read the characters in correctly?

Does notepad/Powershell read the file correctly? Have you tried specifying different input encoding?

See also: https://community.idera.com/database-tools/powershell/powertips/b/tips/posts/get-text-file-encoding

Answer 3

thanks alot RichMatheisen-8856 for taking time.
meanwhile another challange came across where Excel 365 VBA giving error for Powershell to run and giving permission denied error.
now struggling with that error

thanks for your support