It can be fixed by removing everything from windows store again after adding the language pack.
Remove everything:
Get-AppxPackage -AllUsers | Remove-AppxPackage
Provision remove everything:
Get-AppxProvisionedPackage -online | Remove-AppxProvisionedPackage -online