'MsoSpChannelFactoryCache' is not defined when trying to setup Office Online Single Server Farm

Question

Followed all steps as per https://learn.microsoft.com/en-us/officeonlineserver/deploy-office-online-server except installation of Language Pack as that fails with error code 2711 which I was not able to find any information on.

Server is Windows Server 2019. Server also has Sharepoint 2019 installed. When running the following command:
New-OfficeWebAppsFarm -InternalURL "http://<our servername>" -AllowHttp -EditingEnabled

I get the following error:
New-OfficeWebAppsFarm : Requested category 'MsoSpChannelFactoryCache' is not defined 
Parameter name: category Actual value was MsoSpChannelFactoryCache. 
At line:1 char:1 
+ New-OfficeWebAppsFarm -InternalURL "http://<servername>" -AllowHttp -Ed ... 
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

     + CategoryInfo          : NotSpecified: (:) [New-OfficeWebAppsFarm], ArgumentOutOfRangeException     

     + FullyQualifiedErrorId : System.ArgumentOutOfRangeException,Microsoft.Office.Web.Apps.Administration.NewFarmCommand