The API Import Restrictions Doc mentions the following, which I believe describe the behavior that you are seeing
-
server
object isn't supported on the API operation level. - If many
servers
are specified, API Management will try to select the first HTTPs URL. If there aren't any HTTPs URLs - the first HTTP URL. If there aren't any HTTP URLs - the server URL will be empty.
But for both scenarios, you should be able to leverage the set-backend-service policy to change the endpoint to which a request is forwarded to.