Update route tables by using Azure Route Server

Azure ExpressRoute
Azure Storage
Azure Virtual Network
Azure VPN Gateway

This article presents a solution for managing the dynamic routing between NVAs and virtual networks. At the core of the solution is Azure Route Server. This service simplifies the configuration, maintenance, and deployment of NVAs in your virtual network. When you use Route Server, you no longer need to manually update NVA route tables when your virtual network addresses change.

Architecture

Architecture diagram that shows how data flows between local networks, a hub virtual network, a spoke virtual network, and various gateways.

Download a Visio file of this architecture.

Workflow

  • This hub-and-spoke architecture has a hub virtual network and one spoke virtual network. The hub virtual network has multiple subnets, each containing virtual machines (VMs).

  • The address space of each virtual network defines address ranges. For each of those ranges, Azure creates a route with the address prefix of that range. Azure adds those routes to route tables. Each virtual network has multiple subnets, and each subnet has a network interface card (NIC) that controls connectivity. Azure injects each virtual network's route table into the subnets' NICs.

    You can't create or remove these default system routes. But you can:

  • Local networks use Azure VPN Gateway and an ExpressRoute gateway to connect to the hub virtual network in a coexisting configuration. When you add the VPN gateway, routes with the gateway as the next route get added to the route tables. When you add ExpressRoute, the route tables are also updated. These routes propagate to all subnets.

  • The border gateway protocol (BGP) makes the exchange of IP addresses between on-premises and Azure components possible. This protocol directs packets between autonomous systems. Such systems are small networks or huge pools of routers that a single organization runs.

  • A virtual network peering exists between the hub virtual network and the spoke virtual network. When you create the peering, Azure updates the route table. Specifically, Azure adds a route for each address range that's in the hub address space or the spoke address space. These routes propagate to all subnets.

  • A subnet in the hub virtual network uses a service endpoint for Azure Storage. Azure adds a public IP address for Storage to that subnet's route table.

  • The hub virtual network contains two NVAs. The NVAs might be gateways, software-defined wide-area networks (SD-WANs), or security appliance firewalls. Route Server exchanges the NVA, network application, and gateway routes by:

    • Creating an instance of Azure Virtual Machine Scale Sets. Each VM in the scale set has an IP address. As with gateway IP addresses, Route Server has access to the VM IP addresses.
    • Establishing BGP peers between each NVA and a VM in the scale set.
    • Injecting the VM IP addresses into all route tables in the virtual network and connected networks.

    There's no need to:

    • Manually add user-defined routes.
    • Manually create route tables.
    • Link route tables to the subnet to propagate the routes.
    • Update route tables when IP addresses change.

Components

  • Route Server simplifies dynamic routing between NVAs that support BGP and virtual networks. This service eliminates the administrative overhead of maintaining route tables.

  • Virtual Network is the fundamental building block for private networks in Azure. Azure resources like VMs can securely communicate with each other, the internet, and on-premises networks through Virtual Network.

  • Virtual network peering connects two or more Azure virtual networks. Peerings provide low-latency, high-bandwidth connections between resources in different virtual networks. Traffic between VMs in peered virtual networks uses only the Microsoft private network.

  • VPN Gateway is a specific type of virtual network gateway. You can use VPN Gateway to send encrypted traffic:

    • Between an Azure virtual network and an on-premises location over the public internet.
    • Between Azure virtual networks over the Azure backbone network.
  • ExpressRoute extends on-premises networks into the Microsoft cloud. By using a connectivity provider, ExpressRoute establishes private connections to cloud components like Azure services and Microsoft 365.

  • A service endpoint provides secure and direct connectivity to an Azure service from private IP addresses in a virtual network. The service endpoint provides the identity of the virtual network to the Azure service. So the virtual network resources don't need public IP addresses to access the service, and the endpoint protects the service by allowing only traffic from the specified virtual network. The connections use optimized routes over the Azure backbone network.

  • An NVA is a virtual appliance that offers networking capabilities such as firewall security and load balancing.

  • Azure Storage is a cloud storage solution that includes object, file, disk, queue, and table storage. Services include hybrid storage solutions and tools for transferring, sharing, and backing up data.

Alternatives

  • In this solution, you don't have to connect the service endpoint to Storage. You can use other Azure services instead. For a list of services that you can secure with service endpoints, see Virtual Network service endpoints.

  • Instead of using Route Server, you can add user-defined routes to each subnet's route table. For more information about user-defined routes, see User-defined in Virtual network traffic routing.

Scenario details

Network routing is the process of determining the path that traffic takes across networks to reach a destination. Route tables list network topology information that's useful for determining routing paths.

When your virtual network contains a network virtual appliance (NVA), you need to manually configure and update your route tables.

This article presents a solution for managing the dynamic routing between NVAs and virtual networks. At the core of the solution is Azure Route Server. This service simplifies the configuration, maintenance, and deployment of NVAs in your virtual network. When you use Route Server, you no longer need to manually update NVA route tables when your virtual network addresses change.

Potential use cases

This solution applies to scenarios that:

  • Use dual-homed networks. Besides typical hub-and-spoke network topologies, Router Server also supports dual-homed network topologies. This type of configuration peers a spoke virtual network with two or more hub virtual networks. For detailed information, see About dual-homed network with Azure Route Server.
  • Connect NVAs to Azure ExpressRoute. Some virtual networks contain Route Server, an ExpressRoute gateway, and an NVA. By default, Route Server doesn't propagate the NVA routes to ExpressRoute. Route Server also doesn't propagate ExpressRoute routes to the NVA. You can get ExpressRoute and the NVA to exchange routes by turning on route exchange functionality in Route Server. For detailed information, see About Azure Route Server support for ExpressRoute and Azure VPN.
  • Use Azure to connect to the internet from an on-premises system. Organizations that lack good internet access might use this configuration. Systems that have already migrated internet proxies to Azure are other possibilities. Route Server makes this setup possible.

Considerations

Consider these points when implementing this solution:

  • Route Server establishes connections and exchanges routes. It doesn't transfer data packets. As a result, the VMs that Route Server runs in its back end don't require significant CPU power or computational power.

  • When you deploy Route Server, create a subnet called RouteServerSubnet that uses an IPv4 subnet mask of /27. Place Route Server in that subnet.

  • In Azure gateways, the Basic pricing tier doesn't support coexisting ExpressRoute and VPN Gateway connections. For other limitations with coexisting configurations, see Limits and limitations.

  • There's no limit on the number of service endpoints that you can use in a virtual network. But some Azure services, such as Storage, enforce limits on the number of subnets that you can use to secure the resource. For more information, see Next steps in Virtual Network service endpoints.

When considering this solution, also keep in mind the points in the following sections.

Availability

Route Server is a fully managed service that offers high availability. For this service's availability guarantee, see SLA for Azure Route Server.

Scalability

Most components in this solution are managed services that automatically scale. But there are a few exceptions:

  • Route Server can advertise at most 200 routes to ExpressRoute or a VPN gateway.
  • Route Server can support at most 2,000 VMs per virtual network, including peered virtual networks.

Security

Resiliency

This solution uses only managed components. At a regional level, all these components are automatically resilient. Route Server offers high availability. When you deploy Route Server in an Azure region that supports availability zones, your implementation has zone-level redundancy. For more information about availability zones, see Regions and availability zones.

Cost optimization

To estimate the cost of implementing this solution, see the Azure pricing calculator. For general information about reducing unnecessary expenses, see Overview of the cost optimization pillar.

The following sections discuss pricing information for the solution's components.

Route Server

Currently, there's no upfront cost or termination fee for Route Server. For pricing information, see Azure Route Server pricing.

Virtual Network

You can use Virtual Network free of charge. With an Azure subscription, you can create up to 50 virtual networks across all regions. Traffic that's within a virtual network's boundaries is free. As a result, there's no charge for communication between two VMs in the same virtual network.

VPN Gateway

When you use VPN Gateway, all inbound traffic is free. You're charged only for outbound traffic. Internet bandwidth costs apply with VPN outbound traffic. For more information, see VPN Gateway pricing.

ExpressRoute

ExpressRoute data transfers that are inbound are free of charge. For outbound data transfer, you're charged a predetermined rate. A fixed monthly port fee also applies. For more information, see Azure ExpressRoute pricing.

Service endpoints

There's no charge for using service endpoints.

NVAs

NVAs are charged based on the appliance that you use. You're also charged for the Azure VMs that you deploy and the underlying infrastructure resources that you consume, such as storage and networking. For more information, see Linux Virtual Machines Pricing.

Next steps