Extreamly slow Upload speed in Windows (all other OS's on network are fine)

Question

I've been having this issue since at least January 2021 on my entire fleet of Windows devices. I first noticed it when my offsite backups stopped completing in time.

Upload speed in Windows is being throttled by something. Download speed is unaffected.

WAN is 2Gbps symmetrical. My ISP (Washington State K-20 Telecommunications Network) confirmed that their circuit is not the cause and is capable of 1800 Mbps symmetrical throughput. Distance is a factor, as I can get 400Mbps to my local telco (which isn't my IPS). Going past a few hundred kilometers it drops to 30-70Mbps. There is an initial burst, but drops quickly.

I have an HPE/Aruba network and a Sophos XG 310 v2 running SFOS 18.0.4 MR-4. If I plug a client directly into my 10Gbit fiber before my firewall, I can get acceptable speeds on Windows. I haven't been able to find any setting in Sophos XG to tweak that would make any difference. Local iPerf3 tests ruled out my core router/switch/datacenter.

All tests run from Hyper-V guests on Server 2019 Datacenter running on HPE ProLiant DL360 Gen10 hardware.
Windows Server 2019 Datacenter speed tests:

Linux (CentOS 8) speed tests:

Speedtest by Ookla  
  
     Server: Comcast - Seattle, WA (id = 1782)  
        ISP: Washington State K-20 Telecommunications Network  
    Latency:     3.93 ms   (0.16 ms jitter)  
   Download:   915.29 Mbps (data used: 1.2 GB)  
     Upload:  1537.96 Mbps (data used: 1.8 GB)  
Packet Loss: Not available.  
 Result URL: https://www.speedtest.net/result/c/c4bca417-e246-4f46-964a-c4291e4a3914  

Speedtest by Ookla  
  
     Server: Comcast - Sacramento, CA (id = 9436)  
        ISP: Washington State K-20 Telecommunications Network  
    Latency:    24.65 ms   (0.13 ms jitter)  
   Download:  1232.96 Mbps (data used: 1.7 GB)  
     Upload:  1007.46 Mbps (data used: 1.3 GB)  
Packet Loss:     0.4%  
 Result URL: https://www.speedtest.net/result/c/21032a9c-8285-44fe-aadf-ad4dc3d90428  

OS affected for me:

• Windows 10 2004
• Windows 10 20H2
• Windows 2016
• Windows 2019

All devices are fully updated, firmware included.

I've tweaked:

• Limit reservable bandwidth
• AV
• Safe mode boot
• Domain and non-domain computers
• autotuning
• Interrupt Moderation
• Receive Side Scaling
• TCP Congestion Control
• Large Send Offload

I've tried the following hardware:

• Dell Optiplex 7040
• HP Elitebook 840 G5
• HPE ProLiant DL380 Gen10
• HPE ProLiant DL360 Gen10

These OS' are fine:

• ChromeOS
• Android
• MacOS
• iOS
• Linux (CentOS, HyperV)

This is a continuation of https://learn.microsoft.com/en-us/answers/questions/89768/slow-wired-upload-speed-vs-linux-on-same-hardware.html

Answer 1

I'm having the same problem. My setup is Windows 10 host with a pfSense Hyper-V guest as the router, Intel T350-2 Ethernet NIC, 250/10 Mbps cable internet. Downloads are fine, and everthing except my Windows 10 host uploads at the nominal upload speed, which only gets to about 0.1-0.2 Mbps. However, when I switch from wired to WiFi (Intel WiFi 6 AX200) the upload speed jumps to the nominal speed, even without disabling the wired NICs (I just enabled the WiFi NIC and gave it the lowest route metric). So maybe the problem is not in the TCP/IP settings?

Answer 2

Hi there,

Any update on the topic after a year? I upgraded my ISP recently and noticed the same issue.
Linux android and apple machines not affected.

Magnis

Answer 3

Hello @Ian Turner ,

I guess that you read what I wrote about regarding out-of-order delivery undermining the Windows congestion control mechanisms. Have you made any measurements to check to what extent this might explain the behaviour that you are observing?

Gary

Answer 4

Hi ,

Thanks for posting in Q&A platform.

In your case ,we need to analyze performance log to find any clues. Unfortunately, analysis of performance log is beyond our forum support level and due to forum security policy, we have no such channel to collect user log information. So if you want to find the cause ,we recommend you open a case with MS Professional tech support service, they will help you open a phone or email case to Microsoft, so that you would get a technical support on a one-to-one basis while ensuring private information.

Here is the link:

https://support.microsoft.com/en-us/gp/customer-service-phone-numbers

Best Regards,
Sunny

----------

If the Answer is helpful, please click "Accept Answer" and upvote it.

Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

Answer 5

Hi @Gary Nebbett ,

I did read through your responses, but I had not run any measures to check for out of order delivery yet. My suspicion is on my Sophos XG firewall which would be why I can get acceptable speeds directly connected to my WAN connection on a client computer. I have an open ticket with Sophos and will bring up Out of Order delivery with them.

I think I tried all the suggested things, unless I missed something. I used to get normal speeds during upload. I do not have a record of what was changed, either a firewall update, Windows update or something else.

 New-NetEventSession -LocalFilePath $Env:TEMP\SlowUp.etl -Name SlowUp  
 Add-NetEventPacketCaptureProvider -TruncationLength 100 -Level 255 -SessionName SlowUp  
 Add-NetEventProvider -Name "Microsoft-Windows-TCPIP" -Level 255 -SessionName SlowUp  
 Start-NetEventSession -Name SlowUp  
      
 [run performance test]  
      
 Stop-NetEventSession -Name SlowUp  
 Remove-NetEventSession  

Upload event:

ThreadID="10,992" ProcessorNumber="16" Tcb="0xffffb88b35872b20" DataBytesOut="19,242,849" DataBytesIn="13,306" DataSegmentsOut="6,359" DataSegmentsIn="15" SegmentsOut="6,369" SegmentsIn="7,480" NonRecovDa="1,436" NonRecovDaEpisodes="1,325" DupAcksIn="1,989" BytesRetrans="124,100" Timeouts="0" SpuriousRtoDetections="0" FastRetran="66" MaxSsthresh="501,694" MaxSsCwnd="716,706" MaxCaCwnd="507,015" SndLimTransRwin="3" SndLimTimeRwin="21" SndLimBytesRwin="86,140" SndLimTransCwnd="5" SndLimTimeCwnd="16,434" SndLimBytesCwnd="13,408,300" SndLimTransSnd="5" SndLimTimeRSnd="165" SndLimBytesRSnd="497,253" ConnectionTimeMs="16,643" TimestampsEnabled="FALSE" RttUs="24,261" MinRttUs="482" MaxRttUs="45,838" SynRetrans="0" CongestionAlgorithm="CUBIC" State="ClosedState" LocalAddress="10.1.3.146:55306" RemoteAddress="69.241.21.18:8080" CWnd="24,404" SsThresh="14,600" RcvWnd="261,479" RcvBuf="262,800" SndWnd="2,474,880" FormattedMessage="TCP: Connection 0xffffb88b35872b20 Summary: DataBytesOut 19,242,849 DataBytesIn 13,306 DataSegmentsOut 6,359 DataSegmentsIn 15 SegmentsOut 6,369 SegmentsIn 7,480 NonRecovDa \   1,436 NonRecovDaEpisodes 1,325 DupAcksIn 1,989 BytesRetrans 124,100 Timeouts 0 SpuriousRtoDetections 0 FastRetran 66 MaxSsthresh 501,694 MaxSsCwnd 716,706 \   MaxCaCwnd 507,015 SndLimTransRwin 3 SndLimTimeRwin 21 SndLimBytesRwin 86,140 SndLimTransCwnd 5 SndLimTimeCwnd 16,434 SndLimBytesCwnd 13,408,300 \   SndLimTransSnd 5 SndLimTimeSnd 165 SndLimBytesSnd 497,253 ConnectionTimeMs 16,643 Timestamps FALSE RttUs 24,261 MinRtt 482 MaxRtt 45,838 SynRetrans 0 CongestionAlgorithm CUBIC \   State ClosedState Local 10.1.3.146:55306 Remote 69.241.21.18:8080 CWnd 24,404 SsThresh 14,600 RcvWnd 261,479 RcvBuf 262,800 SndWnd 2,474,880. " ActivityID="35872b20-b88b-ffff-0000-000000000000"    

SlowUp.etl: https://drive.google.com/file/d/1DUC9if8uDLiijNq_k0HrER-cUss115Ja/view

Thank you for helping,
Ian