To confirm you have indeed dual stack connectivity, you can open command line and try:
PING /6 BING.COM
PING /4 BING.COM
Values may differ depending on your location but here they resolve to AAAA record [2620:1ec:c11::200] and A record 204.79.197.200 respectively.
If you're not getting IPv6 name resolution, your immediate DNS server may not have IPv6 support. Try this in a command line:
NSLOOKUP myip.opendns.com 2620:0:ccc::2
If you don't get an IPv6 response, your DNS server is bad. In that case, configure windows to use [2620:0:ccc::2] as a DNS server or something similar like 1.1.1.1.
Edge does work with IPv6, it just prioritises IPv4 name resolution first (to be clear technically, requests A records from DNS first rather than AAAA). If you try http://ip6only.me it will show you your IPv6 address if you have IPv6 connectivity (this DNS name only has AAAA record, not A).
You can also try a "dual" test site like https://test-ipv6.com or https://ipv6-test.com and you can confirm both are running.