@nishikata-h Please take a look at the below document, which calls out the need to add the necessary IP ranges that need to be added in the NSG of the network subnet that your private endpoint is in to allow the traffic from Azure DevOps.
Please let us know if this resolves the issue. Otherwise we can continue assiting you. We look forward to your reply.
https://learn.microsoft.com/en-us/azure/devops/pipelines/agents/hosted?view=azure-devops&tabs=yaml#networking)
JSON file that contains the IP addresses, which is updated weekly. (https://www.microsoft.com/en-us/download/details.aspx?id=56519)