Hi @john john,
Thanks for your detailed case description. I completely understand the situation and your feelings.
But according to the official file, I feel regretful to inform you that users who don't have delete permissions also can't change the file name, as designed by SharePoint.
Please accept my sincerely apologizes for any inconvenience this may cause. Thank you for your kind understanding.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.