Hi Ankur,
I am Sumit, an Independent Advisor and a 3 year Windows Insider MVP here to help.
Directly changing the extension is possible, but it would make the file unable to open. Every extension has its own kind of encoding(in layman terms, a format that software can read).
First of all, click view and enable show file extensions.
Right-click the file and choose rename. See the GIF.