Yes, the audio quality on 48k will be higher. This is basically a difference in the bitrate and encoding type, so exporting a higher quality audio will definitely help in the quality of the videos. The supported audio formats are also listed here. You can use tools like audacity to check the difference of quality in these formats.
If an answer is helpful, please click on or upvote which might help other community members reading this thread.