In the storyboard/project area you should see rectangles below your photos and videos. Those tracks represent the added music, narration or sound effects. Select the audio clips you want to remove, right click and choose "Remove".
If you are talking about the audio that is part of the video track, your go to the Video Tools | Edit tab and you set the "Video volume" down to 0. Then add your music as usual.