Hi Trevor,
Welcome to Microsoft Community. To get rid of the icon you are referring to, I would suggest you to follow the suggestion posted by 8^th^ Wonder of the World, on November 22, 2013.
Let us know if you need any further help. Hope this information was helpful.
Thank You