Do you also see ¶ at the end of each paragraph? If so, click on the Show\Hide (¶) button in the Paragraph section of the Home tab of the ribbon.
See the article "What do all those funny marks, like the dots between the words in my document, and the square bullets in the left margin, mean?” at: