On sheet1, select the range of cells in column A to be checked. For example, A9:A22. On the Home tab, select Conditional Formatting -> New Rule -> Use a formula. Enter the formula "=sheet1!a9<>sheet2!a9" without the quotes. Click OK several times and force a mismatch in the data to test.
Repeat for column B