I was able to resolve the issue. I made two changes.
I removed this line:
logger.info("Azure: CLOSING on %s", event.result.json)
Trying to get the result.json in the closing event was messing it up.
Also I moved the speech_recognizer.stop_continuous_recognition() to after the while loop.