I found this solution on stackoverflow that worked for me.
In the properties window for the task, on the Action tab, when creating or editing the action that opens the batch file, there is the "Program/script:" field and there is also a "Start in (optional):" field. I previously had the "Program/script:" field containing the full path to the file, ending with the file name, and I had the "Start in (optional):" field with full path to the directory where the batch file is located.
This configuration appears to work without issue when the task is set to "Run only when user is logged on" in the General tab of the task's properties window. However, this configuration does not work when the task is set to "Run whether user is logged on or not".
In order to resolve the problem, I changed the action so that the "Program/script:" field contained only the file name, not the file path. I put the file path in the "Start in (optional):" field. This configuration works when the task is set to "Run whether user is logged on or not"!
Also, my batch file name does not have any spaces.