You should enable the system.debug == true
variable and check the "Enable System Diagnostics" for a build, run the build, and then inspect the logs for it. The actual msbuild.exe command that is executed will be in there, with all the parameters its using.
Clean all of the bin and obj folders in your solution, and then take the command from the build log and and try running it locally to see if you get output.
Chances are that you will see the same as the build agent is seeing, and have probably not named the correct solution configuration (Debug, Release) or something simple like that.
If you didnt find an msbuild command in the logs then you have to fix the build definition to add it. Try creating a new build definition using the Task based engine and not the YAML way. YAML builds are newer and probably a bit buggy.