Hi @Blair ,
Thankyou for using Microsoft Q&A platform and posting your query.
Looking at your query, it seems when you execute the notebook directly , you are able to see the output . However, when you call the same notebook via Synapse pipelines , pipeline gets succeeded but output doesn't show up .
It is an expected behavior. To view the output after pipeline execution ,
- Pick up the Apache Spark application name from the output of pipeline
- Navigate to Apache Spark Application under Monitor tab and search for the same application name .
- These 4 tabs would be available there: Diagnostics,Logs,Input data,Output data
- Go to Logs ad check 'stdout' for getting the required output.
Attaching video for your reference:
For more details, please refer to this video: https://www.youtube.com/watch?v=ydEXCVVGAiY
If this answers your query, please do let us know.