Synapse Spark Notebook, want to view cell output for scheduled runs

Computer Mike 86 Reputation points
2022-08-15T16:26:58.23+00:00

I want to see the details of my scheduled synapse spark notebook. When I run my notebook while developing, I can see the output when I run all cells. I thought I saw a property, that saves that output, so the next morning I can open my notebook and see the results. I read about this, but can't see where enabled.

Please help,

Mike

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,375 questions
0 comments No comments
{count} votes

Accepted answer
  1. AnnuKumari-MSFT 34,556 Reputation points Microsoft Employee Moderator
    2022-08-16T11:07:29.21+00:00

    Hi @Computer Mike ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your question.

    As I understand your query, you want to know how to view output of each cell of a synapse notebook which gets executed by a scheduled trigger.

    You can view the notebook run details of your scheduled pipeline in the pipeline runs under monitor tab by clicking the 'Open Notebook snapshot' option looks like spectacles icon.

    231516-image.png

    I have created a notebook and attached it to the scheduled trigger and am able to view the output of each cells in the monitor tab.
    Under the pipeline run, go to the monitor application option and select logs tab and check the output in stdout menu. Attaching the video for reference.

    231522-notebookoutput.gif

    Note: You can use print() function instead to write text into stdout. For more details, please Check Known limitations in Azure Synapse Analytics

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.