Notebook activity failing with an error code 200 unable to create livy session while triggered using pipeline.

Question

I have a pipeline with series of notebook activity that runs sequentially once in every 4 hour. the pipeline was running fine for 1-2 weeks then started throwing the below error :

Notebook execution failed at Notebook service with http status code - '200', please check the Run logs on Notebook, additional details - 'Error name - Exception, Error value - Error while creating the livy session, RunId: 964b2f2b-50c8-4033-90f6-a1c8e443091f' :   the notebook is working fine when triggered manually, issue occurs only with pipeline. it occurs with the third notebook activity every time, i did try adding retry but didnt work, i did deactivate that particular notebook and everything ran fine. but the notebook is not having any issue.

Answer 1

@Sethulakshmi Sambasivan Thanks for the question and using MS Q&A platfrom.

MS Fabric is currently not supported in the Q&A forums, the supported products are listed over here Supported products on MS Q&A (more to be added later on).

You can ask the experts in the dedicated MS Fabric community forum.

Can you please open as a new thread in MS Fabric community: https://community.fabric.microsoft.com/t5/General-Discussion/bd-p/ac_generaldiscussion

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 2

After reviewing the relevant documents, it is evident that there is no specific information related to the issue you are facing with the notebook activity failing. However, it should be noted that as the fabric is in the development stage, there may have been some issues that required the involvement of the PG team. It is possible that the issue has already been resolved.

Answer 3

It got resolved by itself after two days.