Fabric Notebook too big

jh 20 Reputation points
2023-11-02T16:47:13.0566667+00:00

I have a Notebook that runs fine when I run it manually. But once I try to automate the notbook to run I get this error Failed to run notebook due to invalid request. [Error: Size of notebook content and exit value must be less than 8MB. Please try to write large outputs to files (Parameter 'resultSnapshot') Actual value was Microsoft.Analytics.SynapseNotebookExecService.Models.RunNotebookSnapshot.]

I've tried reducing the size of the notebook to remove the visuals and outputs, but the notebook is retrieving data from an API, loading it into a csv, I save the csv to a dataframe, transforming it, then loading the dataframe into the Lakehouse.

Any tips or advice to get the notebook to automate?

Thanks in advance. 

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,195 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
3,818 questions
0 comments No comments
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA-MSFT 70,041 Reputation points Microsoft Employee
    2023-11-03T04:55:26.5466667+00:00

    @jh - Thanks for the question and using MS Q&A platform.

    MS Fabric is currently not supported in the Q&A forums, the supported products are listed over here Supported products on MS Q&A (more to be added later on).

    You can ask the experts in the dedicated MS Fabric community forum.

    Can you please open as a new thread in MS Fabric community: https://community.fabric.microsoft.com/t5/General-Discussion/bd-p/ac_generaldiscussion

    I see you have already raised a question on Fabric community: https://community.fabric.microsoft.com/t5/General-Discussion/Fabric-Notebook-too-big/td-p/3509586 you can continue your discussion on that thread and we will close this thread.

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

0 additional answers

Sort by: Most helpful