Hi Team, Is there any command to list all the widgets used in the NB. My requirement is to log all the widgets used in each NB, since widget changes of each NB if there is some command which will give widget and value used in that NB i can add it All NB

List all the widgets in NB

Accepted answer

PRADEEPCHEEKATLA-MSFT 85,586 Microsoft Employee

@Sharukh Kundagol Apologies for the inconvenience caused due to the incorrect answer provided above.

As per the repro, I had found that there is no command called dbutils.widgets.list() in dbutils.widgets module.

User's image

Here is the command to log all the widgets used in a notebook:

# Log all the widgets used in the notebook
my_widgets = dbutils.notebook.entry_point.getCurrentBindings() 
{key: my_widgets[key] for key in my_widgets}

You can add this code to each notebook to log all the widgets used in that notebook.

User's image

Hope this helps. Do let us know if you any further queries.

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Sharukh Kundagol 125 Reputation points

2023-03-30T03:22:16.14+00:00

Hi Pradeep,

Even though this solution worked in standard Clusters it is not working for High concurrency cluster when we run the dbutils.notebook.entry_point.getCurrentBindings() command we are getting

py4j.security.Py4JSecurityException ERROR.
PRADEEPCHEEKATLA-MSFT 85,586 Reputation points Microsoft Employee

2023-03-31T03:29:53.83+00:00

@Sharukh Kundagol - Is the above comment is related to this ask or the other thread which you have created?
Sharukh Kundagol 125 Reputation points

2023-03-31T04:43:44.3233333+00:00

It is related to this thread only. as you suggested below command to get the widgets but in High Concurrency cluster this command is throwing py4j.security.Py4JSecurityException Error.

dbutils.notebook.entry_point.getCurrentBindings()
PRADEEPCHEEKATLA-MSFT 85,586 Reputation points Microsoft Employee

2023-04-03T04:24:22.35+00:00

@Sharukh Kundagol - Can you please share the details on the DBR run time and the code which you are using along with the stacktrace of the error message?

Sharukh Kundagol 125

HI Pradeep, code :

dbutils.notebook.entry_point.getCurrentBindings()

Run time is : User's image

error:

Py4JError                                 Traceback (most recent call last)
/databricks/python/lib/python3.8/site-packages/IPython/core/formatters.py in __call__(self, obj)
    700                 type_pprinters=self.type_printers,
    701                 deferred_pprinters=self.deferred_printers)
--> 702             printer.pretty(obj)
    703             printer.flush()
    704             return stream.getvalue()

/databricks/python/lib/python3.8/site-packages/IPython/lib/pretty.py in pretty(self, obj)
    392                         if cls is not object \
    393                                 and callable(cls.__dict__.get('__repr__')):
--> 394                             return _repr_pprint(obj, self, cycle)
    395 
    396             return _default_pprint(obj, self, cycle)

/databricks/python/lib/python3.8/site-packages/IPython/lib/pretty.py in _repr_pprint(obj, p, cycle)
    698     """A pprint that just redirects to the normal repr function."""
    699     # Find newlines and replace them with p.break_()
--> 700     output = repr(obj)
    701     lines = output.splitlines()
    702     with p.group():

/databricks/spark/python/lib/py4j-0.10.9.1-src.zip/py4j/java_collections.py in __repr__(self)
    101             "{0}: {1}".format(repr(k), repr(v))
    102             for k, v in iteritems(self))
--> 103         return "{{{0}}}".format(", ".join(items))
    104 
    105 

/databricks/spark/python/lib/py4j-0.10.9.1-src.zip/py4j/java_collections.py in <genexpr>(.0)
     98 
     99     def __repr__(self):
--> 100         items = (
    101             "{0}: {1}".format(repr(k), repr(v))
    102             for k, v in iteritems(self))

/usr/lib/python3.8/_collections_abc.py in __iter__(self)
    741 
    742     def __iter__(self):
--> 743         for key in self._mapping:
    744             yield (key, self._mapping[key])
    745 

/databricks/spark/python/lib/py4j-0.10.9.1-src.zip/py4j/java_collections.py in __iter__(self)
     89 
     90     def __iter__(self):
---> 91         return self.keySet().iterator()
     92 
     93     def __contains__(self, key):

/databricks/spark/python/lib/py4j-0.10.9.1-src.zip/py4j/java_gateway.py in __call__(self, *args)
   1302 
   1303         answer = self.gateway_client.send_command(command)
-> 1304         return_value = get_return_value(
   1305             answer, self.gateway_client, self.target_id, self.name)
   1306 

/databricks/spark/python/pyspark/sql/utils.py in deco(*a, **kw)
    115     def deco(*a, **kw):
    116         try:
--> 117             return f(*a, **kw)
    118         except py4j.protocol.Py4JJavaError as e:
    119             converted = convert_exception(e.java_exception)

/databricks/spark/python/lib/py4j-0.10.9.1-src.zip/py4j/protocol.py in get_return_value(answer, gateway_client, target_id, name)
    328                     format(target_id, ".", name), value)
    329             else:
--> 330                 raise Py4JError(
    331                     "An error occurred while calling {0}{1}{2}. Trace:\n{3}\n".
    332                     format(target_id, ".", name, value))

Py4JError: An error occurred while calling o366.iterator. Trace:
py4j.security.Py4JSecurityException: Method public final java.util.Iterator java.util.HashMap$KeySet.iterator() is not whitelisted on class class java.util.HashMap$KeySet
	at py4j.security.WhitelistingPy4JSecurityManager.checkCall(WhitelistingPy4JSecurityManager.java:473)
	at py4j.Gateway.invoke(Gateway.java:294)
	at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
	at py4j.commands.CallCommand.execute(CallCommand.java:79)
	at py4j.GatewayConnection.run(GatewayConnection.java:251)
	at java.lang.Thread.run(Thread.java:750)

PRADEEPCHEEKATLA-MSFT 85,586 Reputation points Microsoft Employee

2023-04-10T06:41:33.6666667+00:00

@Sharukh Kundagol - Thanks for the details, let me check and get back to you.

Share via

List all the widgets in NB

0 additional answers