Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
2,971 questions
1 answer
Could you please let me know how reliable to use OpenCensus library in azure databricks for logging and any Microsoft support available in case of product issues?
We would like to use Opencensus in Azure Data Bricks with Python for logging with Azure Monitor. Could you please let me know how reliable this library to use in our application and any Microsoft support available in case of any product issues?
asked 2020-11-25T18:06:26.49+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(70.4, 44%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETN%3C/text%3E%3C/svg%3E)
Tanguturi, Naresh
1
Reputation point
answered 2020-12-03T06:34:39.97+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Service principal for custom Spark app
I've got a custom Spark app built on top of a custom PaaS (OpenShift based) deployed on Azure IaaS. Is it possible to assign a service principal to my app for the purpose of access control? If so, how do I do it?
asked 2020-11-25T11:42:14.303+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(304, 75%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMN%3C/text%3E%3C/svg%3E)
Minh NGUYEN
126
Reputation points
accepted 2020-12-01T12:50:14.973+00:00
Minh NGUYEN
126
Reputation points
1 answer
Register Azure ML Model from DatabricksStep
Hi, I'm calculating a model while executing a DatabricksStep in an Azure ML Pipeline, save it on my Blob Storage as .pkl file and upload it to the current Azure ML Run using Run.upload_file (). All this works without any problems. But as soon as I try to…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 78%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(22.400000000000002, 11%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERM%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Azure Databricks - How to restrict users don't spinup clusters with "L" Series?
How to create or change cluster policy (Spark) in Databricks to restrict users don't spinup clusters with "L" Series? to restrict users to change from existing series to "L"?
asked 2020-11-23T21:15:49.287+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 46%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVK%3C/text%3E%3C/svg%3E)
Vijay Kumar
2,026
Reputation points
accepted 2020-11-30T17:30:06.383+00:00
Vijay Kumar
2,026
Reputation points
1 answer
One of the answers was accepted by the question author.
data factory - databricks
Hello, I am in the process of learning the data factory. 1- Is there anything that data factory/data flow does not do which means it needs to be done in databricks? I am trying to find-out that if I know data factory really well, then is there a…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 97%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
0 answers
¿Tengo el servicio si soy de CCH?
Al iniciar la sesión y querer obtener el servicio no me deja, me marca un error. AADSTS50011: The reply URL specified in the request does not match the reply URLs configured for the application: '8e0e8db5-b713-4e91-98e6-470fed0aa4c2'. Spanish =>…
asked 2020-11-21T21:00:30.487+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 8%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
Anonymous
commented 2020-11-26T12:18:34.817+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
0 answers
You do not have access
You do not have access Sorry but our systems are a detecting a problem with your account and are unable to validate your access. Please contact Support and reference the following transaction ID and message code. TransactionId:…
asked 2020-11-24T20:25:11.083+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 87%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESR%3C/text%3E%3C/svg%3E)
Steve Rock
1
Reputation point
commented 2020-11-26T12:07:26.73+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Learning databricks
Hello, I have been searching online websites and youtube for good step by step learning tutorials which I can follow along to learn databricks as well as databricks inside ADF. 1- Can you please recommend websites or youtube channels? 2- I do…
1 answer
One of the answers was accepted by the question author.
Handshake fails trying to connect from Azure Databricks to Azure PostgreSQL with SSL
We're trying to connect to an Azure Database for PostgreSQL flexible server from Databricks using the jdbc driver org.postgresql.Driver. Since the flexible server enforces SSL, we added the ssl and sslmode options to our existing code: driver =…
asked 2020-11-21T12:23:57.117+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 71%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETH%3C/text%3E%3C/svg%3E)
Tobias Himmighöfer
21
Reputation points
commented 2020-11-24T07:08:31.24+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
2 answers
One of the answers was accepted by the question author.
Convert dataframe column datatypes according to target table column datatypes - Databricks
Hi All, I am currently loading the csv file, all with string datatypes columns to dataframe df. I want to write this data into an existing table which has different datatypes. So basically in csv file I have a column CreatedDate as string and my…
asked 2020-11-17T11:39:40.01+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(275.2, 98%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Ashish Sinha
161
Reputation points
commented 2020-11-20T04:57:55.493+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
1 answer
Custom Managed key for Azure Databricks Notebook
How to set customr managed key for notebook in Azure daabricks
asked 2020-11-04T10:35:37.78+00:00
Anonymous
commented 2020-11-19T17:54:07.127+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 44%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESS%3C/text%3E%3C/svg%3E)
Saurabh Sharma
23,781
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to print any plot on Databricks?
%matplotlib inline corr = df.corr() f, ax = plt.subplots(figsize=(11, 9)) ax = sns.heatmap( corr, vmin=-1, vmax=1, center=0, cmap=sns.diverging_palette(20, 220, n=500), linewidths=.50, cbar_kws={"shrink": .7}, …
asked 2020-11-05T12:38:53.25+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(19.2, 12%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESB%3C/text%3E%3C/svg%3E)
Siddhesh Bhurke
46
Reputation points
commented 2020-11-18T19:16:14.217+00:00
Siddhesh Bhurke
46
Reputation points
1 answer
One of the answers was accepted by the question author.
Execute Create Table query in Synapse using Databricks
Hi All, So this is my first time using Azure Databricks. I was trying out to load the csv files from my blob to my synapse SQL DW. I am currently using this code:- df.write \ .format("com.databricks.spark.sqldw") \ …
asked 2020-11-15T18:48:30.577+00:00
Ashish Sinha
161
Reputation points
commented 2020-11-16T16:03:09.843+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 21%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDB%3C/text%3E%3C/svg%3E)
David Browne - msft
3,771
Reputation points
1 answer
Is it possible to access Databricks DBFS from Azure Data Factory?
I would like to use the Copy Data Activity in Data Factory to move data from/to Databricks DBFS. I have my databricks workspace successfully linked to Data Factory as a linked service. If I select Azure Delta Storage as a dataset source or sink, I am…
asked 2020-11-09T13:07:49.41+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(48, 51%, 14%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NewUser
1
Reputation point
commented 2020-11-10T18:05:53.303+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
MartinJaffer-MSFT
26,051
Reputation points
2 answers
Azure Databrick Cluster Nodes Encryption in transit
I want to Encrypt traffic between cluster worker nodes although this feature is in private preview. Below is the link: https://learn.microsoft.com/en-us/azure/databricks/security/encryption/encrypt-otw Can someone share any commands/API to create…
asked 2020-10-02T11:35:51.33+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 61%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAV%3C/text%3E%3C/svg%3E)
Akash Verma
21
Reputation points
commented 2020-11-09T14:29:46.437+00:00
Akash Verma
21
Reputation points
2 answers
Weird display for equal sign
Hello, I am using chrome on databrick notebook, but the sign "=" displays weirdly(but works fine). How can I revise this? Any suggestion will be appreciated, thank you.
asked 2020-10-23T01:44:43.63+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(179.20000000000002, 21%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJ%3C/text%3E%3C/svg%3E)
Jonathan
6
Reputation points
commented 2020-11-03T11:39:40.657+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
0 answers
Loading data from .csv
Today I am unable to load data from a .csv into Dynamics365 Sales. Earlier in the day, I deleted all of our records with the hope of importing the data again with a new mapping system. I have tried to upload throughout the day. Sometimes, nothing…
asked 2020-10-23T17:53:56.787+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 71%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPA%3C/text%3E%3C/svg%3E)
Peter Abraldes
1
Reputation point
commented 2020-11-02T22:32:50.847+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(192, 26%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EHM%3C/text%3E%3C/svg%3E)
HimanshuSinha-msft
19,376
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Getting error while using databricks command in ubuntu Vm even after installing databricks-cli
Hi , I am working on one requirement of monitoring databricks with azure monitor. and i m using below document for this .. https://github.com/mspnp/spark-monitoring in one my ubuntu Vm i have completed all pre-requisites .. i also installed…
asked 2020-10-30T10:02:21.333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(35.2, 28.000000000000004%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERB%3C/text%3E%3C/svg%3E)
Rohit Boddu
461
Reputation points
accepted 2020-11-02T05:27:06.867+00:00
Rohit Boddu
461
Reputation points
0 answers
How to integrate Databricks with PowerBI
Hi, I want to integrate Azure Databricks with PowerBI.. Below is my requirement .. I want to generate Power Bi Reports out of Adls using hive tables .. How can i achieve this ? But i m getting below error attached in screenshot while…
asked 2020-10-30T10:17:09.853+00:00
Rohit Boddu
461
Reputation points
commented 2020-11-02T05:00:29.12+00:00
PRADEEPCHEEKATLA-MSFT
84,531
Reputation points Microsoft Employee
1 answer
I would pay cash money for a graphical UI on the portal/dashboard.
Once you get to 200+ resources, the dashboard is a complete disaster. Graphical UI! Make it look like a Windows desktop for all I care.
asked 2020-10-30T15:36:27.34+00:00
Black, Michael
1
Reputation point
answered 2020-10-30T21:25:58.077+00:00
JamesTran-MSFT
36,531
Reputation points Microsoft Employee