Azure Databricks and Repo

Question

Azure Databricks and Repo

Gopinath Rajee 656

All,

We added a repo from our AzureDevOps by Cloning the repository. However, when I try to access the json file in the spark dataframe it is failing with the below errors:

Has anyone got this error before?

I'm able to access the files by running

%sh ls -l /Workspace/Repos/meta-data/json/CS.json

Update: Turns out that issue seems to be with loading json file since I'm able to csv load data.

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-09-15T09:28:35.717+00:00

Hello @Gopinath Rajee ,

Thanks for the question and using MS Q&A platform.

Can you please help on what are the options you get if you right click on the CS.json file?

1 answer

Your answer

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-09-15T09:28:35.717+00:00

Hello @Gopinath Rajee ,

Thanks for the question and using MS Q&A platform.

Can you please help on what are the options you get if you right click on the CS.json file?

Answer 1

Gopinath Rajee 656

Don't know why but this is how it has to be read:

**

import os
df = spark.read.option("multiline","true).json("file:/Workspace/Repos/metadata/json/CS.json)

**

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-09-19T08:22:11.64+00:00

Hello @Gopinath Rajee ,

Are you able to read the cs.json file?
Gopinath Rajee 656 Reputation points

2022-09-19T10:43:49.637+00:00

I'm able to read the json file
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2022-10-10T06:52:12.777+00:00

Hello @Gopinath Rajee ,

Apologize for the delay in response.

Glad to know you are able to read the json file.

Share via

Azure Databricks and Repo

1 answer

Your answer