how add class library for BeautifulSoup in Azure Databricks

Question

Verma, Manish Kumar 131

hi all,
how add class library for BeautifulSoup in Azure Data-bricks

i want to run below code in pyspark notebook

from bs4 import BeautifulSoup
import pandas as pd

table = BeautifulSoup(open('C:/age0.html','r').read()).find('table')
df = pd.read_html(table)

Answer 1

PRADEEPCHEEKATLA-MSFT 56,471 Microsoft Employee

Welcome to the Microsoft Q&A platform.

To install library for BeautifulSoup on Azure DataBricks:

%sh  
pip install beautifulsoup4

Tested on:

Databricks Runtime Version7.0 (includes Apache Spark 3.0.0, Scala 2.12)

Note: The file location should be Databricks File System (DBFS) or mount Azure Storage accounts. You cannot use local path in Azure Databricks.

Hope this helps. Do let us know if you any further queries.

----------------------------------------------------------------------------------------

Do click on "Accept Answer" and Upvote on the post that helps you, this can be beneficial to other community members.

1 answer