web table linked service in azure data factory

KEERTHANA JAYADEVAN 66

Does anyone know what does an index in Web table dataset mean?How should we give one, when i try to gave 1, its throwing an error while previewing data .

The value of the property 'index' is invalid: 'The required property is not specified. Parameter name: index'. The required property is not specified. Parameter name: index

AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee

2022-09-26T04:32:40.38+00:00

Hi @KEERTHANA JAYADEVAN ,
Just checking in to see if the below answer helped. Please do consider clicking Accept Answer and Up-Vote for the same as accepted answers help community as well. If you have any further query do let us know.
KEERTHANA JAYADEVAN 66 Reputation points

2022-09-26T04:51:36.863+00:00

Hi,
My issue has not been resolved. This page is dynamic as in the report gets changed on a monthly basis. I need to create a PL in ADF, of extracting this table in the portal to load to sql server and schedule the jib monthly. But what i get is the html response of the page. May I know the reason for that.
AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee

2022-09-30T05:41:50.067+00:00

Hi @KEERTHANA JAYADEVAN ,
Just checking in to see if the below answer helped. Please do consider clicking Accept Answer and Up-Vote for the same as accepted answers help community as well. If you have any further query do let us know.

1 answer

AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee

2022-09-23T10:53:42.77+00:00
Hi @KEERTHANA JAYADEVAN ,
Welcome to Microsoft Q&A platform and thank you for posting your question.

As I understand your query, you want to know the significance of index in web table connector of ADF. Please let me know if my understanding is incorrect.

Index means the starting point of the web table . You can get the index position of a web table by using Advanced Editor in the Query editor window of the excel.

To get the index of a table which you need to configure in dataset properties, you can use e.g. Excel 2016 as the tool as follows:

Launch Excel and switch to the Data tab.

Click New Query on the toolbar, point to From Other Sources and click From Web.

In the From Web dialog box, enter URL that you would use in linked service JSON along with path you would specify for the dataset and click OK.

If you see Access Web content dialog box, select the right URL, authentication, and click Connect.

Click a table item in the tree view to see content from the table and then click Edit button at the bottom.

In the Query Editor window, click Advanced Editor button on the toolbar.

In the Advanced Editor dialog box, the number next to "Source" is the index.

For getting more details, kindly check : Copy data from Web table by using Azure Data Factory or Synapse Analytics

Hope this will help. Please let us know if any further queries.

------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you.
Original posters help the community find answers faster by identifying the correct answer. Here is how

Want a reminder to come back and check responses? Here is how to subscribe to a notification

If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
Please sign in to rate this answer.

1 person found this answer helpful.
KEERTHANA JAYADEVAN 66 Reputation points

2022-09-23T11:46:37.917+00:00

i tried this, what i am getting is the html response of that page

AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee

2022-09-23T12:53:14.643+00:00

Hi @KEERTHANA JAYADEVAN ,
Could you please share the web page URL if that is a publicly accessible web page so as to repro your scenario and help you better. If not, could you please share the screenshots for more details.

KEERTHANA JAYADEVAN 66 Reputation points

2022-09-23T13:09:41.087+00:00

Thats not a publically accessible website. Attaching the data that i get while i use excel.

KEERTHANA JAYADEVAN 66 Reputation points

2022-09-23T13:11:18.543+00:00

I tried connecting the same website using web activity as well. the output is as below, html code

AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee

2022-09-23T13:58:56.257+00:00

Hi @KEERTHANA JAYADEVAN ,
Are you sure the web page contains a web table that means representing data in the form of rows and columns? Is the web table static or dynamic?

I tried to repro using a web page URL , I am able to fetch the index value as per the steps in the document . Attaching the video for reference:

Kindly check the following video to see if you are missing something : How to copy data from Web Table into Sql Table using synapse pipelines

Please do let us know if it was helpful . Thanks .

KEERTHANA JAYADEVAN 66 Reputation points

2022-09-26T04:57:36.883+00:00

@AnnuKumari-MSFT I checked the above video. In my case, while gettng data from excel, I am not gettng that table details of my page. What i am getting is only document

KEERTHANA JAYADEVAN 66 Reputation points

2022-09-26T05:00:51.093+00:00

Also this particular page is a salesforce site, so do we need to use a salesforce LS connector?

AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee

2022-09-26T05:21:46.457+00:00

Hi @KEERTHANA JAYADEVAN ,

Web table connector extracts table content from an only HTML webpage. Right now, the only way to authenticate to the Web table connector is by using authentication type as 'Anonymous' . As you mentioned, the web page you are trying to access is not publicly accessible page.

Could you please check if using web table connector in the linked service, are you able to successfully connect? If not, then , web table is not the suitable connector in your case.

Probably, you need to go for REST API connector/ Salesforce connector. As I cannot reproduce your issue, I would wait for your response, once you try out the suggested connectors, we can check whether the issue persists or not. Thanks .

KEERTHANA JAYADEVAN 66 Reputation points

2022-09-26T05:30:41.07+00:00

I will try with salesforce connector and let you know. For this connector we need to get the details like client id/API version/Username/Password etc right

AnnuKumari-MSFT 32,906 Reputation points Microsoft Employee

2022-09-26T15:15:25.157+00:00

@KEERTHANA JAYADEVAN ,
Yes right !
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

web table linked service in azure data factory

1 answer

Your answer