Errors for running U-SQL Data Lake Analytics job with storage account as data soruce (MAG)

Azam Mohsin 21 Reputation points
2021-03-27T04:55:40.85+00:00

Hi,
I am following the steps here to compute author h index from the Microsoft Academic Graph: tutorial-usql-hindex. I already have a version of the data in my Azure Storage Account and I set up a Data Lake Analytics Account. I also added my Azure Storage Account as a source for my Data Lake Analytics Account.

Now, when I try running a job with the script provided, I get the following errors:

E_CSC_USER_DDLENTITYDOESNOTEXIST: Table Valued Function 'master.dbo.Affiliations' does not exist.  Line 6  
 E_CSC_USER_DDLENTITYDOESNOTEXIST: Table Valued Function 'master.dbo.Authors' does not exist.Line 7  
 E_CSC_USER_DDLENTITYDOESNOTEXIST: Table Valued Function 'master.dbo.Papers' does not exist. Line 8  
 E_CSC_USER_DDLENTITYDOESNOTEXIST: Table Valued Function 'master.dbo.PaperAuthorAffiliations' does not exist. Line 9  

I am following the instructions exactly how the page describes and I am not sure what is wrong. This worked for me a couple months ago completely fine.

I believe this errors results from these lines (6,7,8,9) of the script provided:

DECLARE @dataVersion string = "<MagContainer>";  
DECLARE @blobAccount string = "<AzureStorageAccount>";  
DECLARE @uriPrefix   string = "wasb://" + @dataVersion + "@" + @blobAccount + "/";  
DECLARE @outAuthorHindex string = "/Output/AuthorHIndex.tsv";  
  
@Affiliations = Affiliations(@uriPrefix);  
@Authors = Authors(@uriPrefix);  
@Papers = Papers(@uriPrefix);  
@PaperAuthorAffiliations = PaperAuthorAffiliations(@uriPrefix);  

I am replacing <MagContainer> and <AzureStorageAccount> with my own values, and I'm confused on why I am still getting the errors.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,348 questions
Azure Storage Explorer
Azure Storage Explorer
An Azure tool that is used to manage cloud storage resources on Windows, macOS, and Linux.
231 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
2,714 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,436 questions
Azure Data Lake Analytics
{count} votes

Accepted answer
  1. Saurabh Sharma 23,751 Reputation points Microsoft Employee
    2021-03-30T15:36:54.333+00:00

    @Azam Mohsin I have followed the tutorial and it worked fine for me. It looks like U-SQL Functions which needs to be created as part of the prerequisites section may have deleted in your environment and thus the current job script is not able to find the function. Please follow the steps as described here to create the functions.

    Please let me know if you still have any issues.

    ----------

    Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful