Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,735 questions
0 answers
How to connect and query with MySQL server using Azure Machine Learning
Hi, I am currently working on a project where I need to connect to an Azure Database for MySQL using Azure Machine Learning (AML) and Python scripts. However, I want to use AML resources such as Datastore and Dataset for the connection rather than…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(272, 33%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETN%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 78%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ED%3C/text%3E%3C/svg%3E)
1 answer
ADF Pipeline intermittently failing - why?
Hi, Our organisation is new to Azure Data Factory (ADF) and we're facing an intermittent error with our first Pipeline. Being intermittent adds that little bit more complexity to resolving the error. The Pipeline has two activities: Script…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(67.2, 21%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 89%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
1 answer
adf from configtable
Hi, how to load tablename from config table and using copy activity at front end... how it will execute it.... let say copy activtiy lookup for tablename then how copy activity will take that...please help with screenshot ...
asked 2024-07-21T20:01:20.1833333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 13%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
Vineet S
445
Reputation points
commented 2024-07-29T08:19:58.03+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 46%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EN%3C/text%3E%3C/svg%3E)
NIKHILANETHIKUNTA
155
Reputation points Microsoft Vendor
0 answers
The issue with the on-fail activity
Dear Mr/Ms, I created a pipeline, there is a If Condition Activity in the pipeline as below: The content in the If Conditioin is as below: In If Condition, I set up the pipeline, if any activities failed, the next step is updating by Store procedure.…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 93%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EET%3C/text%3E%3C/svg%3E)
1 answer
How to delete files from source storage after sharing through Azure Data Share
Is there a way to delete files from the source storage after sharing them through data share? I'd like to clean up the storage, but since data share doesn't have a feature for deleting shared files, I'm not sure how to do it. Any suggestions?
asked 2024-07-24T12:47:37.2433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(252.8, 3%, 34%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDC%3C/text%3E%3C/svg%3E)
DEEPANSHU CHAUHAN
0
Reputation points
commented 2024-07-29T08:06:30.6033333+00:00
DEEPANSHU CHAUHAN
0
Reputation points
1 answer
refresh token pipeline parameter runs successfully during manual trigger but not scheduled trigger
I have an ADF pipeline set up with LS_RestServiceNetSuite. Within the pipeline there is a web activity "Get_Access_Token" that has started to fail. In this activity, in the URL field we passed: …
asked 2024-07-24T18:08:44.1966667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(217.60000000000002, 18%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EEA%3C/text%3E%3C/svg%3E)
Evelyn Ajayi
0
Reputation points
commented 2024-07-29T08:05:36.78+00:00
NIKHILANETHIKUNTA
155
Reputation points Microsoft Vendor
0 answers
Securing args of the Python script in Azure Data Factory Custom Azure Batch Activity
Hi, Imagine running a simple ADF Pipeline that consists of 2 steps: Fetching a sensitive value - like Storage Account URL - from Azure Key Vault Executing a Python script with argsparse where this value is set as an argument with the command …
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 20%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3E14%3C/text%3E%3C/svg%3E)
0 answers
Copy Data Lineage Activity is not reported in Purview
Hi, Context: I have a data pipeline in ADF. The pipeline contains the following activities A total of 15 number of copy data activity Total 1 number of Data Flow activity The data source for all activities is a common blob storage account. The data…
asked 2024-07-26T14:58:02.5+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(102.4, 26%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ER%3C/text%3E%3C/svg%3E)
Ravineesh
80
Reputation points
commented 2024-07-29T07:45:01.18+00:00
PRADEEPCHEEKATLA-MSFT
85,826
Reputation points Microsoft Employee
1 answer
HttpRequestFailedWithUnauthorizedError output after Copy Data function when extract data from Sharepoint to adl using data factory
I followed the tutorial from "https://www.youtube.com/watch?v=FFfNu3cI-uw&pp=ygUjZXh0cmFjdCBkYXRhIGZyb20gc2hhcmVwb2ludCB0byBhZGw%3D" but this error occurred. "errors": [ { "Code": 22757, "Message":…
asked 2024-07-29T06:13:18.0233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 74%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EXL%3C/text%3E%3C/svg%3E)
Xing Le Lee
0
Reputation points
answered 2024-07-29T07:05:56.01+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 81%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAS%3C/text%3E%3C/svg%3E)
Amrinder Singh
4,910
Reputation points Microsoft Employee
2 answers
"Dataset is using 'AzureSqlDatabase' linked service with SQLVersion 'Recommended', which is not supported in data flow." I am facing this error, please help me to understand which sql version should i use? should i create 'mysqldatabase' rather than sql ?
I have tried solving this problem by disabling the Always encrypted check button in linked services. I am not understanding what to do?
asked 2024-07-29T06:14:30.8766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(220.8, 96%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVH%3C/text%3E%3C/svg%3E)
Vedant Hosamani
0
Reputation points
commented 2024-07-29T07:04:39.0566667+00:00
PRADEEPCHEEKATLA-MSFT
85,826
Reputation points Microsoft Employee
0 answers
Is there a limitation of the HubSpot Source connector for Contact records to 5,900 records?
I am using the HubSpot source connector in Azure Data Factory for Companies and Contacts and associated properties. I have a "Copy Data" activity that references the "HubSpot Contact" dataset in entirety, using "Table", not…
asked 2024-07-24T23:05:22.3233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 81%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGB%3C/text%3E%3C/svg%3E)
Grant Barrington
0
Reputation points
commented 2024-07-29T06:57:59.8366667+00:00
PRADEEPCHEEKATLA-MSFT
85,826
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
How to generate JWT token for client_assertion?
We have an app registration which is connected to an external API. We have to use this API in our Azure Data factory. For this purpose, till now we were generating client secrets and generating tokens (in Azure Data Factory) from this URL -…
asked 2024-07-18T08:15:12.36+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(166.4, 4%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDA%3C/text%3E%3C/svg%3E)
Devansh Agarwal
20
Reputation points
accepted 2024-07-29T06:53:22.75+00:00
Devansh Agarwal
20
Reputation points
2 answers
One of the answers was accepted by the question author.
dataset is using azuresqldatabase linked service type with sql encryption, which is not supported in data flow sink
Hi, when i am using dataflow in ADF at sink place i am getting this below error. source as azuresql and sink also azuresql but am unbale to success the pipeline. Error details: dataset is using azuresqldatabase linked service type with sql encryption,…
asked 2023-04-24T10:19:20.1733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 43%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBR%3C/text%3E%3C/svg%3E)
Bommisetty, Rakesh (Hudson IT Consultant)
170
Reputation points
answered 2024-07-29T06:52:36.74+00:00
Vedant Hosamani
0
Reputation points
0 answers
How to fix {"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'peopleSQL': ERRORCODE:MSSQL_101, STAGE:UPSERT-N-WAY, SQLERRORCODE:1750, MESSAGE:Could not create constraint or index.
Hello, I struggle with running a pipeline which calls a data flow. At the end of the flow the data should get updated (via Upsert) into a SQL database. But I get the following error and I have no idea what could be wrong and where to look for to solve…
asked 2024-07-22T08:54:04.6933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(60.8, 90%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERZ%3C/text%3E%3C/svg%3E)
Roger Zirn
0
Reputation points
commented 2024-07-29T06:50:19.8366667+00:00
PRADEEPCHEEKATLA-MSFT
85,826
Reputation points Microsoft Employee
1 answer
Error code11000
Error details Error code11000 DetailsThe operation failed, detailed error: An internal error has occurred. Please retry the operation at a later time. If the issue persists, please contact Microsoft support for further assistance. Activity…
asked 2024-07-22T11:27:33.17+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(313.6, 31%, 40%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDM%3C/text%3E%3C/svg%3E)
Deepak Munjral
5
Reputation points
commented 2024-07-29T06:50:06.8633333+00:00
PRADEEPCHEEKATLA-MSFT
85,826
Reputation points Microsoft Employee
1 answer
Change Data Capture preview feature not working
I am trying to perform some poc by using change data capture feature which is in preview, but I am not able to see table results. I create a connection with Azure SQL Database and get a succesful connection, but when I try to fetch tables every time its…
asked 2024-07-22T07:31:37.3133333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(73.60000000000001, 32%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAG%3C/text%3E%3C/svg%3E)
Anmol Ganju
176
Reputation points
commented 2024-07-29T06:49:15.02+00:00
PRADEEPCHEEKATLA-MSFT
85,826
Reputation points Microsoft Employee
1 answer
What is the difference between self-hosted and Azure integration runtime?
The Azure integration runtime with a managed virtual network has the same region as your data factory. It can't be auto resolved like the Azure integration runtime. The self-hosted integration runtime is located in the region of your local machines or…
asked 2024-07-22T06:49:14.1766667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 15%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESD%3C/text%3E%3C/svg%3E)
Santo Daiz
0
Reputation points
commented 2024-07-29T06:47:41.18+00:00
PRADEEPCHEEKATLA-MSFT
85,826
Reputation points Microsoft Employee
1 answer
how ADF connection to Azure Delta Lake ?
Are there any plans to provide connection between ADF v2/Managing Data Flow and Azure Delta Lake? It would be great new source and sync for ADF pipeline and Managing Data Flows to provide full ETL/ELT CDC capabilities to simplify complex lambda data…
asked 2024-07-22T06:14:23.61+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 85%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESW%3C/text%3E%3C/svg%3E)
shane want
0
Reputation points
commented 2024-07-29T06:47:25.03+00:00
PRADEEPCHEEKATLA-MSFT
85,826
Reputation points Microsoft Employee
1 answer
In Data Factory CDC (Preview), I am forced to choose an incremental column when configuring a source SQL table, even though CDC is enabled on the source table.
When configuring a change data capture resource in ADF, I used as a reference this video, in which it is stated that if we have CDC enabled on a source SQL table, we don't need to specify an incremental column. I have decided to do reproduce the same…
asked 2024-07-22T16:34:55.31+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(169.60000000000002, 41%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EDR%3C/text%3E%3C/svg%3E)
Dario Ruben Scanferlato
5
Reputation points
commented 2024-07-29T05:59:12.3366667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
12,620
Reputation points Microsoft Vendor
1 answer
Linked service authentication options for SQL Server are different amongst ADF within same subscription
In the same Azure subscription, I have several resource groups and each has data factories, however, the linked service authentication options are not the same among them, why? Here is an example: ADF1: SQL SERVER Linked service authentication…
asked 2024-07-19T10:42:32.6633333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(227.2, 5%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGA%3C/text%3E%3C/svg%3E)
Gonçalo J P Carvalho
0
Reputation points
commented 2024-07-29T05:54:54.01+00:00
Smaran Thoomu
12,620
Reputation points Microsoft Vendor