Meaning of DF-Rest_006 - Row marker value:17 is not valid! isssue

Question

Meaning of DF-Rest_006 - Row marker value:17 is not valid! isssue

Gabriel Dodu-Balaban 1

Hello,

I just wondering if there is someone to help me with the meaning of DF-Rest_006 - Row marker value:17 is not valid! issue.
What am I doing wrong ?

Thanks !

MartinJaffer-MSFT 26,236 Reputation points

2022-02-11T19:38:08.867+00:00

Hello @Gabriel Dodu-Balaban and welcome to Microsoft Q&A. Could you please elaborate on what you were doing when you got this message? Preferably include steps to reproduce the issue.

1 answer

Your answer

MartinJaffer-MSFT 26,236 Reputation points

2022-02-11T19:38:08.867+00:00

Hello @Gabriel Dodu-Balaban and welcome to Microsoft Q&A. Could you please elaborate on what you were doing when you got this message? Preferably include steps to reproduce the issue.

Answer 1

Gabriel Dodu-Balaban 1

What I am trying to do is to sink some transformed data in data factory to a data verse/dynamics 365 table. The dataflow runs smoothly in debug mode and I get all the data i need in sink step, but when I trigger the pipeline it fails. Here is the error I receive. Isn't a data verse custom table supported for sink in data factory?

{"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'sink1': org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 12.0 failed 1 times, most recent failure: Lost task 0.0 in stage 12.0 (TID 1405, vm-09497082, executor 1): com.microsoft.dataflow**.Issues: DF-Rest_006 - Row marker value:17 is not valid!**\n\tat com.microsoft.dataflow.Utils$.failure(Utils.scala:75)\n\tat org.apache.spark.sql.execution.datasources.rest.RestClient$$anonfun$savePartitionSingle$1$$anonfun$apply$mcV$sp$3.apply(RestClient.scala:117)\n\tat org.apache.spark.sql.execution.datasources.rest.RestClient$$anonfun$savePartitionSingle$1$$anonfun$apply$mcV$sp$3.apply(RestClient.scala:101)\n\tat scala.collection.Iterator$class.foreach(Iterator.scala:891)\n\tat scala.collection.AbstractIterator.foreach(Iterator.scala:1334)\n\tat org.apache.spark.sql.execution.datasources.rest.RestClient$$anonfun$savePartitionSingle$1.apply$mcV$sp(RestClient.scala:100)\n\tat org.apache.spark.sql.execution.datasources.rest.RestClient$$anonfun$savePartitionSingle$1.apply(Re","Details":"org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 12.0 failed 1 times, most recent failure: Lost task 0.0 in stage 12.0
Thanks

MartinJaffer-MSFT 26,236 Reputation points

2022-02-15T22:24:59.547+00:00

With the details you provided, I found an active support case, appearing nearly identical. The case also was opened about the time this question was posted. Did you open a support case @Gabriel Dodu-Balaban ?
Gabriel Dodu-Balaban 1 Reputation point

2022-02-17T16:33:21.077+00:00

I don't think so ... I just wonder what is the cause of this issue to find a solution to bring some data in DataVerse.
MartinJaffer-MSFT 26,236 Reputation points

2022-02-22T21:25:49.41+00:00

Okay, so the open case I found seems to be still active. There are some details I'd like to confirm to determine whether the cause is the same @Gabriel Dodu-Balaban .

You are loading data into a CDS entity which has a many-to-one relationship to another entity, and has a lookup column.

If these do match, then I can tell you the Product Team is working on a fix, and suggested a workaround: instead of a look-up is it possible you can use a Left-outer-join to replace the look-up it should have the same functionality as the look-up.
Gabriel Dodu-Balaban 1 Reputation point

2022-03-09T16:10:52.037+00:00

First of all, thanks for your advice, it seems to work.

I changed the lookup action with a Left-outer-join one and there is another problem that i'm dealing with. After around 15.000 records processed the pipeline run fails with request method: POST, status code: 429 (most probably too many requests). Is there any way to adjust the patch requests number to be aligned with the Dynamics limits ?

Sorry to bother you again.

Share via

Meaning of DF-Rest_006 - Row marker value:17 is not valid! isssue

1 answer

Your answer