Flowlet using join

Question

Flowlet using join

Kirti Bhudhar 31

Hi Team,

I have one scenario, I am creating a flowlet with 2 inputs and1 join and 1 select component. When I am trying to use the created flowlet in a dataflow, i am not able to see the data in data preview tab.

Getting below error :
DF-COMP-003 at Compose 'Flowlet1': Compose transformation should have the same number of input streams as input transformations - RunId: 4b24615c-7f60-47e7-beb9-b37826c53ea1

Also, wish to get confirmation on how can we handle more than one inputs in FLOWLET ?

MarkKromer-MSFT 5,231 Reputation points Microsoft Employee Moderator

2021-12-21T21:46:35.31+00:00

Are you able to share the script code behind your data flow graph? I'd like to have a look at your script to help troubleshoot.
Kirti Bhudhar 31 Reputation points

2021-12-22T04:59:46.37+00:00

159572-flowlet-join-script.txt

Shared the script.
MarkKromer-MSFT 5,231 Reputation points Microsoft Employee Moderator

2021-12-27T23:24:10.447+00:00

Can you also share the script behind the data flow where you are using this flowlet?
Kirti Bhudhar 31 Reputation points

2021-12-30T12:27:08.703+00:00

Here is the script behind the data flow where I am using this flowlet ::::

source(output(
id as integer,
name as string,
city as string
),
allowSchemaDrift: true,
validateSchema: false,
ignoreNoFilesFound: false) ~> source1
source(output(
id as integer,
job as string,
salary as integer
),
allowSchemaDrift: true,
validateSchema: false,
ignoreNoFilesFound: false) ~> source2
source1, source2, source2 compose(mapColumn(
id = source1@id,
name,
city
),mapColumn(
id = source2@id,
job,
salary
),
composition: 'sample_flowlet3') ~> Flowlet1@(output1)
Flowlet1@output1 sink(allowSchemaDrift: true,
validateSchema: false,
skipDuplicateMapInputs: true,
skipDuplicateMapOutputs: true,
store: 'cache',
format: 'inline',
output: false,
saveOrder: 1) ~> sink1
KranthiPakala-MSFT 46,827 Reputation points Moderator

2022-01-05T00:14:38.223+00:00

Hello @Kirti Bhudhar ,

Following up to see if you have got a chance to see Mark Kromer's response. If so could you please share the requested details for further assistance.

Thank you
Kirti Bhudhar 31 Reputation points

2022-01-05T04:53:57.793+00:00

Yes Kranti, I have already shared. Re sharing it here.162298-script-containing-join-flowlet.txt
KranthiPakala-MSFT 46,827 Reputation points Moderator

2022-01-13T02:08:15.04+00:00

Thank you @Kirti Bhudhar for sharing it again. I am checking on this issue with internal team and will let you know as soon as I have update. Sorry for the inconvenience caused because of this.
KranthiPakala-MSFT 46,827 Reputation points Moderator

2022-01-18T20:20:42.197+00:00

Hello @Kirti Bhudhar ,

I wasn't able to get the response from internal teams. To expedite the investigation if you have a support plan, could you please file a support ticket? In case if you don't have a support plan, do let me know here.

Thank you
Kirti Bhudhar 31 Reputation points

2022-01-20T11:54:07.933+00:00

Hi @KranthiPakala-MSFT ,

We don't have a support plan.

Also I have observed similar issue in few other components. Whenever we are trying to create a flowlet with 2 inputs we are able to create and publish the flowlet but unable to use it in dataflow. Can you please check if you can address this issue as well?

Thank you !
KranthiPakala-MSFT 46,827 Reputation points Moderator

2022-01-21T02:11:33.727+00:00

Thanks @Kirti Bhudhar for getting back. Please do share the details as requested in private message.

We look forward to your response.

Thank you
Kirti Bhudhar 31 Reputation points

2022-01-31T10:42:39.903+00:00

Hi Kranthi,

I am not able to see the private message. Could you please send that one more time ?

Sorry for the inconvenience.
KranthiPakala-MSFT 46,827 Reputation points Moderator

2022-01-31T18:31:51.163+00:00

Hello @Kirti Bhudhar ,

Thanks for getting back. I have initiated another private message, could you please check it and respond accordingly.

Thank you.
Kirti Bhudhar 31 Reputation points

2022-02-01T05:54:27.387+00:00

Hi @KranthiPakala-MSFT

Mail sent. Request you to please check from your end.

Thank you!
KranthiPakala-MSFT 46,827 Reputation points Moderator

2022-02-01T06:31:18.363+00:00

Thank you @Kirti Bhudhar for sharing the details. Please do follow the instructions provided in the email to file a support ticket and do share the SR# once it is filed so that we can track it internally.

Thank you