Conversational Language Understanding -Mapping the Entities with respective Intent

Question

Conversational Language Understanding -Mapping the Entities with respective Intent

Manoj Kumar 40

Hi Team,

Post migrating the data from LUIS to CLU, We have a list of values in entity(EX: demo) under Schema definition. Since these list of entity values are part of particular intent(EX: demoIntent). When we train the model, we are getting top Intent as correct (demoIntent) only for few of the entities values, for few wer'e getting wrong results. On Data labeling when we try to add each entity value with respective intent(demoIntent). We get the expected result as top Intent. Could you please let us know, is there any way where we can to get required Intent to required entity values. ( In LUIS we have the feature called patterns where we can map the all the entities value/ entity to particular intent)

Thanks.

romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-04-12T08:10:03.6266667+00:00

@Manoj Kumar With respect to patterns, it is one of those features of LUIS that is no longer needed with CLU as CLU is capable of generalizing intents by leveraging the state-of-the-art models. You can provide a few utterances to match a specific pattern/utterance to an intent in CLU and the model should be able to classify the different patterns as the top intent without the need of the pattern template utterance.

So, if you are seeing some incorrect results it might be easier to add more utterances and check if the model is able to identify the top intents based on additional utterances added. Also, please refer the guidance from documentation on how the missing features need to be handled with CLU.
Manoj Kumar 40 Reputation points

2023-04-12T13:47:57.0533333+00:00

@romungi-MSFT Thanks for the response. Another query is we have feature of uploading JSON entity file in LUIS. Is this option available in CLU to add the entity value in JSON file.
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-04-13T07:59:17.8633333+00:00

@Manoj Kumar Do you mean importing an app as JSON in LUIS? I do not see an option to upload a file for entities creation as JSON from LUIS entities screen.

With CLU too I only see an option to upload a utterance file with all the entities and intents. Thanks!!
Manoj Kumar 40 Reputation points

2023-04-13T14:37:14.2433333+00:00

@romungi-MSFT : on Luis entity we have option to import JSON file
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-04-17T07:25:35.5366667+00:00

@Manoj Kumar Unfortunately, this is also not available with CLU.
Manoj Kumar 40 Reputation points

2023-04-19T21:31:37.0266667+00:00
@romungi-MSFT : Thanks for the update. Could you please clarify the below queries

We have Prediction URL in POST method, Similarly do we have Prediction URL in Get method to access the end point url.

We have entity with list of terms, EX: {Country} Salary. Since country is list which has all the country name in the world. Do we have option in CLU to create {Country} Salary entities/pattern ?. The result will be like canada salary, vietnam salary, to get salary entity has top value.

We have training job which holds previously created training job with id, which is created before as shown below. Do we have option to reuse the old training job/id ?
Manoj Kumar 40 Reputation points

2023-04-20T13:09:49.53+00:00

Could you help on the above queries
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-04-24T10:09:55.5433333+00:00

@Manoj Kumar For the runtime API, I see there is only one option with the POST analyze-conversations API. Is this what you are referring to with the POST API?

I think you can try to use the Entity options feature to not combine or not combine the components to extract the values. Once you add your entities you should see this feature to select the method to extract them.

Do you intend to overwrite the model that was created using the previous training job id? If Yes, you should have an option to overwrite existing model. Otherwise, I did not see an option to re-run the training job.

Your answer

romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-04-12T08:10:03.6266667+00:00

@Manoj Kumar With respect to patterns, it is one of those features of LUIS that is no longer needed with CLU as CLU is capable of generalizing intents by leveraging the state-of-the-art models. You can provide a few utterances to match a specific pattern/utterance to an intent in CLU and the model should be able to classify the different patterns as the top intent without the need of the pattern template utterance.

So, if you are seeing some incorrect results it might be easier to add more utterances and check if the model is able to identify the top intents based on additional utterances added. Also, please refer the guidance from documentation on how the missing features need to be handled with CLU.
Manoj Kumar 40 Reputation points

2023-04-12T13:47:57.0533333+00:00

@romungi-MSFT Thanks for the response. Another query is we have feature of uploading JSON entity file in LUIS. Is this option available in CLU to add the entity value in JSON file.
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-04-13T07:59:17.8633333+00:00

@Manoj Kumar Do you mean importing an app as JSON in LUIS? I do not see an option to upload a file for entities creation as JSON from LUIS entities screen.

With CLU too I only see an option to upload a utterance file with all the entities and intents. Thanks!!
Manoj Kumar 40 Reputation points

2023-04-13T14:37:14.2433333+00:00

@romungi-MSFT : on Luis entity we have option to import JSON file
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-04-17T07:25:35.5366667+00:00

@Manoj Kumar Unfortunately, this is also not available with CLU.
Manoj Kumar 40 Reputation points

2023-04-19T21:31:37.0266667+00:00

@romungi-MSFT : Thanks for the update. Could you please clarify the below queries

We have Prediction URL in POST method, Similarly do we have Prediction URL in Get method to access the end point url.

We have entity with list of terms, EX: {Country} Salary. Since country is list which has all the country name in the world. Do we have option in CLU to create {Country} Salary entities/pattern ?. The result will be like canada salary, vietnam salary, to get salary entity has top value.

We have training job which holds previously created training job with id, which is created before as shown below. Do we have option to reuse the old training job/id ?
Manoj Kumar 40 Reputation points

2023-04-20T13:09:49.53+00:00

Could you help on the above queries
romungi-MSFT 48,906 Reputation points Microsoft Employee Moderator

2023-04-24T10:09:55.5433333+00:00

@Manoj Kumar For the runtime API, I see there is only one option with the POST analyze-conversations API. Is this what you are referring to with the POST API?

I think you can try to use the Entity options feature to not combine or not combine the components to extract the values. Once you add your entities you should see this feature to select the method to extract them.

Do you intend to overwrite the model that was created using the previous training job id? If Yes, you should have an option to overwrite existing model. Otherwise, I did not see an option to re-run the training job.

Share via

Conversational Language Understanding -Mapping the Entities with respective Intent

Your answer