There is a 'SetProperty' method on the config to allow you to set parameters to your request, which can change the default silence time:
(in C#: https://learn.microsoft.com/en-us/dotnet/api/microsoft.cognitiveservices.speech.propertycollection.setproperty?view=azure-dotnet)
This way you can set the EndSilenceTimeout (PropertyIDs in C# as below document:
https://learn.microsoft.com/en-us/dotnet/api/microsoft.cognitiveservices.speech.propertyid?view=azure-dotnet)
Hope this helps!
Regards,
Yutong
-Please kindly accept the answer if you feel helpful, thanks.