@Rupali gokhale , Thanks for the great question.
The VS Code extension is more of a developer tool than something designed for ALM or CICD.
You may try a similar approach -check in JSON files for index/datasource/indexer/etc. into source control. Then as part of a Pipeline, you could have a script step that calls our APIs and sends the JSON files as the body.
Typically, other users also come up with some way to do string replacements in the json file to programmatically update connection strings, index names, etc.
--
To benefit the community find the right answers, please do mark the post which was helpful by clicking on ‘Accept Answer’ & ‘Up-Vote’.