Hello Siddharth Joshi ,
Please correct me if my understanding is wrong. Your release pipeline is partially deployed with the objects, and you want to rollback the changes to the previous good release.
To roll back to a previous state, you can access the Release Management for the project, identify the previous release, and redeploy it to replace the newer release.
If you look at the below screenshot, my release pipeline-13 failed, and I was able to roll back the changes using my
previous release pipeline-11
Set the DropObjectsNotInSource=True to drop the objects that exist in the target but not source should be dropped; I hope this helps. Please let me know if you have any further questions.