@Roey Retner Thanks for reaching here!
Have you tried to remove data source?
If you want to delete your training files.
You can optionally delete training and validation files that you uploaded for training, and result files generated during training, on the Management > Data files pane in Azure OpenAI Studio.
Select the file to delete, and then select Delete to delete the file.
Let me know if you have further query.