Microsoft recently announced that they are adding a feature to enable and disable activity in Azure Data Factory. This feature is in the preview currently.
Select the activity which you want to disable, and under the general property window, set the Activity state radio button to inactive.
Refer to this post for more details.