Hello @Guillaume,
welcome to this moderated Azure community forum.
The behavior you experience, receiving the full set of desired properties even when only one is changed, is the default behavior and cannot be modified.
The set of all desired properties must be seen as the complete desired state and must be handled as being 'atomic' (as in 'uncuttable').
The method used to handle desired property changes must be smart enough (or dump enough) to just process each separate desired property first. Only then, any action needed on any desired property change must be executed.
If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. All community members with similar issues will benefit by doing so. Your contribution is highly appreciated.