Don't worry about it. You won't lose any user data by clearing the cache. Restarting Teams after you clear the cache might take longer than usual because the Teams cache files have to be rebuilt.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.