Teams backup with Commvault

Question

Teams backup with Commvault

IBN 4,476

Hello

We would need an advice on Teams backup with Commvault.

The Backup will stop every now and then usually at the end of backup session. It is just hanging and unable to close backup session unless killing it manually.

And because of that backup may fail for some teams. This problem happens 1-2 times a week during school period and now off school period more randomly.

In Commvault there have been few API errors, few files and channels failed to backup, nothing major. Commvault logfiles are not very informative. Commvault support is rather convinced that the problem is in our Teams environment.

We found few team duplicates (now removed) and 1 team with [ character in teams name (excluded from backup).

Teams and SharePoint backups have been scheduled so that they (usually) don't overlap.

What would you recommend us to check or do next?

Is there a kind of tool to check Teams for obvious

JimmyYang-MSFT 58,641 Reputation points Microsoft External Staff

2022-06-08T03:35:36.18+00:00

Hi @IBN

In Commvault there have been few API errors, few files and channels failed to backup, nothing major.

To better understand your question, could you share the error message with us?

The Backup will stop every now and then usually at the end of backup session. It is just hanging and unable to close backup session unless killing it manually.

Do you have any operations in Teams client before this issue occurred?
IBN 4,476 Reputation points

2022-06-08T13:16:36.957+00:00

Thank you for your reply

I have contact Commvault few times on this problem. Problem seems to void log files, they are not helpful. We had a meeting with Commvault support and our 365 (Teams) admins: found just few team duplicates.

But no error messages, no alerts during backup.

Here you have few pictures of Commvault Teams backup from June 1 2022 when Teams backup job had to be killed.

Backup seem to be still running but on Proxy1-vm Process Manager we see code “4185 TPool [SdtHeadThPool]. Tot [0], Pend [0], Comp [0], Max Par [0], Avg Work Time [0.00 s], Avg Wait Time [0.00 s]”, repeating the same over and over again until job is killed.

This is what happens before that:

4185 ExAgentController::StopAllWorkers() - Agent [cvproxy1-vm_Remote1] Finished stopping all workers

4185 ExAgentController::OnAgentStopped() - Agent [cvproxy1-vm_Remote1] Send Message ExchangeVirtualAgent_EVCAgentShutdown] to server

4185 TPool [SdtHeadThPool]. Tot [0], Pend [0], Comp [0], Max Par [0], Avg Work Time [0.00 s], Avg Wait Time [0.00 s]

4185 ### PerformWebRequestInMemory - Web Exception generated [504] [GatewayTimeout] [UnknownError] []

Team status shows no major problem.

On that day One failed channel:

Failed to fetch tabs associated with this channel. [Error code [NotFound], Error message [No active channel found with channel id: , Status code [404] [NotFound]]
Few failed files:

Could not download data or hash comparison failed for file.
JimmyYang-MSFT 58,641 Reputation points Microsoft External Staff

2022-06-13T08:58:09.523+00:00

Hi @IBN

No active channel found with channel id

Could you find this channel in Teams admin center? And could you access the channel file normally in your environment?
JimmyYang-MSFT 58,641 Reputation points Microsoft External Staff

2022-06-17T09:14:23.877+00:00

@IBN

It has been a while, how is everything going?
If you have any update about this issue, please feel free to post back.

Your answer

JimmyYang-MSFT 58,641 Reputation points Microsoft External Staff

2022-06-08T03:35:36.18+00:00

Hi @IBN

In Commvault there have been few API errors, few files and channels failed to backup, nothing major.

To better understand your question, could you share the error message with us?

The Backup will stop every now and then usually at the end of backup session. It is just hanging and unable to close backup session unless killing it manually.

Do you have any operations in Teams client before this issue occurred?
IBN 4,476 Reputation points

2022-06-08T13:16:36.957+00:00

Thank you for your reply

I have contact Commvault few times on this problem. Problem seems to void log files, they are not helpful. We had a meeting with Commvault support and our 365 (Teams) admins: found just few team duplicates.

But no error messages, no alerts during backup.

Here you have few pictures of Commvault Teams backup from June 1 2022 when Teams backup job had to be killed.

Backup seem to be still running but on Proxy1-vm Process Manager we see code “4185 TPool [SdtHeadThPool]. Tot [0], Pend [0], Comp [0], Max Par [0], Avg Work Time [0.00 s], Avg Wait Time [0.00 s]”, repeating the same over and over again until job is killed.

This is what happens before that:

4185 ExAgentController::StopAllWorkers() - Agent [cvproxy1-vm_Remote1] Finished stopping all workers

4185 ExAgentController::OnAgentStopped() - Agent [cvproxy1-vm_Remote1] Send Message ExchangeVirtualAgent_EVCAgentShutdown] to server

4185 TPool [SdtHeadThPool]. Tot [0], Pend [0], Comp [0], Max Par [0], Avg Work Time [0.00 s], Avg Wait Time [0.00 s]

4185 ### PerformWebRequestInMemory - Web Exception generated [504] [GatewayTimeout] [UnknownError] []

Team status shows no major problem.

On that day One failed channel:

Failed to fetch tabs associated with this channel. [Error code [NotFound], Error message [No active channel found with channel id: , Status code [404] [NotFound]]
Few failed files:

Could not download data or hash comparison failed for file.
JimmyYang-MSFT 58,641 Reputation points Microsoft External Staff

2022-06-13T08:58:09.523+00:00

Hi @IBN

No active channel found with channel id

Could you find this channel in Teams admin center? And could you access the channel file normally in your environment?
JimmyYang-MSFT 58,641 Reputation points Microsoft External Staff

2022-06-17T09:14:23.877+00:00

@IBN

It has been a while, how is everything going?
If you have any update about this issue, please feel free to post back.

Share via

Teams backup with Commvault

Your answer