@Liang HAN Welcome to Microsoft Q&A Forum, Thank you for posting your query here!
.
Please be aware that the Speech Devices SDK is now retired.
.
The SDK has issues reported on Raspberrian Pi OS in the past. I have seen issues on the SDK issues pages. Refer this thread for similar issue.
.
You can however install the supported libraries for windows or linux OS. For example: With the SDK version 1.11.0 binaries for linux ARM32 and ARM64 are released for raspberry pi. You could also try with 1.16.0 SDK version and check. .
Also, the SDK issues pages here and here are the official support page for issues related to the SDK. I hope this helps.