Hi, @zero wei
Thank you for posting in Microsoft Q&A forum.
To remove SCUP updates from Configuration Manager console, we need to expire the update in SCUP and the re-publish it into WSUS. Then on the next scheduled SCCM/WSUS synchronization the update will be marked as expired in the SCCM console. Finally, after a few weeks the update will be removed from the console.
By the way, the System Center Updates Publisher (SCUP) and Integration with Configuration manager is deprecated on January 31, 2024.
If the answer is the right solution, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Add comment".