Hi @Jun Ting Ho
Based on your question i understand that you want to secure the web api without using Azure AD or Keyvault.
You can look at API key based authentication or certificate based authentication. It is easy to implement and same API key or certificate can be used by logic app while calling API irrespective of which user.
I hope this answers your question.
Thanks
Rahul