@David Thielen , Thanks for posting this question and your feedback. it's much appreciated.
Based on my understanding of your scenario. You may consider to Add scoring profiles - Azure AI Search | Microsoft Learn, now this is applicable to vectors too.
Since this question is related to collaborative filtering, you may consider intelligent recommendations out of the box : What are Intelligent Recommendations? - Microsoft Cloud for Retail | Microsoft Learn or adding logic that is recommended for this type of scenario for e-commerce: Building recommender systems with Azure Machine Learning service | Microsoft Azure Blog.
Additionally, you may incorporate the search service into the pipeline as needed. The notebooks contain distinct end-to-end code for various scenarios (including the one you highlighted).
If the answer helped (pointed you in the right direction) > please click Accept Answer - it will benefit users in finding the right answer quickly.