I am posting the discussion and your finding as resolution so it can help other community members.
Since the Microsoft Q&A community has a policy that the question author cannot accept their own answer, they can only accept answers by others, I'll repost your solution in case you'd like to Accept the answer.
Issue: You observed that adding row using the excel connector takes 17-23 seconds for every request.
Resolve: You found that slower insertion speed in one of the table is influenced by two other tabs/tables that have VLOOKUP formulas referencing the slower table. This additional factor contributes to the overall slowness. To address this issue, you plan to remove those VLOOKUP formulas and monitor the performance again.