Custom AI Model with product documents

Question

We intend to create an AI model that possesses contextual knowledge about any given product. The model will be trained using various documents associated with product like requirement document, Functional Specifications, Technical Design etc. The trained AI model should maintain the context of the product and provide solutions to product-specific queries or problems.


Currently we are not able to train AI model with huge product docs without loosing the context. The LLM's which we used are splitting the docs into multiple portions and the responses are loosing context due to that. Also we are facing token and character limitation when we wanted to use OpenAI

Is this possible with Microsoft AI and how we can achieve it?