I think the answer above is not really what you are looking for. You can add multiple document libraries in a site. For this, it is possible to add a document library template from an existing document library.
Your use case is somewhat different, as you want to use one document library and then have multiple subfolders with a specific configuration. We have the same use case for our projects. From what I found so far, this is not possible with the standard functionality.
It get's worse if you use OneDrive Business to sync the folders to the users computers. All the predefined site element types and templates are not respected at all. Users can add any file they want and the templates are nowhere to be found.
I completely understand this from a technical point, but it is really not a good document management system from a user requirements perspective.