95% of what? 48GB? Or 95% of 35 GB?
SQL Server will grab as much memory it needs within what is set with max server memory. And as long as Windows does not signal memory pressure, SQL Server will cling to that memory. The memory is used for the buffer cache, so that users can be served the results of queries faster.
Task Manager is not a good place to looking if you have granted SQL Server "lock pages in memory". sys.dm_os_process_memory
is a better place.