The problem is that even if you can find where the memory is spent, it can be difficult to deal with it. Well, you can start to flush various caches, but that is not that much than restarting the machine. And if you do that, you could add more RAM while you are it.
But you could look at sys.dm_os_memory_clerks to see where the memory is spent.