Hi
There are many ways we can check memory consumption of Indexserver.
1. First check if any Job are running in the system which is causing high memory consumption on the Index Server. You can check by going to HANA Studio --> Performance tab --> Job Progress
2. Check with this SQL Query "HANA_Memory_Overview.txt -- This will give you detailed information about memory consumption of all the components. This will tell you which component is consuming the memory in the system.
3. Check the SAP Note 1999997 FAQ:SAP HANA MEMORY
Mahesh Shetty