A family of Microsoft spreadsheet software with tools for analyzing, charting, and communicating data.
I am guessing but it appears that you used tables in Word to create your example and you want a similar thing in Excel.
From your example it appears that if you need 6 rows beginning from column 2 then in column 1 merge 6 cells for the row titles (ie. Project 1, Project 2, Project 3 etc). That will effectively provide you with one extra high cell for the row titles in the first column and 6 standard height rows for each of the columns to the right.
As per the following screen shot where I have also applied Left justify and Top justify to the merged cells in column 1. I have not applied any borders but you should be able to do that as required.