Click on the Graph. The Field list shows all available options. If what you want is not there then you're out of luck.
To get what you want I think you're going to need some VBA code. Whilst Project calculates and early and late start and finish date, it only calculates costs for the scheduled start/finish dates. Therefore there is no early and late cost over time.
I think your macro will need to copy Early and Late start-finish to two interim custom date fields, then set start-finish to Early start dates and export timephased earned value data to Excel. Do same for Late dates and export then remove all constraint
dates you just created by forcing dates and create you graph in Excel.