I solved it.

Right click on Server Server Agent. Select "properties". Go to connection. Under "Alias local host server" I deleted whatever was there (I had server name there, which is the only instance), and left it empty!

Now SQL server agent starts fine!!