Here's my brief answer... 

Statistics are simply data SQL Server collects about a column's data selectivity,  uniqueness and counts of particular values in that column.  Stats exist on every index, however stats can also exist on columns that are not indexed.