You have to correct your join clause. Your HAVING clause has an issue as well.

SELECT parentName, count(*)

FROM parents p --Alias parent table

JOIN children c --Alias children table

ON p.parentName = c.parentName --Use correct join syntax

GROUP BY parentName

HAVING COUNT (childName) > 1 --Only greater than