It could perhaps be because there are some so-called 'objective' measures of attractiveness that people use to help themselves decide what is and isn't attractive to them, or at least ones where there is a social consensus on what those standards are! Meanwhile, feelings are the wild uncharted frontier and take way more time and effort to sort out.