They are dropped by crows and thus are usually found near animal and human corpses. Feathers usually respawn after a few days. Or after a blizzard, because a blizzard causes crows to disappear and subsequently reappear afterwards. Player-hunted animals do attract crows aswell and can be used as an easy source of feathers.
As a feather touches the ground, it makes a small sound that can be heard if nearby.