Following the standard pattern (
payee = one who is paid), employee = one who is employed,
devotee = one who is devoted), an attendee must be someone who is attended, i.e.,
the SPEAKER not the ATTENDERS in the audience.
Used (with other similar patterns) by people too lazy to look up the correct word.