You just haven't been told, nor have conceived yourself, of ways in which 'fitness' is currently measured, evolutionarily. People that are less able to conform to society are less able to breed today, as they end up dead, gay, or in jail, where opportunities to breed are limited.

The evolutionary pressures still exist, and evolution is yet ongoing, only the rules have changed.

Also, temporary accumulations of recessives doesn't imply permanence. Things are rosy now, but after the EMP, when healthy, young people will have to scrabble to survive, those disabled by recessive genetic diseases will suddenly not survive in droves, and evolution will be working again, just like in the bad old days.

Don't count your chickens until the fat lady burns the bridge you need to cross... or something like that.