Women and minorities feel they have to work harder