Are racist or sexist books written by scientists worth reading?

IMO, yes, definitely a waste of time. People who write from a bigoted viewpoint write only to preach their ideas, not to inform the reader. So I would say a better use of your time would be to read works of _real_ scientists, not people who are just trying to convert readers to their bigotry.