Other very intelligent people hold some pretty unpopular opinions as well. Nobel laureate James D. Watson has made some very controversial comments about racial minorities. Martin Heidegger was a card carrying Nazi, and never apologized for his support of Adolf Hitler. Noam Chomsky is a self identified anarcho-syndicalist.
Most of us would agree that the above individuals are extremely intelligent, probably even more intelligent than ourselves. But I suspect that most of us would also balk at the idea of eugenics or National Socialism. So how do you justify disagreeing with someone who is much more intelligent than you? To what extent, if any, should you reevaluate your own position?