Why is voting for answers considered valid for determining the correct answer?

Sometimes voters are valid, especially if enough people vote. I know sometimes only 1 or 2 people vote so that answer automatically wins even though it's not the best. But it's just a way to close a question if the asker doesn't choose a best answer. Otherwise there would be hundreds of open questions for years