Improve on general knowledge?

I have a good memory and read a lot. But then you see these people on Jeopardy and whatnot who can answer almost every question on the board. They seem like your average every day people, not geniouses (with the exception of Ken Jennings). How do they have such a large base of knowledge and what can I do to greatly increase my knowledge base?