The Invisible Web

Never sure if anyone has talked about this before. A few weeks back, a friend of mine mentioned the existence of the "Deep Web" or the majority of the web that is hidden or hard to find through basic search engines. The image I keep seeing used is the deep web is like an iceberg. The "surface web" is the things you can find easily or have been indexed by major search engines. The "deep web" is much larger than the surface web, yet harder to reach or find, but contains the greatest amount of information.

For you tech guys, have you heard of this, and if so, what is the importance of the deep web? How does one go about uncovering it? Does it have valuable information or is most of it useless? Is there a way to streamline the deep web and all website to make it easier to find webpages using any search engine? Any other thoughts or comments that come to mind would be appreciated as well.

From what I hear, the deep web is full of pedophiles, drug dealers, necrophiliacs, murderers, and other horrible things. Best to just stay away.

There is a reason why it is hidden and hard to find...