URL Discovery

All around the world, millions of people are creating content daily and it is estimated that around ~330 million terabytes of data is created every day and with the ever increasing speed new pages, videos, articles are getting created everyday, how search engines are able to keep up with this speed?