INTELLIGENT CRAWLER: A CRAWLER TO SEARCH DEEP WEB INTERFACES

Abstract

As internet is growing fast with most of its data is not accessed easily. Everyone want to access data preferred to them. For this purpose, we proposed Intelligent crawler. Intelligent crawler system used to crawl data from deep web. Webpages are visited by two stages, which consist of site-locating and in-site exploring. As deep web consists of vast amount of data we use reverse searching and visit only relevant sites. And explore only forms which are relevant to user query by using incremental site prioritizing algorithm. This paper also talks about filtering search result by user preference. This paper solves the issue of harvesting deep web interfaces with maximum accuracy and in short time. It also proposes a way to classify data using user preference. Our experimental results show’s that our crawler is efficient than other crawlers.