Design and implementation of a new type of web crawler