Heritrix 网络爬虫
HeritrixistheInternetArchive'sopen-source,extensible,web-scale,archival-qualitywebcrawlerproject.Heritrix(sometimesspelledheretrix,ormisspelledormissaidasheratrix/heritix/heretix/heratix)isanarchaicwordforheiress(womanwhoinherits).Sinceourcrawlerseekstocollectandpreservethedigitalartifa