浣跨敤Heritrix锛屾偍闇€瑕佹寜鐓т互涓嬫楠よ繘琛屾搷浣滐細

1. 涓嬭浇鍜屽畨瑁匟eritrix锛氭偍鍙互浠嶩eritrix瀹樻柟缃戠珯锛坔ttp://crawler.archive.org/锛変笅杞芥渶鏂扮増鏈殑Heritrix锛屽苟鎸夌収瀹夎璇存槑杩涜瀹夎銆?/p>

2. 閰嶇疆Heritrix锛氬湪Heritrix鐨勫畨瑁呯洰褰曚笅锛屾偍鍙互鎵惧埌涓€涓悕涓?quot;crawler-beans.cxml"鐨勯厤缃枃浠躲€傞€氳繃缂栬緫杩欎釜鏂囦欢锛屾偍鍙互閰嶇疆Heritrix鐨勮涓猴紝渚嬪璁剧疆鐖彇鐨勮捣濮婾RL銆佽缃埇鍙栨繁搴︾瓑銆?/p>

3. 鍚姩Heritrix鎺у埗鍙帮細鍦℉eritrix鐨勫畨瑁呯洰褰曚笅锛岃繍琛屼互涓嬪懡浠ゅ惎鍔℉eritrix鎺у埗鍙帮細

./heritrix.sh

4. 浣跨敤Heritrix鎺у埗鍙帮細閫氳繃娴忚鍣ㄨ闂?quot;http://localhost:8443"锛屾偍灏嗙湅鍒癏eritrix鐨勬帶鍒跺彴鐣岄潰銆傚湪鎺у埗鍙颁腑锛屾偍鍙互鍒涘缓鍜岀鐞嗙埇铏换鍔★紝鐩戞帶鐖彇杩囩▼锛屾煡鐪嬬埇鍙栫粨鏋滅瓑銆?/p>

5. 鍒涘缓鐖櫕浠诲姟锛氬湪鎺у埗鍙扮晫闈㈢殑"Job"閮ㄥ垎锛屾偍鍙互鐐瑰嚮"New Job"鎸夐挳鍒涘缓涓€涓柊鐨勭埇铏换鍔°€傚湪鍒涘缓浠诲姟鐨勮繃绋嬩腑锛屾偍闇€瑕佽缃换鍔＄殑鍚嶇О銆佽捣濮婾RL銆佺埇鍙栨繁搴︾瓑鍙傛暟銆?/p>

6. 鍚姩鐖櫕浠诲姟锛氬湪鎺у埗鍙扮晫闈㈢殑"Job"閮ㄥ垎锛屾偍鍙互閫夋嫨涓€涓凡鍒涘缓鐨勪换鍔★紝骞剁偣鍑?quot;Launch"鎸夐挳鍚姩浠诲姟銆?/p>

7. 鐩戞帶鐖彇杩囩▼锛氬湪鎺у埗鍙扮晫闈㈢殑"Job"閮ㄥ垎锛屾偍鍙互閫夋嫨涓€涓鍦ㄨ繍琛岀殑浠诲姟锛屽苟鐐瑰嚮"Inspect"鎸夐挳鏌ョ湅浠诲姟鐨勮缁嗕俊鎭紝鍖呮嫭宸茬埇鍙栫殑URL銆佺埇鍙栭€熷害绛夈€?/p>

8. 鏌ョ湅鐖彇缁撴灉锛氬湪鎺у埗鍙扮晫闈㈢殑"Reports"閮ㄥ垎锛屾偍鍙互鏌ョ湅宸插畬鎴愮殑浠诲姟鐨勬姤鍛婏紝鍖呮嫭宸茬埇鍙栫殑URL銆佺埇鍙栫殑椤甸潰鍐呭绛夈€?/p>

浠ヤ笂鏄疕eritrix鐨勫熀鏈娇鐢ㄦ楠わ紝鎮ㄥ彲浠ユ牴鎹嚜宸辩殑闇€姹傝繘琛岃繘涓€姝ョ殑閰嶇疆鍜屽畾鍒躲€?/p>