'212.Heritrix_설정파일'에 해당되는 글 42건

  1. 2016.07.26 [Heritrix/crawler-beans.cxml]longerOverrides
  2. 2016.07.26 [Heritrix/crawler-beans.cxml]simpleOverrides

LongerOverrides

  • 크롤링할 사이트의 URL 주소를 세팅할 때 설정해주는 bean이다.

기본 세팅 값

 <!-- overrides from declared <prop> elements, more easily allowing
      multiline values or even declared beans -->
 <bean id="longerOverrides" class="org.springframework.beans.factory.config.PropertyOverrideConfigurer">
  <property name="properties">
   <props>
    <prop key="seeds.textSource.value">

# URLS HERE
http://example.example/example

    </prop>
   </props>
  </property>
 </bean>


Posted by Righ
,

SimpleOverrides

  • 크롤링 당하는 사이트에 크롤링 하는  정보를 제공하기 위해 사용하는 bean이다.

기본 세팅 값.

<!-- overrides from a text property list -->
 <bean id="simpleOverrides" class="org.springframework.beans.factory.config.PropertyOverrideConfigurer">
  <property name="properties">
   <value>
# This Properties map is specified in the Java 'property list' text format
# http://java.sun.com/javase/6/docs/api/java/util/Properties.html#load%28java.io.Reader%29

metadata.operatorContactUrl=ENTER_AN_URL_WITH_YOUR_CONTACT_INFO_HERE_FOR_WEBMASTERS_AFFECTED_BY_YOUR_CRAWL
metadata.jobName=basic
metadata.description=Basic crawl starting with useful defaults

##..more?..##
   </value>
  </property>
 </bean>


Posted by Righ
,