Package com.soulgalore.crawler.core

Examples of com.soulgalore.crawler.core.HTMLPageResponse


            this.processor = processor;
        }

        @Override
        public HTMLPageResponse get(PageURL url, boolean fetchBody, Map<String, String> requestHeaders, boolean followRedirectsToNewDomain) {
            HTMLPageResponse response = super.get(url, fetchBody, requestHeaders, followRedirectsToNewDomain);
            if (response.getResponseCode() == 200 && response.getResponseType().startsWith("text")) {
                processor.process(response.getBody());
            }
            return response;
        }
View Full Code Here

TOP

Related Classes of com.soulgalore.crawler.core.HTMLPageResponse

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.