org.htmlparser.parserapplications

类 SiteCapturer

java.lang.Object

org.htmlparser.parserapplications.SiteCapturer

直接已知子类:

WikiCapturer

public class SiteCapturer
extends java.lang.Object

Save a web site locally. Illustrative program to save a web site contents locally. It was created to demonstrate URL rewriting in it's simplest form. It uses customized tags in the NodeFactory to alter the URLs. This program has a number of limitations:

• it doesn't capture forms, this would involve too many assumptions
• it doesn't capture script references, so funky onMouseOver and other non-static content will not be faithfully reproduced
• it doesn't handle style sheets
• it doesn't dig into attributes that might reference resources, so for example, background images won't necessarily be captured
• worst of all, it gets confused when a URL both has content and is the prefix for other content, i.e. http://whatever.com/top and http://whatever.com/top/sub.html both yield content, since this cannot be faithfully replicated to a static directory structure (this happens a lot with servlet based sites)

构造器概要

构造器

构造器和说明
SiteCapturer() Create a web site capturer.

方法概要

限定符和类型	方法和说明
void	capture() Perform the capture.
boolean	getCaptureResources() Getter for property captureResources.
NodeFilter	getFilter() Getter for property filter.
java.lang.String	getSource() Getter for property source.
java.lang.String	getTarget() Getter for property target.
static void	main(java.lang.String[] args) Mainline to capture a web site locally.
void	setCaptureResources(boolean capture) Setter for property captureResources.
void	setFilter(NodeFilter filter) Setter for property filter.
void	setSource(java.lang.String source) Setter for property source.
void	setTarget(java.lang.String target) Setter for property target.

从类继承的方法 java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SiteCapturer

public SiteCapturer()

Create a web site capturer.

方法详细资料

getSource

public java.lang.String getSource()

Getter for property source.

返回:

Value of property source.

setSource

public void setSource(java.lang.String source)

Setter for property source. This is the base URL to capture. URL's that don't start with this prefix are ignored (left as is), while the ones with this URL as a base are re-homed to the local target.

参数:

source - New value of property source.

getTarget

public java.lang.String getTarget()

Getter for property target.

返回:

Value of property target.

setTarget

public void setTarget(java.lang.String target)

Setter for property target. This is the local directory under which to save the site's pages.

参数:

target - New value of property target.

getCaptureResources

public boolean getCaptureResources()

Getter for property captureResources. If true, the images and other resources referenced by the site and within the base URL tree are also copied locally to the target directory. If false, the image links are left 'as is', still refering to the original site.

返回:

Value of property captureResources.

setCaptureResources

public void setCaptureResources(boolean capture)

Setter for property captureResources.

参数:

capture - New value of property captureResources.

getFilter

public NodeFilter getFilter()

Getter for property filter.

返回:

Value of property filter.

setFilter

public void setFilter(NodeFilter filter)

Setter for property filter.

参数:

filter - New value of property filter.

capture

public void capture()

Perform the capture.

main

public static void main(java.lang.String[] args)
                 throws java.net.MalformedURLException,
                        java.io.IOException

Mainline to capture a web site locally.

参数:

args - The command line arguments. There are three arguments the web site to capture, the local directory to save it to, and a flag (true or false) to indicate whether resources such as images and video are to be captured as well. These are requested via dialog boxes if not supplied.

抛出:

java.net.MalformedURLException - If the supplied URL is invalid.

java.io.IOException - If an error occurs reading the page or resources.