org.apache.streams.urls

Class LinkResolver

java.lang.Object

org.apache.streams.urls.LinkResolver

All Implemented Interfaces:

Serializable

public class LinkResolver
extends Object
implements Serializable

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
LinkResolver(String originalURL) Raw string input of the URL.

Method Summary

Modifier and Type	Method and Description
LinkDetails	getLinkDetails() Get the link details
static String	normalizeURL(String url) Removes the protocol, if it exists, from the front and removes any random encoding characters Extend this to do other url cleaning/pre-processing
void	run()
static List<String>	tokenizeURL(String url) Goal is to get the different parts of the URL path.
void	unwindLink(String url)
protected void	updateTookInMillis()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LinkResolver

public LinkResolver(String originalURL)

Raw string input of the URL. If the URL is invalid, the response code that is returned will indicate such.

Parameters:

originalURL - The URL you wish to unwind represented as a string.

Method Detail

getLinkDetails

public LinkDetails getLinkDetails()

Get the link details

Returns:

Detailed log of every redirection that took place with the browser along with it it's ultimate status code.

run

public void run()

updateTookInMillis

protected void updateTookInMillis()

unwindLink

public void unwindLink(String url)

normalizeURL

public static String normalizeURL(String url)

Removes the protocol, if it exists, from the front and removes any random encoding characters Extend this to do other url cleaning/pre-processing

Parameters:

url - - The String URL to normalize

Returns:

normalizedUrl - The String URL that has no junk or surprises

tokenizeURL

public static List<String> tokenizeURL(String url)

Goal is to get the different parts of the URL path. This can be used in a classifier to help us determine if we are working with

Reference: http://stackoverflow.com/questions/10046178/pattern-matching-for-url-classification

Parameters:

url - - Url to be tokenized

Returns:

tokens - A String array of all the tokens