org.apache.streams.local.builders

Class LocalStreamBuilder

java.lang.Object

org.apache.streams.local.builders.LocalStreamBuilder

All Implemented Interfaces:

Serializable, StreamBuilder

public class LocalStreamBuilder
extends Object
implements StreamBuilder

LocalStreamBuilder implementation to run a data processing stream in a single JVM across many threads. Depending on your data stream, the JVM heap may need to be set to a high value. Default implementation uses unbound ConcurrentLinkedQueue to connect stream components.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static String	DEFAULT_STARTED_AT_KEY
static String	DEFAULT_STREAM_IDENTIFIER

Constructor Summary

Constructors

Constructor and Description
LocalStreamBuilder() Creates a local stream builder with all configuration resolved by typesafe
LocalStreamBuilder(LocalRuntimeConfiguration localRuntimeConfiguration)
LocalStreamBuilder(LocalRuntimeConfiguration localRuntimeConfiguration, MonitoringConfiguration monitoringConfiguration)
LocalStreamBuilder(MonitoringConfiguration monitoringConfiguration)

Method Summary

Modifier and Type	Method and Description
StreamBuilder	addStreamsPersistWriter(String id, StreamsPersistWriter writer, int numTasks, String... inBoundIds)
StreamBuilder	addStreamsProcessor(String id, StreamsProcessor processor, int numTasks, String... inBoundIds)
protected void	forceShutdown(Map<String,List<StreamsTask>> streamsTasks)
org.apache.streams.config.StreamsConfiguration	getStreamsConfiguration()
protected int	getTimeout()
StreamBuilder	newPerpetualStream(String id, StreamsProvider provider)
StreamBuilder	newReadCurrentStream(String id, StreamsProvider provider)
StreamBuilder	newReadNewStream(String id, StreamsProvider provider, BigInteger sequence)
StreamBuilder	newReadRangeStream(String id, StreamsProvider provider, org.joda.time.DateTime start, org.joda.time.DateTime end)
void	prepare()
StreamBuilder	setStreamsConfiguration(org.apache.streams.config.StreamsConfiguration configuration)
protected void	setupComponentTasks(Map<String,List<StreamsTask>> streamsTasks)
protected void	setupProviderTasks(Map<String,StreamsProviderTask> provTasks)
void	setUseDeprecatedMonitors(boolean useDeprecatedMonitors)
protected void	shutdown(Map<String,List<StreamsTask>> streamsTasks)
void	start() Runs the data stream in the this JVM and blocks till completion.
void	stop() NOT IMPLEMENTED.
protected void	stopInternal(boolean systemExiting)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_STREAM_IDENTIFIER

public static final String DEFAULT_STREAM_IDENTIFIER

See Also:

Constant Field Values

DEFAULT_STARTED_AT_KEY

public static final String DEFAULT_STARTED_AT_KEY

See Also:

Constant Field Values

Constructor Detail

LocalStreamBuilder

public LocalStreamBuilder()

Creates a local stream builder with all configuration resolved by typesafe

LocalStreamBuilder

public LocalStreamBuilder(LocalRuntimeConfiguration localRuntimeConfiguration)

LocalStreamBuilder

public LocalStreamBuilder(MonitoringConfiguration monitoringConfiguration)

LocalStreamBuilder

public LocalStreamBuilder(LocalRuntimeConfiguration localRuntimeConfiguration,
                          MonitoringConfiguration monitoringConfiguration)

Method Detail

prepare

public void prepare()

setUseDeprecatedMonitors

public void setUseDeprecatedMonitors(boolean useDeprecatedMonitors)

newPerpetualStream

public StreamBuilder newPerpetualStream(String id,
                                        StreamsProvider provider)

Specified by:

newPerpetualStream in interface StreamBuilder

newReadCurrentStream

public StreamBuilder newReadCurrentStream(String id,
                                          StreamsProvider provider)

Specified by:

newReadCurrentStream in interface StreamBuilder

newReadNewStream

public StreamBuilder newReadNewStream(String id,
                                      StreamsProvider provider,
                                      BigInteger sequence)

Specified by:

newReadNewStream in interface StreamBuilder

newReadRangeStream

public StreamBuilder newReadRangeStream(String id,
                                        StreamsProvider provider,
                                        org.joda.time.DateTime start,
                                        org.joda.time.DateTime end)

Specified by:

newReadRangeStream in interface StreamBuilder

setStreamsConfiguration

public StreamBuilder setStreamsConfiguration(org.apache.streams.config.StreamsConfiguration configuration)

Specified by:

setStreamsConfiguration in interface StreamBuilder

getStreamsConfiguration

public org.apache.streams.config.StreamsConfiguration getStreamsConfiguration()

Specified by:

getStreamsConfiguration in interface StreamBuilder

addStreamsProcessor

public StreamBuilder addStreamsProcessor(String id,
                                         StreamsProcessor processor,
                                         int numTasks,
                                         String... inBoundIds)

Specified by:

addStreamsProcessor in interface StreamBuilder

addStreamsPersistWriter

public StreamBuilder addStreamsPersistWriter(String id,
                                             StreamsPersistWriter writer,
                                             int numTasks,
                                             String... inBoundIds)

Specified by:

addStreamsPersistWriter in interface StreamBuilder

start

public void start()

Runs the data stream in the this JVM and blocks till completion.

Specified by:

start in interface StreamBuilder

forceShutdown

protected void forceShutdown(Map<String,List<StreamsTask>> streamsTasks)

shutdown

protected void shutdown(Map<String,List<StreamsTask>> streamsTasks)
                 throws InterruptedException

Throws:

InterruptedException

setupProviderTasks

protected void setupProviderTasks(Map<String,StreamsProviderTask> provTasks)

setupComponentTasks

protected void setupComponentTasks(Map<String,List<StreamsTask>> streamsTasks)

stop

public void stop()

NOT IMPLEMENTED.

Specified by:

stop in interface StreamBuilder

stopInternal

protected void stopInternal(boolean systemExiting)

getTimeout

protected int getTimeout()