org.apache.streams.s3

Class S3PersistWriter

java.lang.Object

org.apache.streams.s3.S3PersistWriter

All Implemented Interfaces:

Serializable, DatumStatusCountable, StreamsOperation, StreamsPersistWriter

public class S3PersistWriter
extends Object
implements StreamsPersistWriter, DatumStatusCountable

S3PersistWriter writes documents to s3.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected LineReadWriteUtil	lineWriterUtil
static String	STREAMS_ID

Constructor Summary

Constructors

Constructor and Description
S3PersistWriter()
S3PersistWriter(com.amazonaws.services.s3.AmazonS3Client amazonS3Client, S3WriterConfiguration s3WriterConfiguration) Instantiator with a pre-existing amazonS3Client, this is used to help with re-use.
S3PersistWriter(S3WriterConfiguration s3WriterConfiguration)

Method Summary

Modifier and Type	Method and Description
void	cleanUp()
com.amazonaws.services.s3.AmazonS3Client	getAmazonS3Client()
DatumStatusCounter	getDatumStatusCounter()
String	getId()
com.fasterxml.jackson.databind.ObjectMapper	getObjectMapper()
Map<String,String>	getObjectMetaData()
S3WriterConfiguration	getS3WriterConfiguration()
List<String>	getWrittenFiles()
void	prepare(Object configurationObject)
OutputStreamWriter	resetFile() Reset File when it's time to create a new file.
void	setObjectMapper(com.fasterxml.jackson.databind.ObjectMapper mapper)
void	setObjectMetaData(Map<String,String> val)
void	write(StreamsDatum streamsDatum)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

STREAMS_ID

public static final String STREAMS_ID

See Also:

Constant Field Values

lineWriterUtil

protected LineReadWriteUtil lineWriterUtil

Constructor Detail

S3PersistWriter

public S3PersistWriter()

S3PersistWriter

public S3PersistWriter(S3WriterConfiguration s3WriterConfiguration)

S3PersistWriter

public S3PersistWriter(com.amazonaws.services.s3.AmazonS3Client amazonS3Client,
                       S3WriterConfiguration s3WriterConfiguration)

Instantiator with a pre-existing amazonS3Client, this is used to help with re-use.

Parameters:

amazonS3Client - If you have an existing amazonS3Client, it wont' bother to create another one

s3WriterConfiguration - Configuration of the write paths and instructions are still required.

Method Detail

getAmazonS3Client

public com.amazonaws.services.s3.AmazonS3Client getAmazonS3Client()

getS3WriterConfiguration

public S3WriterConfiguration getS3WriterConfiguration()

getWrittenFiles

public List<String> getWrittenFiles()

getObjectMetaData

public Map<String,String> getObjectMetaData()

getObjectMapper

public com.fasterxml.jackson.databind.ObjectMapper getObjectMapper()

setObjectMapper

public void setObjectMapper(com.fasterxml.jackson.databind.ObjectMapper mapper)

setObjectMetaData

public void setObjectMetaData(Map<String,String> val)

getId

public String getId()

Specified by:

getId in interface StreamsOperation

write

public void write(StreamsDatum streamsDatum)

Specified by:

write in interface StreamsPersistWriter

resetFile

public OutputStreamWriter resetFile()
                             throws Exception

Reset File when it's time to create a new file.

Returns:

OutputStreamWriter

Throws:

Exception - Exception

prepare

public void prepare(Object configurationObject)

Specified by:

prepare in interface StreamsOperation

cleanUp

public void cleanUp()

Specified by:

cleanUp in interface StreamsOperation

getDatumStatusCounter

public DatumStatusCounter getDatumStatusCounter()

Specified by:

getDatumStatusCounter in interface DatumStatusCountable