org.apache.streams.s3

Class S3ObjectInputStreamWrapper

java.lang.Object

java.io.InputStream

org.apache.streams.s3.S3ObjectInputStreamWrapper

All Implemented Interfaces:

Closeable, AutoCloseable

public class S3ObjectInputStreamWrapper
extends InputStream

There is a nuance associated with reading portions of files in S3. Everything occurs over an Apache HTTP client object. Apache and therefore Amazon defaults to re-using the stream. As a result, if you only intend read a small portion of the file. You must first "abort" the stream, then close the 'inputStream'. Otherwise, Apache will exhaust the entire stream and transfer the entire file. If you are only reading the first 50 lines of a 5,000,000 line file this becomes problematic.

This class operates as a wrapper to fix the aforementioned nuances.

Reference: http://stackoverflow.com/questions/17782937/connectionpooltimeoutexception-when-iterating-objects-in-s3

Constructor Summary

Constructors

Constructor and Description
S3ObjectInputStreamWrapper(com.amazonaws.services.s3.model.S3Object s3Object) Create an input stream safely.

Method Summary

Modifier and Type	Method and Description
int	available()
void	close()
void	ensureEverythingIsReleased() ensureEverythingIsReleased as part of close process.
boolean	equals(Object obj)
protected void	finalize()
int	hashCode()
void	mark(int readlimit)
boolean	markSupported()
int	read()
int	read(byte[] byt)
int	read(byte[] byt, int off, int len)
void	reset()
long	skip(long skip)
String	toString()

Methods inherited from class java.lang.Object

clone, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

S3ObjectInputStreamWrapper

public S3ObjectInputStreamWrapper(com.amazonaws.services.s3.model.S3Object s3Object)

Create an input stream safely.

Parameters:

s3Object - s3Object

Method Detail

hashCode

public int hashCode()

Overrides:

hashCode in class Object

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

toString

public String toString()

Overrides:

toString in class Object

read

public int read()
         throws IOException

Specified by:

read in class InputStream

Throws:

IOException

read

public int read(byte[] byt)
         throws IOException

Overrides:

read in class InputStream

Throws:

IOException

read

public int read(byte[] byt,
                int off,
                int len)
         throws IOException

Overrides:

read in class InputStream

Throws:

IOException

skip

public long skip(long skip)
          throws IOException

Overrides:

skip in class InputStream

Throws:

IOException

available

public int available()
              throws IOException

Overrides:

available in class InputStream

Throws:

IOException

markSupported

public boolean markSupported()

Overrides:

markSupported in class InputStream

mark

public void mark(int readlimit)

Overrides:

mark in class InputStream

reset

public void reset()
           throws IOException

Overrides:

reset in class InputStream

Throws:

IOException

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class InputStream

Throws:

IOException

ensureEverythingIsReleased

public void ensureEverythingIsReleased()

ensureEverythingIsReleased as part of close process.

finalize

protected void finalize()
                 throws Throwable

Overrides:

finalize in class Object

Throws:

Throwable