com.northconcepts.datapipeline.filesystem.amazons3

Class AmazonS3FileSystem

java.lang.Object

FileSystem

com.northconcepts.datapipeline.filesystem.amazons3.AmazonS3FileSystem

public class AmazonS3FileSystem
extends FileSystem

Class for accessing an Amazon S3 file system.

Field Summary

Fields

Modifier and Type	Field and Description
static int	DEFAULT_QUEUE_SIZE
static int	MINIMUM_PART_SIZE

Constructor Summary

Constructors

Constructor and Description
AmazonS3FileSystem() Constructs an Amazon S3 file system instance.

Method Summary

Modifier and Type	Method and Description
void	close() Closes the Amazon S3 connection.
AmazonS3Client	getClient()
AWSCredentials	getCredentials()
AWSCredentialsProvider	getCredentialsProvider()
boolean	isDebug()
List<Bucket>	listBuckets() Returns the buckets owned by the authenticated user.
ObjectListing	listFolder(String bucket, String folder) Returns the objects in the specified bucket's folder.
ObjectListing	listRootFolder(String bucket) Returns the root objects in the specified bucket.
ObjectListing	nextBatch(ObjectListing previousListing) Returns the next set of paged objects.
void	open() Opens a connection to the Amazon S3 file system.
InputStream	readFile(String bucket, String filePath) Reads the file in the S3 bucket.
AmazonS3FileSystem	setBasicAWSCredentials(String accessKey, String secretKey)
AmazonS3FileSystem	setCredentials(AWSCredentials credentials)
AmazonS3FileSystem	setCredentialsProvider(AWSCredentialsProvider credentialsProvider)
AmazonS3FileSystem	setDebug(boolean debug)
AmazonS3FileSystem	setProfileCredentialsProvider()
OutputStream	writeMultipartFile(String bucket, String filePath)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MINIMUM_PART_SIZE

public static final int MINIMUM_PART_SIZE

See Also:

Constant Field Values

DEFAULT_QUEUE_SIZE

public static final int DEFAULT_QUEUE_SIZE

See Also:

Constant Field Values

Constructor Detail

AmazonS3FileSystem

public AmazonS3FileSystem()

Constructs an Amazon S3 file system instance.

Method Detail

getCredentialsProvider

public AWSCredentialsProvider getCredentialsProvider()

setCredentialsProvider

public AmazonS3FileSystem setCredentialsProvider(AWSCredentialsProvider credentialsProvider)

setProfileCredentialsProvider

public AmazonS3FileSystem setProfileCredentialsProvider()

getCredentials

public AWSCredentials getCredentials()

setCredentials

public AmazonS3FileSystem setCredentials(AWSCredentials credentials)

setBasicAWSCredentials

public AmazonS3FileSystem setBasicAWSCredentials(String accessKey,
                                                 String secretKey)

isDebug

public boolean isDebug()

setDebug

public AmazonS3FileSystem setDebug(boolean debug)

open

public void open()
          throws DataException

Opens a connection to the Amazon S3 file system.

Throws:

DataException

close

public void close()
           throws DataException

Closes the Amazon S3 connection.

Throws:

DataException

getClient

public AmazonS3Client getClient()

readFile

public InputStream readFile(String bucket,
                            String filePath)

Reads the file in the S3 bucket. To specify a nested folder, use "/" as the path separator.

writeMultipartFile

public OutputStream writeMultipartFile(String bucket,
                                       String filePath)

listBuckets

public List<Bucket> listBuckets()
                         throws Throwable

Returns the buckets owned by the authenticated user.

Throws:

Throwable

listRootFolder

public ObjectListing listRootFolder(String bucket)
                             throws Throwable

Returns the root objects in the specified bucket.

Throws:

Throwable

listFolder

public ObjectListing listFolder(String bucket,
                                String folder)
                         throws Throwable

Returns the objects in the specified bucket's folder.

Throws:

Throwable

nextBatch

public ObjectListing nextBatch(ObjectListing previousListing)
                        throws Throwable

Returns the next set of paged objects.

Throws:

Throwable