com.bigdata.service.jini.master
Interface MappedTaskMaster.ConfigurationOptions

All Superinterfaces:

TaskMaster.ConfigurationOptions

All Known Subinterfaces:

MappedRDFDataLoadMaster.ConfigurationOptions

Enclosing class:

MappedTaskMaster<S extends MappedTaskMaster.JobState,T extends AbstractAsynchronousClientTask<U,V,L>,L extends ClientLocator,U,V extends Serializable>

public static interface MappedTaskMaster.ConfigurationOptions
extends TaskMaster.ConfigurationOptions

Configuration options for the MappedTaskMaster.

Version:

$Id$

Author:

Bryan Thompson

Field Summary

static String	CLIENT_HASH_FUNCTION The hash function used to assign resources to client tasks.
static int	DEFAULT_PENDING_SET_MASTER_INITIAL_CAPACITY
static int	DEFAULT_PENDING_SET_SUBTASK_INITIAL_CAPACITY
static String	DELETE_AFTER When true, the source files identified by the scanner will be deleted if they are successfully processed.
static String	PENDING_SET_MASTER_INITIAL_CAPACITY The initial capacity of the pending Map for the job -or- Integer.MAX_VALUE to use a BigdataMap.
static String	PENDING_SET_SUBTASK_INITIAL_CAPACITY The initial capacity of the pending Set for each client -or- Integer.MAX_VALUE to use a BigdataSet.
static String	RESOURCE_BUFFER_CONFIG Option specifies the AsynchronousIndexWriteConfiguration used to provision the buffer on which the master queues the resources to be processed by the client tasks.
static String	RESOURCE_SCANNER_FACTORY Option specifies the IResourceScannerFactory used to instantiate the scanner which will select the resources to be processed by the job.

Fields inherited from interface com.bigdata.service.jini.master.TaskMaster.ConfigurationOptions

AGGREGATORS_TEMPLATE, CLIENTS_TEMPLATE, DELETE_JOB, FORCE_OVERFLOW, INDEX_DUMP_DIR, INDEX_DUMP_NAMESPACE, JOB_NAME, NAGGREGATORS, NCLIENTS, SERVICES_DISCOVERY_TIMEOUT, SERVICES_TEMPLATES

Field Detail

RESOURCE_BUFFER_CONFIG

static final String RESOURCE_BUFFER_CONFIG

Option specifies the AsynchronousIndexWriteConfiguration used to provision the buffer on which the master queues the resources to be processed by the client tasks.

Note: The configuration values for the indices are stored in the IndexMetadata on the IMetadataService. The easiest way to tweak things is just to update the IndexMetadata objects on the IMetadataService.

Note: Clients using the asynchronous index write API are MUCH more efficient if they can maintain a steady workload.

See Also:

Constant Field Values

RESOURCE_SCANNER_FACTORY

static final String RESOURCE_SCANNER_FACTORY

Option specifies the IResourceScannerFactory used to instantiate the scanner which will select the resources to be processed by the job.

See Also:

Constant Field Values

PENDING_SET_MASTER_INITIAL_CAPACITY

static final String PENDING_SET_MASTER_INITIAL_CAPACITY

The initial capacity of the pending Map for the job -or- Integer.MAX_VALUE to use a BigdataMap.

The pending set contains all resources for which there is an outstanding asynchronous work request. There is a pending set for the ResourceBufferTask (per job) and the ResourceBufferSubtask (per client).

See Also:

Constant Field Values

DEFAULT_PENDING_SET_MASTER_INITIAL_CAPACITY

static final int DEFAULT_PENDING_SET_MASTER_INITIAL_CAPACITY

See Also:

Constant Field Values

PENDING_SET_SUBTASK_INITIAL_CAPACITY

static final String PENDING_SET_SUBTASK_INITIAL_CAPACITY

The initial capacity of the pending Set for each client -or- Integer.MAX_VALUE to use a BigdataSet.

See Also:

Constant Field Values

DEFAULT_PENDING_SET_SUBTASK_INITIAL_CAPACITY

static final int DEFAULT_PENDING_SET_SUBTASK_INITIAL_CAPACITY

See Also:

Constant Field Values

CLIENT_HASH_FUNCTION

static final String CLIENT_HASH_FUNCTION

The hash function used to assign resources to client tasks.

See Also:

Constant Field Values

DELETE_AFTER

static final String DELETE_AFTER

When true, the source files identified by the scanner will be deleted if they are successfully processed.

See Also:

Constant Field Values