com.bigdata.service.ndx.pipeline
Class AbstractRunnableMasterStats<L,HS extends AbstractSubtaskStats>

java.lang.Object
  com.bigdata.service.ndx.pipeline.AbstractMasterStats<L,HS>
      com.bigdata.service.ndx.pipeline.AbstractRunnableMasterStats<L,HS>

Direct Known Subclasses:

AbstractPendingSetMasterStats, IndexAsyncWriteStats

public class AbstractRunnableMasterStats<L,HS extends AbstractSubtaskStats>
extends AbstractMasterStats<L,HS>

Statistics for the consumer, including several moving averages based on sampled data.

Version:

$Id: AbstractRunnableMasterStats.java 2265 2009-10-26 12:51:06Z thompsonbry $

Author:

Bryan Thompson

TODO:

The sink counters based on a MovingAverageTask will stop updating once a given sink is discarded. Since the MovingAverageTask is no longer run, the counter does not get a new sample from that task and the counter value thereafter remains the same.

Nested Class Summary

protected class

AbstractRunnableMasterStats.StatisticsTask Task samples various counters of interest and convert them into moving averages.

Field Summary

AtomicLong	duplicateCount The #of duplicates which were filtered out.
long	elapsedHandleChunkNanos Elapsed nanoseconds in IndexWriteTask.handleChunk(com.bigdata.btree.keys.KVO[], boolean) .
long	elapsedSplitChunkNanos Elapsed nanoseconds in IndexWriteTask.handleChunk(com.bigdata.btree.keys.KVO[], boolean) required to split a chunk drained from the master.
AtomicLong	handledChunkCount The #of chunks that have passed through IndexWriteTask.handleChunk(com.bigdata.btree.keys.KVO[], boolean) .
protected static double	scalingFactor Scaling factor converts nanoseconds to milliseconds.
protected AbstractRunnableMasterStats.StatisticsTask	statisticsTask Task that will convert sampled data into moving averages.

Fields inherited from class com.bigdata.service.ndx.pipeline.AbstractMasterStats

chunksIn, chunksOut, chunksTransferred, elapsedRedirectNanos, elapsedSinkChunkWaitingNanos, elapsedSinkChunkWritingNanos, elapsedSinkOfferNanos, elementsIn, elementsOnSinkQueues, elementsOut, elementsTransferred, masterCreateCount, masters, redirectCount, subtaskEndCount, subtaskIdleTimeoutCount, subtaskStartCount

Constructor Summary

AbstractRunnableMasterStats(AbstractFederation<?> fed)

Method Summary

CounterSet	getCounterSet() Return a CounterSet which may be used to report the statistics on the index write operation.
protected AbstractRunnableMasterStats.StatisticsTask	newStatisticsTask() Return the AbstractRunnableMasterStats.StatisticsTask that will sample various counters of interest and convert them into moving averages.
protected HS	newSubtaskStats(L locator) Factory for the subtask statistics.
String	toString()

Methods inherited from class com.bigdata.service.ndx.pipeline.AbstractMasterStats

getActiveSinkCount, getMasterActiveCount, getMaximumPartitionCount, getSubtaskStats, getSubtaskStats

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

duplicateCount

public final AtomicLong duplicateCount

The #of duplicates which were filtered out.

handledChunkCount

public final AtomicLong handledChunkCount

The #of chunks that have passed through IndexWriteTask.handleChunk(com.bigdata.btree.keys.KVO[], boolean) .

elapsedSplitChunkNanos

public long elapsedSplitChunkNanos

Elapsed nanoseconds in IndexWriteTask.handleChunk(com.bigdata.btree.keys.KVO[], boolean) required to split a chunk drained from the master.

elapsedHandleChunkNanos

public long elapsedHandleChunkNanos

Elapsed nanoseconds in IndexWriteTask.handleChunk(com.bigdata.btree.keys.KVO[], boolean) .

statisticsTask

protected final AbstractRunnableMasterStats.StatisticsTask statisticsTask

Task that will convert sampled data into moving averages.

scalingFactor

protected static final double scalingFactor

Scaling factor converts nanoseconds to milliseconds.

Constructor Detail

AbstractRunnableMasterStats

public AbstractRunnableMasterStats(AbstractFederation<?> fed)

Method Detail

newStatisticsTask

protected AbstractRunnableMasterStats.StatisticsTask newStatisticsTask()

Return the AbstractRunnableMasterStats.StatisticsTask that will sample various counters of interest and convert them into moving averages. This be overridden to extend the sampled counters. However, you MUST also override getCounterSet() to report any additional data.

getCounterSet

public CounterSet getCounterSet()

Return a CounterSet which may be used to report the statistics on the index write operation. The CounterSet is NOT placed into any namespace.

Overrides:

getCounterSet in class AbstractMasterStats<L,HS extends AbstractSubtaskStats>

toString

public String toString()

Overrides:

toString in class AbstractMasterStats<L,HS extends AbstractSubtaskStats>

newSubtaskStats

protected HS newSubtaskStats(L locator)

Description copied from class: AbstractMasterStats

Factory for the subtask statistics.

Specified by:

newSubtaskStats in class AbstractMasterStats<L,HS extends AbstractSubtaskStats>

Parameters:

locator - The subtask key.

Returns:

The statistics for the subtask.