com.bigdata.rdf.load
Class RDFLoadTaskFactory<S extends Statement,T extends Runnable>

java.lang.Object
  com.bigdata.rdf.load.AbstractRDFTaskFactory<S,T>
      com.bigdata.rdf.load.RDFLoadTaskFactory<S,T>

All Implemented Interfaces:

ITaskFactory<T>

public class RDFLoadTaskFactory<S extends Statement,T extends Runnable>
extends AbstractRDFTaskFactory<S,T>

Factory for tasks for loading RDF resources into a database.

Version:

$Id: RDFLoadTaskFactory.java 2265 2009-10-26 12:51:06Z thompsonbry $

Author:

Bryan Thompson

Field Summary

Fields inherited from class com.bigdata.rdf.load.AbstractRDFTaskFactory

db, deleteAfter, fallback, log, verifyData

Constructor Summary

RDFLoadTaskFactory(AbstractTripleStore db, boolean verifyData, boolean deleteafter, RDFFormat fallback, IStatementBufferFactory factory)

RDFLoadTaskFactory(AbstractTripleStore db, int bufferCapacity, BlockingBuffer<ISPO[]> writeBuffer, boolean verifyData, boolean deleteafter, RDFFormat fallback)

Method Summary

CounterSet	getCounters() Sets up some additional counters for reporting by the client to the ILoadBalancerService.
String	reportTotals() Report totals.

Methods inherited from class com.bigdata.rdf.load.AbstractRDFTaskFactory

elapsed, getBufferFactory, getRDFFormat, newTask, notifyEnd, notifyStart

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RDFLoadTaskFactory

public RDFLoadTaskFactory(AbstractTripleStore db,
                          int bufferCapacity,
                          BlockingBuffer<ISPO[]> writeBuffer,
                          boolean verifyData,
                          boolean deleteafter,
                          RDFFormat fallback)

Parameters:

db -

bufferCapacity -

writeBuffer - An optional buffer for asynchronous writes on the statement indices.

verifyData -

deleteAfter - if the file should be deleted once it has been loaded.

fallback - An attempt will be made to determine the interchange syntax using RDFFormat. If no determination can be made then the loader will presume that the files are in the format specified by this parameter (if any). Files whose format can not be determined will be logged as errors.

TODO:

drop the writeBuffer arg.

RDFLoadTaskFactory

public RDFLoadTaskFactory(AbstractTripleStore db,
                          boolean verifyData,
                          boolean deleteafter,
                          RDFFormat fallback,
                          IStatementBufferFactory factory)

Parameters:

db -

verifyData -

deleteAfter - if the file should be deleted once it has been loaded.

fallback - An attempt will be made to determine the interchange syntax using RDFFormat. If no determination can be made then the loader will presume that the files are in the format specified by this parameter (if any). Files whose format can not be determined will be logged as errors.

factory - Used to buffer and load statements.

Method Detail

getCounters

public CounterSet getCounters()

Sets up some additional counters for reporting by the client to the ILoadBalancerService.

TODO:

in the base class also?

reportTotals

public String reportTotals()

Report totals.

Note: these totals reflect the actual state of the database, not just the #of triples written by this client. Therefore if there are concurrent writers then the apparent TPS here will be higher than was reported by the counters for just this client -- all writers on the database will have been attributed to just this client.