net.yacy.kelondro.rwi

Class IODispatcher

java.lang.Object

java.lang.Thread

net.yacy.kelondro.rwi.IODispatcher

All Implemented Interfaces:

java.lang.Runnable

public class IODispatcher
extends java.lang.Thread

this is a concurrent merger that can merge single files that are queued for merging. when several ReferenceContainerArray classes host their ReferenceContainer file arrays, they may share a single ReferenceContainerMerger object which does the sharing for all of them. This is the best way to do the merging, because it does heavy IO access and such access should not be performed concurrently, but queued. This class is the manaagement class for queueing of merge jobs. to use this class, first instantiate a object and then start the concurrent execution of merging with a call to the start() - method. To shut down all mergings, call terminate() only once.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
private class	IODispatcher.DumpJob<ReferenceType extends Reference>
private class	IODispatcher.MergeJob

Nested classes/interfaces inherited from class java.lang.Thread

java.lang.Thread.State, java.lang.Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field and Description
private java.util.concurrent.Semaphore	controlQueue
private java.util.concurrent.ArrayBlockingQueue<IODispatcher.DumpJob<? extends Reference>>	dumpQueue
private static ConcurrentLog	log
private java.util.concurrent.ArrayBlockingQueue<IODispatcher.MergeJob>	mergeQueue
private boolean	terminate
private java.util.concurrent.Semaphore	termination
private int	writeBufferSize

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
IODispatcher(int dumpQueueLength, int mergeQueueLength, int writeBufferSize)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	dump(ReferenceContainerCache<? extends Reference> cache, java.io.File file, ReferenceContainerArray<? extends Reference> array)
protected void	merge(java.io.File f1, java.io.File f2, ReferenceFactory<? extends Reference> factory, ArrayStack array, java.io.File newFile)
protected int	queueLength()
void	run()
void	terminate()

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

log

private static final ConcurrentLog log

controlQueue

private java.util.concurrent.Semaphore controlQueue

termination

private final java.util.concurrent.Semaphore termination

mergeQueue

private java.util.concurrent.ArrayBlockingQueue<IODispatcher.MergeJob> mergeQueue

dumpQueue

private java.util.concurrent.ArrayBlockingQueue<IODispatcher.DumpJob<? extends Reference>> dumpQueue

terminate

private boolean terminate

writeBufferSize

private final int writeBufferSize

Constructor Detail

IODispatcher

public IODispatcher(int dumpQueueLength,
            int mergeQueueLength,
            int writeBufferSize)

Method Detail

terminate

public void terminate()

dump

protected void dump(ReferenceContainerCache<? extends Reference> cache,
        java.io.File file,
        ReferenceContainerArray<? extends Reference> array)

queueLength

protected int queueLength()

merge

protected void merge(java.io.File f1,
         java.io.File f2,
         ReferenceFactory<? extends Reference> factory,
         ArrayStack array,
         java.io.File newFile)

run

public void run()

Specified by:

run in interface java.lang.Runnable

Overrides:

run in class java.lang.Thread