org.apache.hadoop.hbase.regionserver.compactions

Class DefaultCompactor

java.lang.Object

org.apache.hadoop.hbase.regionserver.compactions.Compactor<StoreFile.Writer>

org.apache.hadoop.hbase.regionserver.compactions.DefaultCompactor

Direct Known Subclasses:

DefaultMobStoreCompactor, TestCompaction.DummyCompactor, TestDefaultStoreEngine.DummyCompactor

@InterfaceAudience.Private
public class DefaultCompactor
extends Compactor<StoreFile.Writer>

Compact passed set of files. Create an instance and then call compact(CompactionRequest, CompactionThroughputController, User)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.hbase.regionserver.compactions.Compactor

Compactor.CellSink, Compactor.CellSinkFactory<S>, Compactor.FileDetails, Compactor.InternalScannerFactory

Field Summary

Fields inherited from class org.apache.hadoop.hbase.regionserver.compactions.Compactor

compactionCompression, compactionKVMax, conf, defaultScannerFactory, keepSeqIdPeriod, progress, store

Constructor Summary

Constructors

Constructor and Description
DefaultCompactor(Configuration conf, Store store)

Method Summary

Modifier and Type	Method and Description
protected void	abortWriter(StoreFile.Writer writer)
protected List<Path>	commitWriter(StoreFile.Writer writer, Compactor.FileDetails fd, CompactionRequest request)
List<Path>	compact(CompactionRequest request, CompactionThroughputController throughputController, User user) Do a minor/major compaction on an explicit set of storefiles from a Store.
List<Path>	compactForTesting(Collection<StoreFile> filesToCompact, boolean isMajor) Compact a list of files for testing.
protected StoreFile.Writer	createTmpWriter(Compactor.FileDetails fd, long smallestReadPoint) Creates a writer for a new file in a temporary directory.

Methods inherited from class org.apache.hadoop.hbase.regionserver.compactions.Compactor

appendMetadataAndCloseWriter, compact, createFileScanners, createScanner, createScanner, createTmpWriter, getFileDetails, getProgress, getSmallestReadPoint, performCompaction, postCreateCoprocScanner, preCreateCoprocScanner, preCreateCoprocScanner

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultCompactor

public DefaultCompactor(Configuration conf,
                        Store store)

Method Detail

compact

public List<Path> compact(CompactionRequest request,
                          CompactionThroughputController throughputController,
                          User user)
                   throws IOException

Do a minor/major compaction on an explicit set of storefiles from a Store.

Throws:

IOException

createTmpWriter

protected StoreFile.Writer createTmpWriter(Compactor.FileDetails fd,
                                           long smallestReadPoint)
                                    throws IOException

Creates a writer for a new file in a temporary directory.

Parameters:

fd - The file details.

smallestReadPoint - The smallest mvcc readPoint across all the scanners in this region.

Returns:

Writer for a new StoreFile in the tmp dir.

Throws:

IOException

compactForTesting

public List<Path> compactForTesting(Collection<StoreFile> filesToCompact,
                                    boolean isMajor)
                             throws IOException

Compact a list of files for testing. Creates a fake CompactionRequest to pass to compact(CompactionRequest, CompactionThroughputController, User);

Parameters:

filesToCompact - the files to compact. These are used as the compactionSelection for the generated CompactionRequest.

isMajor - true to major compact (prune all deletes, max versions, etc)

Returns:

Product of compaction or an empty list if all cells expired or deleted and nothing \ made it through the compaction.

Throws:

IOException

commitWriter

protected List<Path> commitWriter(StoreFile.Writer writer,
                                  Compactor.FileDetails fd,
                                  CompactionRequest request)
                           throws IOException

Specified by:

commitWriter in class Compactor<StoreFile.Writer>

Throws:

IOException

abortWriter

protected void abortWriter(StoreFile.Writer writer)
                    throws IOException

Specified by:

abortWriter in class Compactor<StoreFile.Writer>

Throws:

IOException