org.apache.hadoop.hbase.regionserver.wal

Class TestFSHLog

java.lang.Object

org.apache.hadoop.hbase.regionserver.wal.TestFSHLog

public class TestFSHLog
extends java.lang.Object

Provides FSHLog test cases.

Field Summary

Fields

Modifier and Type	Field and Description
protected static Configuration	conf
TestName	currentTest
protected static Path	dir
protected static FileSystem	fs
protected static Log	LOG
protected static Path	rootDir
protected static HBaseTestingUtility	TEST_UTIL
protected static Path	walRootDir

Constructor Summary

Constructors

Constructor and Description
TestFSHLog()

Method Summary

Modifier and Type	Method and Description
protected void	addEdits(WAL log, HRegionInfo hri, HTableDescriptor htd, int times, java.util.concurrent.atomic.AtomicLong sequenceId)
protected void	flushRegion(WAL wal, byte[] regionEncodedName, java.util.Set<byte[]> flushedFamilyNames) helper method to simulate region flush for a WAL.
void	setUp()
static void	setUpBeforeClass()
void	tearDown()
static void	tearDownAfterClass()
void	testAllRegionsFlushed() Simulates WAL append ops for a region and tests FSHLog#areAllRegionsFlushed(Map, Map, Map) API.
void	testFailedToCreateWALIfParentRenamed()
void	testFindMemStoresEligibleForFlush() On rolling a wal after reaching the threshold, WAL#rollWriter() returns the list of regions which should be flushed in order to archive the oldest wal file.
void	testFlushSequenceIdIsGreaterThanAllEditsInHFile() Test flush for sure has a sequence id that is beyond the last edit appended.
void	testSyncRunnerIndexOverflow()
void	testUnflushedSeqIdTracking() Test case for https://issues.apache.org/jira/browse/HBASE-16721
void	testWALComparator() tests the log comparator.
void	testWALCoprocessorLoaded() A loaded WAL coprocessor won't break existing WAL test cases.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final Log LOG

conf

protected static Configuration conf

fs

protected static FileSystem fs

dir

protected static Path dir

rootDir

protected static Path rootDir

walRootDir

protected static Path walRootDir

TEST_UTIL

protected static final HBaseTestingUtility TEST_UTIL

currentTest

public final TestName currentTest

Constructor Detail

TestFSHLog

public TestFSHLog()

Method Detail

setUp

public void setUp()
           throws java.lang.Exception

Throws:

java.lang.Exception

tearDown

public void tearDown()
              throws java.lang.Exception

Throws:

java.lang.Exception

setUpBeforeClass

public static void setUpBeforeClass()
                             throws java.lang.Exception

Throws:

java.lang.Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws java.lang.Exception

Throws:

java.lang.Exception

testWALCoprocessorLoaded

public void testWALCoprocessorLoaded()
                              throws java.lang.Exception

A loaded WAL coprocessor won't break existing WAL test cases.

Throws:

java.lang.Exception

addEdits

protected void addEdits(WAL log,
                        HRegionInfo hri,
                        HTableDescriptor htd,
                        int times,
                        java.util.concurrent.atomic.AtomicLong sequenceId)
                 throws java.io.IOException

Throws:

java.io.IOException

flushRegion

protected void flushRegion(WAL wal,
                           byte[] regionEncodedName,
                           java.util.Set<byte[]> flushedFamilyNames)

helper method to simulate region flush for a WAL.

Parameters:

wal -

regionEncodedName -

testWALComparator

public void testWALComparator()
                       throws java.lang.Exception

tests the log comparator. Ensure that we are not mixing meta logs with non-meta logs (throws exception if we do). Comparison is based on the timestamp present in the wal name.

Throws:

java.lang.Exception

testFindMemStoresEligibleForFlush

public void testFindMemStoresEligibleForFlush()
                                       throws java.lang.Exception

On rolling a wal after reaching the threshold, WAL#rollWriter() returns the list of regions which should be flushed in order to archive the oldest wal file.

This method tests this behavior by inserting edits and rolling the wal enough times to reach the max number of logs threshold. It checks whether we get the "right regions" for flush on rolling the wal.

Throws:

java.lang.Exception

testAllRegionsFlushed

public void testAllRegionsFlushed()

Simulates WAL append ops for a region and tests FSHLog#areAllRegionsFlushed(Map, Map, Map) API. It compares the region sequenceIds with oldestFlushing and oldestUnFlushed entries. If a region's entries are larger than min of (oldestFlushing, oldestUnFlushed), then the region should be flushed before archiving this WAL.

testFailedToCreateWALIfParentRenamed

public void testFailedToCreateWALIfParentRenamed()
                                          throws java.io.IOException

Throws:

java.io.IOException

testFlushSequenceIdIsGreaterThanAllEditsInHFile

public void testFlushSequenceIdIsGreaterThanAllEditsInHFile()
                                                     throws java.io.IOException

Test flush for sure has a sequence id that is beyond the last edit appended. We do this by slowing appends in the background ring buffer thread while in foreground we call flush. The addition of the sync over HRegion in flush should fix an issue where flush was returning before all of its appends had made it out to the WAL (HBASE-11109). see HBASE-11109

Throws:

java.io.IOException

testSyncRunnerIndexOverflow

public void testSyncRunnerIndexOverflow()
                                 throws java.io.IOException,
                                        java.lang.NoSuchFieldException,
                                        java.lang.SecurityException,
                                        java.lang.IllegalArgumentException,
                                        java.lang.IllegalAccessException

Throws:

java.io.IOException

java.lang.NoSuchFieldException

java.lang.SecurityException

java.lang.IllegalArgumentException

java.lang.IllegalAccessException

testUnflushedSeqIdTracking

public void testUnflushedSeqIdTracking()
                                throws java.io.IOException,
                                       java.lang.InterruptedException

Test case for https://issues.apache.org/jira/browse/HBASE-16721

Throws:

java.io.IOException

java.lang.InterruptedException