org.apache.hadoop.hbase.wal

Class TestDefaultWALProvider

java.lang.Object

org.apache.hadoop.hbase.wal.TestDefaultWALProvider

Direct Known Subclasses:

TestDefaultWALProviderWithHLogKey

public class TestDefaultWALProvider
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
protected static Configuration	conf
TestName	currentTest
protected static FileSystem	fs
protected static Log	LOG
protected static HBaseTestingUtility	TEST_UTIL
protected static FileSystem	walFs
protected static Path	walRootDir

Constructor Summary

Constructors

Constructor and Description
TestDefaultWALProvider()

Method Summary

Modifier and Type	Method and Description
protected void	addEdits(WAL log, HRegionInfo hri, HTableDescriptor htd, int times, AtomicLong sequenceId)
protected void	flushRegion(WAL wal, byte[] regionEncodedName, Set<byte[]> flushedFamilyNames) helper method to simulate region flush for a WAL.
void	setMembershipDedups() Ensure that we can use Set.add to deduplicate WALs
void	setUp()
static void	setUpBeforeClass()
void	tearDown()
static void	tearDownAfterClass()
void	testConcurrentWrites() Write to a log file with three concurrent threads and verifying all data is written.
void	testGetServerNameFromWALDirectoryName()
void	testLogCleaning()
void	testWALArchiving() Tests wal archiving by adding data, doing flushing/rolling and checking we archive old logs and also don't archive "live logs" (that is, a log with un-flushed entries).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final Log LOG

conf

protected static Configuration conf

fs

protected static FileSystem fs

walFs

protected static FileSystem walFs

walRootDir

protected static Path walRootDir

TEST_UTIL

protected static final HBaseTestingUtility TEST_UTIL

currentTest

public final TestName currentTest

Constructor Detail

TestDefaultWALProvider

public TestDefaultWALProvider()

Method Detail

setUp

public void setUp()
           throws Exception

Throws:

Exception

tearDown

public void tearDown()
              throws Exception

Throws:

Exception

setUpBeforeClass

public static void setUpBeforeClass()
                             throws Exception

Throws:

Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws Exception

Throws:

Exception

testGetServerNameFromWALDirectoryName

public void testGetServerNameFromWALDirectoryName()
                                           throws IOException

Throws:

IOException

addEdits

protected void addEdits(WAL log,
                        HRegionInfo hri,
                        HTableDescriptor htd,
                        int times,
                        AtomicLong sequenceId)
                 throws IOException

Throws:

IOException

flushRegion

protected void flushRegion(WAL wal,
                           byte[] regionEncodedName,
                           Set<byte[]> flushedFamilyNames)

helper method to simulate region flush for a WAL.

Parameters:

wal -

regionEncodedName -

testLogCleaning

public void testLogCleaning()
                     throws Exception

Throws:

Exception

testWALArchiving

public void testWALArchiving()
                      throws IOException

Tests wal archiving by adding data, doing flushing/rolling and checking we archive old logs and also don't archive "live logs" (that is, a log with un-flushed entries).

This is what it does: It creates two regions, and does a series of inserts along with log rolling. Whenever a WAL is rolled, HLogBase checks previous wals for archiving. A wal is eligible for archiving if for all the regions which have entries in that wal file, have flushed - past their maximum sequence id in that wal file.

Throws:

IOException

testConcurrentWrites

public void testConcurrentWrites()
                          throws Exception

Write to a log file with three concurrent threads and verifying all data is written.

Throws:

Exception

setMembershipDedups

public void setMembershipDedups()
                         throws IOException

Ensure that we can use Set.add to deduplicate WALs

Throws:

IOException