org.apache.hadoop.hbase.regionserver.wal

Class TestWALReplay

java.lang.Object

org.apache.hadoop.hbase.regionserver.wal.TestWALReplay

Direct Known Subclasses:

TestSecureWALReplay, TestWALReplayCompressed

public class TestWALReplay
extends java.lang.Object

Test replay of edits out of a WAL split.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestWALReplay.CustomStoreFlusher

Field Summary

Fields

Modifier and Type	Field and Description
TestName	currentTest
static Log	LOG

Constructor Summary

Constructors

Constructor and Description
TestWALReplay()

Method Summary

Modifier and Type	Method and Description
void	setUp()
static void	setUpBeforeClass()
void	tearDown()
static void	tearDownAfterClass()
void	test2727() Tests for hbase-2727.
void	testCompactedBulkLoadedFiles() HRegion test case that is made of a major compacted HFile (created with three bulk loaded files) and an edit in the memstore.
void	testDatalossWhenInputError() testcase for https://issues.apache.org/jira/browse/HBASE-15252
void	testRegionMadeOfBulkLoadedFilesOnly() Test case of HRegion that is only made out of bulk loaded files.
void	testReplayEditsAfterAbortingFlush() Test that we could recover the data correctly after aborting flush.
void	testReplayEditsAfterPartialFlush() Test that we recover correctly when there is a failure in between the flushes.
void	testReplayEditsAfterRegionMovedWithMultiCF()
void	testReplayEditsWrittenIntoWAL() Create an HRegion with the result of a WAL split and test we only see the good edits
void	testReplayEditsWrittenViaHRegion() Test writing edits into an HRegion, closing it, splitting logs, opening Region again.
void	testSequentialEditLogSeqNum()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final Log LOG

currentTest

public final TestName currentTest

Constructor Detail

TestWALReplay

public TestWALReplay()

Method Detail

setUpBeforeClass

public static void setUpBeforeClass()
                             throws java.lang.Exception

Throws:

java.lang.Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws java.lang.Exception

Throws:

java.lang.Exception

setUp

public void setUp()
           throws java.lang.Exception

Throws:

java.lang.Exception

tearDown

public void tearDown()
              throws java.lang.Exception

Throws:

java.lang.Exception

testReplayEditsAfterRegionMovedWithMultiCF

public void testReplayEditsAfterRegionMovedWithMultiCF()
                                                throws java.lang.Exception

Throws:

java.lang.Exception

test2727

public void test2727()
              throws java.lang.Exception

Tests for hbase-2727.

Throws:

java.lang.Exception

See Also:

https://issues.apache.org/jira/browse/HBASE-2727

testRegionMadeOfBulkLoadedFilesOnly

public void testRegionMadeOfBulkLoadedFilesOnly()
                                         throws java.io.IOException,
                                                java.lang.SecurityException,
                                                java.lang.IllegalArgumentException,
                                                java.lang.NoSuchFieldException,
                                                java.lang.IllegalAccessException,
                                                java.lang.InterruptedException

Test case of HRegion that is only made out of bulk loaded files. Assert that we don't 'crash'.

Throws:

java.io.IOException

java.lang.IllegalAccessException

java.lang.NoSuchFieldException

java.lang.IllegalArgumentException

java.lang.SecurityException

java.lang.InterruptedException

testCompactedBulkLoadedFiles

public void testCompactedBulkLoadedFiles()
                                  throws java.io.IOException,
                                         java.lang.SecurityException,
                                         java.lang.IllegalArgumentException,
                                         java.lang.NoSuchFieldException,
                                         java.lang.IllegalAccessException,
                                         java.lang.InterruptedException

HRegion test case that is made of a major compacted HFile (created with three bulk loaded files) and an edit in the memstore. This is for HBASE-10958 "[dataloss] Bulk loading with seqids can prevent some log entries from being replayed"

Throws:

java.io.IOException

java.lang.IllegalAccessException

java.lang.NoSuchFieldException

java.lang.IllegalArgumentException

java.lang.SecurityException

java.lang.InterruptedException

testReplayEditsWrittenViaHRegion

public void testReplayEditsWrittenViaHRegion()
                                      throws java.io.IOException,
                                             java.lang.SecurityException,
                                             java.lang.IllegalArgumentException,
                                             java.lang.NoSuchFieldException,
                                             java.lang.IllegalAccessException,
                                             java.lang.InterruptedException

Test writing edits into an HRegion, closing it, splitting logs, opening Region again. Verify seqids.

Throws:

java.io.IOException

java.lang.IllegalAccessException

java.lang.NoSuchFieldException

java.lang.IllegalArgumentException

java.lang.SecurityException

java.lang.InterruptedException

testReplayEditsAfterPartialFlush

public void testReplayEditsAfterPartialFlush()
                                      throws java.io.IOException,
                                             java.lang.SecurityException,
                                             java.lang.IllegalArgumentException,
                                             java.lang.NoSuchFieldException,
                                             java.lang.IllegalAccessException,
                                             java.lang.InterruptedException

Test that we recover correctly when there is a failure in between the flushes. i.e. Some stores got flushed but others did not. Unfortunately, there is no easy hook to flush at a store level. The way we get around this is by flushing at the region level, and then deleting the recently flushed store file for one of the Stores. This would put us back in the situation where all but that store got flushed and the region died. We restart Region again, and verify that the edits were replayed.

Throws:

java.io.IOException

java.lang.IllegalAccessException

java.lang.NoSuchFieldException

java.lang.IllegalArgumentException

java.lang.SecurityException

java.lang.InterruptedException

testReplayEditsAfterAbortingFlush

public void testReplayEditsAfterAbortingFlush()
                                       throws java.io.IOException

Test that we could recover the data correctly after aborting flush. In the test, first we abort flush after writing some data, then writing more data and flush again, at last verify the data.

Throws:

java.io.IOException

testReplayEditsWrittenIntoWAL

public void testReplayEditsWrittenIntoWAL()
                                   throws java.lang.Exception

Create an HRegion with the result of a WAL split and test we only see the good edits

Throws:

java.lang.Exception

testSequentialEditLogSeqNum

public void testSequentialEditLogSeqNum()
                                 throws java.io.IOException

Throws:

java.io.IOException

testDatalossWhenInputError

public void testDatalossWhenInputError()
                                throws java.io.IOException,
                                       java.lang.InstantiationException,
                                       java.lang.IllegalAccessException

testcase for https://issues.apache.org/jira/browse/HBASE-15252

Throws:

java.io.IOException

java.lang.InstantiationException

java.lang.IllegalAccessException