org.apache.hadoop.hbase.wal

Class TestWALSplit

java.lang.Object

org.apache.hadoop.hbase.wal.TestWALSplit

Direct Known Subclasses:

TestWALSplitCompressed

public class TestWALSplit
extends java.lang.Object

Testing WAL splitting code.

Field Summary

Fields

Modifier and Type	Field and Description
TestName	name
protected static HBaseTestingUtility	TEST_UTIL

Constructor Summary

Constructors

Constructor and Description
TestWALSplit()

Method Summary

Modifier and Type	Method and Description
static long	appendEntry(Writer writer, TableName table, byte[] region, byte[] row, byte[] family, byte[] qualifier, byte[] value, long seq)
void	setUp()
static void	setUpBeforeClass()
void	tearDown()
static void	tearDownAfterClass()
void	testConcurrentSplitLogAndReplayRecoverEdit()
void	testCorruptedFileGetsArchivedIfSkipErrors()
void	testCorruptedLogFilesSkipErrorsFalseDoesNotTouchLogs()
void	testCorruptWALTrailer()
void	testEmptyLogFiles()
void	testEmptyOpenLogFiles()
void	testEOFisIgnored()
void	testFirstLineCorruptionLogFileSkipErrorsPasses()
void	testIOEOnOutputThread()
void	testLogCannotBeWrittenOnceParsed() Simulates splitting a WAL out from under a regionserver that is still trying to write it.
void	testLogDirectoryShouldBeDeletedAfterSuccessfulSplit()
void	testLogsGetArchivedAfterSplit()
void	testMiddleGarbageCorruptionSkipErrorsReadsHalfOfFile()
void	testMovedWALDuringRecovery()
void	testOldRecoveredEditsFileSidelined() Test old recovered edits file doesn't break WALSplitter.
void	testOpenZeroLengthReportedFileButWithDataGetsSplit()
void	testRecoveredEditsPathForMeta()
void	testRetryOpenDuringRecovery()
void	testSplit()
void	testSplitDeletedRegion()
void	testSplitLogFileDeletedRegionDir()
void	testSplitLogFileEmpty()
void	testSplitLogFileFirstLineCorruptionLog()
void	testSplitLogFileMultipleRegions()
void	testSplitPreservesEdits()
void	testSplitWillFailIfWritingToRegionFails()
void	testTerminationAskedByReporter()
void	testThreading() Test log split process with fake data and lots of edits to trigger threading issues.
void	testThreadingSlowWriterSmallBuffer() Test blocking behavior of the log split process if writers are writing slower than the reader is reading.
void	testTrailingGarbageCorruptionLogFileSkipErrorsFalseThrows()
void	testTralingGarbageCorruptionFileSkipErrorsPasses()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TEST_UTIL

protected static final HBaseTestingUtility TEST_UTIL

name

public TestName name

Constructor Detail

TestWALSplit

public TestWALSplit()

Method Detail

setUpBeforeClass

public static void setUpBeforeClass()
                             throws java.lang.Exception

Throws:

java.lang.Exception

tearDownAfterClass

public static void tearDownAfterClass()
                               throws java.lang.Exception

Throws:

java.lang.Exception

setUp

public void setUp()
           throws java.lang.Exception

Throws:

java.lang.Exception

tearDown

public void tearDown()
              throws java.lang.Exception

Throws:

java.lang.Exception

testLogCannotBeWrittenOnceParsed

public void testLogCannotBeWrittenOnceParsed()
                                      throws java.io.IOException,
                                             java.lang.InterruptedException

Simulates splitting a WAL out from under a regionserver that is still trying to write it. Ensures we do not lose edits.

Throws:

java.io.IOException

java.lang.InterruptedException

testRecoveredEditsPathForMeta

public void testRecoveredEditsPathForMeta()
                                   throws java.io.IOException

Throws:

java.io.IOException

See Also:

https://issues.apache.org/jira/browse/HBASE-3020

testOldRecoveredEditsFileSidelined

public void testOldRecoveredEditsFileSidelined()
                                        throws java.io.IOException

Test old recovered edits file doesn't break WALSplitter. This is useful in upgrading old instances.

Throws:

java.io.IOException

testSplitPreservesEdits

public void testSplitPreservesEdits()
                             throws java.io.IOException

Throws:

java.io.IOException

testEmptyLogFiles

public void testEmptyLogFiles()
                       throws java.io.IOException

Throws:

java.io.IOException

testEmptyOpenLogFiles

public void testEmptyOpenLogFiles()
                           throws java.io.IOException

Throws:

java.io.IOException

testOpenZeroLengthReportedFileButWithDataGetsSplit

public void testOpenZeroLengthReportedFileButWithDataGetsSplit()
                                                        throws java.io.IOException

Throws:

java.io.IOException

testTralingGarbageCorruptionFileSkipErrorsPasses

public void testTralingGarbageCorruptionFileSkipErrorsPasses()
                                                      throws java.io.IOException

Throws:

java.io.IOException

testFirstLineCorruptionLogFileSkipErrorsPasses

public void testFirstLineCorruptionLogFileSkipErrorsPasses()
                                                    throws java.io.IOException

Throws:

java.io.IOException

testMiddleGarbageCorruptionSkipErrorsReadsHalfOfFile

public void testMiddleGarbageCorruptionSkipErrorsReadsHalfOfFile()
                                                          throws java.io.IOException

Throws:

java.io.IOException

testCorruptedFileGetsArchivedIfSkipErrors

public void testCorruptedFileGetsArchivedIfSkipErrors()
                                               throws java.io.IOException

Throws:

java.io.IOException

testTrailingGarbageCorruptionLogFileSkipErrorsFalseThrows

public void testTrailingGarbageCorruptionLogFileSkipErrorsFalseThrows()
                                                               throws java.io.IOException

Throws:

java.io.IOException

testCorruptedLogFilesSkipErrorsFalseDoesNotTouchLogs

public void testCorruptedLogFilesSkipErrorsFalseDoesNotTouchLogs()
                                                          throws java.io.IOException

Throws:

java.io.IOException

testEOFisIgnored

public void testEOFisIgnored()
                      throws java.io.IOException

Throws:

java.io.IOException

testCorruptWALTrailer

public void testCorruptWALTrailer()
                           throws java.io.IOException

Throws:

java.io.IOException

testLogsGetArchivedAfterSplit

public void testLogsGetArchivedAfterSplit()
                                   throws java.io.IOException

Throws:

java.io.IOException

testSplit

public void testSplit()
               throws java.io.IOException

Throws:

java.io.IOException

testLogDirectoryShouldBeDeletedAfterSuccessfulSplit

public void testLogDirectoryShouldBeDeletedAfterSuccessfulSplit()
                                                         throws java.io.IOException

Throws:

java.io.IOException

testSplitWillFailIfWritingToRegionFails

public void testSplitWillFailIfWritingToRegionFails()
                                             throws java.lang.Exception

Throws:

java.lang.Exception

testSplitDeletedRegion

public void testSplitDeletedRegion()
                            throws java.io.IOException

Throws:

java.io.IOException

testIOEOnOutputThread

public void testIOEOnOutputThread()
                           throws java.lang.Exception

Throws:

java.lang.Exception

testMovedWALDuringRecovery

public void testMovedWALDuringRecovery()
                                throws java.lang.Exception

Throws:

java.lang.Exception

testRetryOpenDuringRecovery

public void testRetryOpenDuringRecovery()
                                 throws java.lang.Exception

Throws:

java.lang.Exception

testTerminationAskedByReporter

public void testTerminationAskedByReporter()
                                    throws java.io.IOException,
                                           CorruptedLogFileException

Throws:

java.io.IOException

CorruptedLogFileException

testThreading

public void testThreading()
                   throws java.lang.Exception

Test log split process with fake data and lots of edits to trigger threading issues.

Throws:

java.lang.Exception

testThreadingSlowWriterSmallBuffer

public void testThreadingSlowWriterSmallBuffer()
                                        throws java.lang.Exception

Test blocking behavior of the log split process if writers are writing slower than the reader is reading.

Throws:

java.lang.Exception

testSplitLogFileDeletedRegionDir

public void testSplitLogFileDeletedRegionDir()
                                      throws java.io.IOException

Throws:

java.io.IOException

testSplitLogFileEmpty

public void testSplitLogFileEmpty()
                           throws java.io.IOException

Throws:

java.io.IOException

testSplitLogFileMultipleRegions

public void testSplitLogFileMultipleRegions()
                                     throws java.io.IOException

Throws:

java.io.IOException

testSplitLogFileFirstLineCorruptionLog

public void testSplitLogFileFirstLineCorruptionLog()
                                            throws java.io.IOException

Throws:

java.io.IOException

testConcurrentSplitLogAndReplayRecoverEdit

public void testConcurrentSplitLogAndReplayRecoverEdit()
                                                throws java.io.IOException

Throws:

java.io.IOException

See Also:

https://issues.apache.org/jira/browse/HBASE-4862

appendEntry

public static long appendEntry(Writer writer,
                               TableName table,
                               byte[] region,
                               byte[] row,
                               byte[] family,
                               byte[] qualifier,
                               byte[] value,
                               long seq)
                        throws java.io.IOException

Throws:

java.io.IOException