org.apache.hadoop.hbase.regionserver

Class TestHRegionReplayEvents

java.lang.Object

org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents

public class TestHRegionReplayEvents
extends java.lang.Object

Tests of HRegion methods for replaying flush, compaction, region open, etc events for secondary region replicas

Field Summary

Fields

Modifier and Type	Field and Description
static Configuration	CONF
protected byte[]	cq
protected java.lang.String	method
TestName	name
protected byte[]	row
protected byte[]	row2
protected byte[]	tableName

Constructor Summary

Constructors

Constructor and Description
TestHRegionReplayEvents()

Method Summary

Modifier and Type	Method and Description
void	setup()
void	tearDown()
void	testOnlyReplayingFlushStartDoesNotHoldUpRegionClose() Tests a case where we replay only a flush start marker, then the region is closed.
void	testRefreshStoreFiles()
void	testRegionReadsEnabledFlag() Tests the reads enabled flag for the region.
void	testRegionReplicaSecondaryCannotFlush()
void	testReplayBulkLoadEvent() Tests replaying region open markers from primary region.
void	testReplayFlushCommitMarkerLargerThanFlushStartMarker() Tests the case where we prepare a flush with some seqId and we receive a flush commit marker larger than the previous flush start marker.
void	testReplayFlushCommitMarkerSmallerThanFlushStartMarker() Tests the case where we prepare a flush with some seqId and we receive a flush commit marker less than the previous flush start marker.
void	testReplayFlushCommitMarkerWithoutFlushStartMarker(boolean droppableMemstore) Tests the case where we receive a flush commit before receiving any flush prepare markers
void	testReplayFlushCommitMarkerWithoutFlushStartMarkerDroppableMemstore() Tests the case where we receive a flush commit before receiving any flush prepare markers.
void	testReplayFlushCommitMarkerWithoutFlushStartMarkerNonDroppableMemstore() Tests the case where we receive a flush commit before receiving any flush prepare markers.
void	testReplayFlushesAndCompactions()
void	testReplayFlushSeqIds()
void	testReplayFlushStartMarkers() Tests cases where we prepare a flush with some seqId and we receive other flush start markers equal to, greater or less than the previous flush start marker.
void	testReplayingBulkLoadEventWithFileAlreadyDeleted()
void	testReplayingCompactionWithFileAlreadyDeleted()
void	testReplayingFlushCommitWithFileAlreadyDeleted()
void	testReplayingFlushRequestRestoresReadsEnabledState() Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region.
void	testReplayingFlushRestoresReadsEnabledState() Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region.
void	testReplayingFlushWithEmptyMemstoreRestoresReadsEnabledState() Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region.
void	testReplayingRegionOpenEventRestoresReadsEnabledState() Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region.
void	testReplayingRegionOpenEventWithFileAlreadyDeleted()
void	testReplayRegionOpenEvent() Tests replaying region open markers from primary region.
void	testReplayRegionOpenEventAfterFlushStart() Tests the case where we replay a region open event after a flush start but before receiving flush commit
void	testSecondaryRegionDoesNotWriteRegionEventsToWAL() Tests that a region opened in secondary mode would not write region open / close events to its WAL.
void	testSeqIdsFromReplay()
void	testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent() Tests whether edits coming in for replay are skipped which have smaller seq id than the seqId of the last replayed region open event.
void	testWriteFlushRequestMarker() Tests the case where a request for flush cache is sent to the region, but region cannot flush.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

name

public TestName name

CONF

public static Configuration CONF

tableName

protected byte[] tableName

method

protected java.lang.String method

row

protected final byte[] row

row2

protected final byte[] row2

cq

protected byte[] cq

Constructor Detail

TestHRegionReplayEvents

public TestHRegionReplayEvents()

Method Detail

setup

public void setup()
           throws java.io.IOException

Throws:

java.io.IOException

tearDown

public void tearDown()
              throws java.lang.Exception

Throws:

java.lang.Exception

testRegionReplicaSecondaryCannotFlush

public void testRegionReplicaSecondaryCannotFlush()
                                           throws java.io.IOException

Throws:

java.io.IOException

testOnlyReplayingFlushStartDoesNotHoldUpRegionClose

public void testOnlyReplayingFlushStartDoesNotHoldUpRegionClose()
                                                         throws java.io.IOException

Tests a case where we replay only a flush start marker, then the region is closed. This region should not block indefinitely

Throws:

java.io.IOException

testReplayFlushesAndCompactions

public void testReplayFlushesAndCompactions()
                                     throws java.io.IOException

Throws:

java.io.IOException

testReplayFlushStartMarkers

public void testReplayFlushStartMarkers()
                                 throws java.io.IOException

Tests cases where we prepare a flush with some seqId and we receive other flush start markers equal to, greater or less than the previous flush start marker.

Throws:

java.io.IOException

testReplayFlushCommitMarkerSmallerThanFlushStartMarker

public void testReplayFlushCommitMarkerSmallerThanFlushStartMarker()
                                                            throws java.io.IOException

Tests the case where we prepare a flush with some seqId and we receive a flush commit marker less than the previous flush start marker.

Throws:

java.io.IOException

testReplayFlushCommitMarkerLargerThanFlushStartMarker

public void testReplayFlushCommitMarkerLargerThanFlushStartMarker()
                                                           throws java.io.IOException

Tests the case where we prepare a flush with some seqId and we receive a flush commit marker larger than the previous flush start marker.

Throws:

java.io.IOException

testReplayFlushCommitMarkerWithoutFlushStartMarkerDroppableMemstore

public void testReplayFlushCommitMarkerWithoutFlushStartMarkerDroppableMemstore()
                                                                         throws java.io.IOException

Tests the case where we receive a flush commit before receiving any flush prepare markers. The memstore edits should be dropped after the flush commit replay since they should be in flushed files

Throws:

java.io.IOException

testReplayFlushCommitMarkerWithoutFlushStartMarkerNonDroppableMemstore

public void testReplayFlushCommitMarkerWithoutFlushStartMarkerNonDroppableMemstore()
                                                                            throws java.io.IOException

Tests the case where we receive a flush commit before receiving any flush prepare markers. The memstore edits should be not dropped after the flush commit replay since not every edit will be in flushed files (based on seqId)

Throws:

java.io.IOException

testReplayFlushCommitMarkerWithoutFlushStartMarker

public void testReplayFlushCommitMarkerWithoutFlushStartMarker(boolean droppableMemstore)
                                                        throws java.io.IOException

Tests the case where we receive a flush commit before receiving any flush prepare markers

Throws:

java.io.IOException

testReplayRegionOpenEvent

public void testReplayRegionOpenEvent()
                               throws java.io.IOException

Tests replaying region open markers from primary region. Checks whether the files are picked up

Throws:

java.io.IOException

testReplayRegionOpenEventAfterFlushStart

public void testReplayRegionOpenEventAfterFlushStart()
                                              throws java.io.IOException

Tests the case where we replay a region open event after a flush start but before receiving flush commit

Throws:

java.io.IOException

testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent

public void testSkippingEditsWithSmallerSeqIdAfterRegionOpenEvent()
                                                           throws java.io.IOException

Tests whether edits coming in for replay are skipped which have smaller seq id than the seqId of the last replayed region open event.

Throws:

java.io.IOException

testReplayFlushSeqIds

public void testReplayFlushSeqIds()
                           throws java.io.IOException

Throws:

java.io.IOException

testSeqIdsFromReplay

public void testSeqIdsFromReplay()
                          throws java.io.IOException

Throws:

java.io.IOException

testSecondaryRegionDoesNotWriteRegionEventsToWAL

public void testSecondaryRegionDoesNotWriteRegionEventsToWAL()
                                                      throws java.io.IOException

Tests that a region opened in secondary mode would not write region open / close events to its WAL.

Throws:

java.io.IOException

testRegionReadsEnabledFlag

public void testRegionReadsEnabledFlag()
                                throws java.io.IOException

Tests the reads enabled flag for the region. When unset all reads should be rejected

Throws:

java.io.IOException

testWriteFlushRequestMarker

public void testWriteFlushRequestMarker()
                                 throws java.io.IOException

Tests the case where a request for flush cache is sent to the region, but region cannot flush. It should write the flush request marker instead.

Throws:

java.io.IOException

testReplayingFlushRequestRestoresReadsEnabledState

public void testReplayingFlushRequestRestoresReadsEnabledState()
                                                        throws java.io.IOException

Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region. Replaying CANNOT_FLUSH flush marker entry should restore the reads enabled status in the region and allow the reads to continue.

Throws:

java.io.IOException

testReplayingFlushRestoresReadsEnabledState

public void testReplayingFlushRestoresReadsEnabledState()
                                                 throws java.io.IOException

Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region. Replaying flush start and commit entries should restore the reads enabled status in the region and allow the reads to continue.

Throws:

java.io.IOException

testReplayingFlushWithEmptyMemstoreRestoresReadsEnabledState

public void testReplayingFlushWithEmptyMemstoreRestoresReadsEnabledState()
                                                                  throws java.io.IOException

Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region. Replaying flush start and commit entries should restore the reads enabled status in the region and allow the reads to continue.

Throws:

java.io.IOException

testReplayingRegionOpenEventRestoresReadsEnabledState

public void testReplayingRegionOpenEventRestoresReadsEnabledState()
                                                           throws java.io.IOException

Test the case where the secondary region replica is not in reads enabled state because it is waiting for a flush or region open marker from primary region. Replaying region open event entry from primary should restore the reads enabled status in the region and allow the reads to continue.

Throws:

java.io.IOException

testRefreshStoreFiles

public void testRefreshStoreFiles()
                           throws java.io.IOException

Throws:

java.io.IOException

testReplayBulkLoadEvent

public void testReplayBulkLoadEvent()
                             throws java.io.IOException

Tests replaying region open markers from primary region. Checks whether the files are picked up

Throws:

java.io.IOException

testReplayingFlushCommitWithFileAlreadyDeleted

public void testReplayingFlushCommitWithFileAlreadyDeleted()
                                                    throws java.io.IOException

Throws:

java.io.IOException

testReplayingCompactionWithFileAlreadyDeleted

public void testReplayingCompactionWithFileAlreadyDeleted()
                                                   throws java.io.IOException

Throws:

java.io.IOException

testReplayingRegionOpenEventWithFileAlreadyDeleted

public void testReplayingRegionOpenEventWithFileAlreadyDeleted()
                                                        throws java.io.IOException

Throws:

java.io.IOException

testReplayingBulkLoadEventWithFileAlreadyDeleted

public void testReplayingBulkLoadEventWithFileAlreadyDeleted()
                                                      throws java.io.IOException

Throws:

java.io.IOException