org.apache.hadoop.hbase.mapreduce

Class TestLoadIncrementalHFilesSplitRecovery

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestLoadIncrementalHFilesSplitRecovery

Direct Known Subclasses:

TestSecureLoadIncrementalHFilesSplitRecovery

public class TestLoadIncrementalHFilesSplitRecovery
extends Object

Test cases for the atomic load error handling of the bulk load functionality.

Constructor Summary

Constructors

Constructor and Description
TestLoadIncrementalHFilesSplitRecovery()

Method Summary

Modifier and Type	Method and Description
static void	buildHFiles(FileSystem fs, Path dir, int value)
static void	setupCluster()
static void	teardownCluster()
void	testBulkLoadPhaseFailure() Test that shows that exception thrown from the RS side will result in an exception on the LIHFile client.
void	testGroupOrSplitFailure() This simulates an remote exception which should cause LIHF to exit with an exception.
void	testGroupOrSplitPresplit() This test splits a table and attempts to bulk load.
void	testGroupOrSplitWhenRegionHoleExistsInMeta()
void	testSplitTmpFileCleanUp() This test creates a table with many small regions.
void	testSplitWhileBulkLoadPhase() This test exercises the path where there is a split after initial validation but before the atomic bulk load call.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TestLoadIncrementalHFilesSplitRecovery

public TestLoadIncrementalHFilesSplitRecovery()

Method Detail

buildHFiles

public static void buildHFiles(FileSystem fs,
                               Path dir,
                               int value)
                        throws IOException

Throws:

IOException

setupCluster

public static void setupCluster()
                         throws Exception

Throws:

Exception

teardownCluster

public static void teardownCluster()
                            throws Exception

Throws:

Exception

testBulkLoadPhaseFailure

public void testBulkLoadPhaseFailure()
                              throws Exception

Test that shows that exception thrown from the RS side will result in an exception on the LIHFile client.

Throws:

Exception

testSplitWhileBulkLoadPhase

public void testSplitWhileBulkLoadPhase()
                                 throws Exception

This test exercises the path where there is a split after initial validation but before the atomic bulk load call. We cannot use presplitting to test this path, so we actually inject a split just before the atomic region load.

Throws:

Exception

testGroupOrSplitPresplit

public void testGroupOrSplitPresplit()
                              throws Exception

This test splits a table and attempts to bulk load. The bulk import files should be split before atomically importing.

Throws:

Exception

testSplitTmpFileCleanUp

public void testSplitTmpFileCleanUp()
                             throws Exception

This test creates a table with many small regions. The bulk load files would be splitted multiple times before all of them can be loaded successfully.

Throws:

Exception

testGroupOrSplitFailure

public void testGroupOrSplitFailure()
                             throws Exception

This simulates an remote exception which should cause LIHF to exit with an exception.

Throws:

Exception

testGroupOrSplitWhenRegionHoleExistsInMeta

public void testGroupOrSplitWhenRegionHoleExistsInMeta()
                                                throws Exception

Throws:

Exception