org.apache.hadoop.hbase.mapreduce

Class TestImportTsv

java.lang.Object

org.apache.hadoop.hbase.mapreduce.TestImportTsv

public class TestImportTsv
extends Object

Field Summary

Fields

Modifier and Type	Field and Description
protected static String	DELETE_AFTER_LOAD_CONF Delete the tmp directory after running doMROnTableTest.
protected static String	FORCE_COMBINER_CONF Force use of combiner in doMROnTableTest.
protected static Log	LOG
protected static String	NAME
protected static HBaseTestingUtility	util

Constructor Summary

Constructors

Constructor and Description
TestImportTsv()

Method Summary

Modifier and Type	Method and Description
protected static Tool	doMROnTableTest(HBaseTestingUtility util, String family, String data, String[] args)
protected static Tool	doMROnTableTest(HBaseTestingUtility util, String family, String data, String[] args, int valueMultiplier)
protected static Tool	doMROnTableTest(HBaseTestingUtility util, String family, String data, String[] args, int valueMultiplier, int expectedKVCount) Run an ImportTsv job and perform basic validation on the results.
Configuration	getConf()
static void	provisionCluster()
static void	releaseCluster()
void	setConf(Configuration conf)
void	testBulkOutputWithAnExistingTable()
void	testBulkOutputWithAnExistingTableNoStrictTrue()
void	testBulkOutputWithoutAnExistingTable()
void	testBulkOutputWithTsvImporterTextMapper()
void	testJobConfigurationsWithTsvImporterTextMapper()
void	testMROnTable()
void	testMROnTableWithCustomMapper()
void	testMROnTableWithTimestamp()
void	testMRWithoutAnExistingTable()
void	testTsvImporterTextMapperWithInvalidData() If there are invalid data rows as inputs, then only those rows should be ignored.
void	testWithoutAnExistingTableAndCreateTableSetToNo()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final Log LOG

NAME

protected static final String NAME

util

protected static HBaseTestingUtility util

DELETE_AFTER_LOAD_CONF

protected static final String DELETE_AFTER_LOAD_CONF

Delete the tmp directory after running doMROnTableTest. Boolean. Default is false.

FORCE_COMBINER_CONF

protected static final String FORCE_COMBINER_CONF

Force use of combiner in doMROnTableTest. Boolean. Default is true.

Constructor Detail

TestImportTsv

public TestImportTsv()

Method Detail

getConf

public Configuration getConf()

setConf

public void setConf(Configuration conf)

provisionCluster

public static void provisionCluster()
                             throws Exception

Throws:

Exception

releaseCluster

public static void releaseCluster()
                           throws Exception

Throws:

Exception

testMROnTable

public void testMROnTable()
                   throws Exception

Throws:

Exception

testMROnTableWithTimestamp

public void testMROnTableWithTimestamp()
                                throws Exception

Throws:

Exception

testMROnTableWithCustomMapper

public void testMROnTableWithCustomMapper()
                                   throws Exception

Throws:

Exception

testBulkOutputWithoutAnExistingTable

public void testBulkOutputWithoutAnExistingTable()
                                          throws Exception

Throws:

Exception

testBulkOutputWithAnExistingTable

public void testBulkOutputWithAnExistingTable()
                                       throws Exception

Throws:

Exception

testBulkOutputWithAnExistingTableNoStrictTrue

public void testBulkOutputWithAnExistingTableNoStrictTrue()
                                                   throws Exception

Throws:

Exception

testJobConfigurationsWithTsvImporterTextMapper

public void testJobConfigurationsWithTsvImporterTextMapper()
                                                    throws Exception

Throws:

Exception

testBulkOutputWithTsvImporterTextMapper

public void testBulkOutputWithTsvImporterTextMapper()
                                             throws Exception

Throws:

Exception

testWithoutAnExistingTableAndCreateTableSetToNo

public void testWithoutAnExistingTableAndCreateTableSetToNo()
                                                     throws Exception

Throws:

Exception

testMRWithoutAnExistingTable

public void testMRWithoutAnExistingTable()
                                  throws Exception

Throws:

Exception

testTsvImporterTextMapperWithInvalidData

public void testTsvImporterTextMapperWithInvalidData()
                                              throws Exception

If there are invalid data rows as inputs, then only those rows should be ignored.

Throws:

Exception

doMROnTableTest

protected static Tool doMROnTableTest(HBaseTestingUtility util,
                                      String family,
                                      String data,
                                      String[] args)
                               throws Exception

Throws:

Exception

doMROnTableTest

protected static Tool doMROnTableTest(HBaseTestingUtility util,
                                      String family,
                                      String data,
                                      String[] args,
                                      int valueMultiplier)
                               throws Exception

Throws:

Exception

doMROnTableTest

protected static Tool doMROnTableTest(HBaseTestingUtility util,
                                      String family,
                                      String data,
                                      String[] args,
                                      int valueMultiplier,
                                      int expectedKVCount)
                               throws Exception

Run an ImportTsv job and perform basic validation on the results. Returns the ImportTsv Tool instance so that other tests can inspect it for further validation as necessary. This method is static to insure non-reliance on instance's util/conf facilities.

Parameters:

args - Any arguments to pass BEFORE inputFile path is appended.

Returns:

The Tool instance used to run the test.

Throws:

Exception