org.apache.hadoop.hbase

Class IntegrationTestDDLMasterFailover

java.lang.Object

org.apache.hadoop.hbase.util.AbstractHBaseTool

org.apache.hadoop.hbase.IntegrationTestBase

org.apache.hadoop.hbase.IntegrationTestDDLMasterFailover

public class IntegrationTestDDLMasterFailover
extends IntegrationTestBase

Integration test that verifies Procedure V2.

DDL operations should go through (rollforward or rollback) when primary master is killed by ChaosMonkey (default MASTER_KILLING)

Multiple Worker threads are started to randomly do the following Actions in loops:
Actions generating and populating tables:

• CreateTableAction
• DisableTableAction
• EnableTableAction
• DeleteTableAction
• AddRowAction

Actions performing DDL operations:

• AddColumnFamilyAction
• AlterColumnFamilyVersionsAction
• AlterColumnFamilyEncodingAction
• DeleteColumnFamilyAction

The threads run for a period of time (default 20 minutes) then are stopped at the end of runtime. Verification is performed towards those checkpoints:

1. No Actions throw Exceptions.
2. No inconsistencies are detected in hbck.

This test should be run by the hbase user since it invokes hbck at the end

Usage: hbase org.apache.hadoop.hbase.IntegrationTestDDLMasterFailover -Dhbase.IntegrationTestDDLMasterFailover.runtime=1200000 -Dhbase.IntegrationTestDDLMasterFailover.numThreads=20 -Dhbase.IntegrationTestDDLMasterFailover.numRegions=50 --monkey masterKilling

Field Summary

Fields

Modifier and Type	Field and Description
protected HBaseCluster	cluster
protected Connection	connection
protected java.util.concurrent.atomic.AtomicBoolean	create_table
protected static int	DEFAULT_NUM_REGIONS
protected static int	DEFAULT_NUM_THREADS
protected static long	DEFAULT_RUN_TIME
protected static java.lang.String	NUM_REGIONS_KEY
protected static java.lang.String	NUM_THREADS_KEY
protected int	numRegions
protected int	numThreads
protected static java.lang.String	RUN_TIME_KEY A soft limit on how long we should run
protected java.util.concurrent.atomic.AtomicBoolean	running

Fields inherited from class org.apache.hadoop.hbase.IntegrationTestBase

CHAOS_MONKEY_PROPS, monkey, MONKEY_LONG_OPT, monkeyProps, monkeyToUse, NO_CLUSTER_CLEANUP_LONG_OPT, noClusterCleanUp, util

Fields inherited from class org.apache.hadoop.hbase.util.AbstractHBaseTool

cmdLineArgs, conf, EXIT_FAILURE, EXIT_SUCCESS

Constructor Summary

Constructors

Constructor and Description
IntegrationTestDDLMasterFailover()

Method Summary

Modifier and Type	Method and Description
void	cleanUpCluster()
protected java.util.Set<java.lang.String>	getColumnFamilies()
protected Connection	getConnection()
protected int	getMinServerCount()
TableName	getTablename()
static void	main(java.lang.String[] args)
int	runTestFromCommandLine()
protected void	setConnection(Connection connection)
void	setUpCluster()
void	testAsUnitTest()
protected void	verifyTables()

Methods inherited from class org.apache.hadoop.hbase.IntegrationTestBase

addOptions, cleanUp, cleanUpMonkey, cleanUpMonkey, doWork, getConf, getDefaultMonkeyFactory, getTestingUtil, processBaseOptions, processOptions, setUp, setUpMonkey, startMonkey

Methods inherited from class org.apache.hadoop.hbase.util.AbstractHBaseTool

addOptNoArg, addOptNoArg, addOptWithArg, addOptWithArg, addRequiredOptWithArg, addRequiredOptWithArg, doStaticMain, parseArgs, parseInt, parseLong, printUsage, printUsage, run, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEFAULT_RUN_TIME

protected static final long DEFAULT_RUN_TIME

See Also:

Constant Field Values

DEFAULT_NUM_THREADS

protected static final int DEFAULT_NUM_THREADS

See Also:

Constant Field Values

DEFAULT_NUM_REGIONS

protected static final int DEFAULT_NUM_REGIONS

See Also:

Constant Field Values

cluster

protected HBaseCluster cluster

connection

protected Connection connection

RUN_TIME_KEY

protected static final java.lang.String RUN_TIME_KEY

A soft limit on how long we should run

See Also:

Constant Field Values

NUM_THREADS_KEY

protected static final java.lang.String NUM_THREADS_KEY

See Also:

Constant Field Values

NUM_REGIONS_KEY

protected static final java.lang.String NUM_REGIONS_KEY

See Also:

Constant Field Values

running

protected java.util.concurrent.atomic.AtomicBoolean running

create_table

protected java.util.concurrent.atomic.AtomicBoolean create_table

numThreads

protected int numThreads

numRegions

protected int numRegions

Constructor Detail

IntegrationTestDDLMasterFailover

public IntegrationTestDDLMasterFailover()

Method Detail

setUpCluster

public void setUpCluster()
                  throws java.lang.Exception

Specified by:

setUpCluster in class IntegrationTestBase

Throws:

java.lang.Exception

cleanUpCluster

public void cleanUpCluster()
                    throws java.lang.Exception

Overrides:

cleanUpCluster in class IntegrationTestBase

Throws:

java.lang.Exception

getMinServerCount

protected int getMinServerCount()

setConnection

protected void setConnection(Connection connection)

getConnection

protected Connection getConnection()

verifyTables

protected void verifyTables()
                     throws java.io.IOException

Throws:

java.io.IOException

testAsUnitTest

public void testAsUnitTest()
                    throws java.lang.Exception

Throws:

java.lang.Exception

runTestFromCommandLine

public int runTestFromCommandLine()
                           throws java.lang.Exception

Specified by:

runTestFromCommandLine in class IntegrationTestBase

Throws:

java.lang.Exception

getTablename

public TableName getTablename()

Specified by:

getTablename in class IntegrationTestBase

getColumnFamilies

protected java.util.Set<java.lang.String> getColumnFamilies()

Specified by:

getColumnFamilies in class IntegrationTestBase

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception