org.apache.hadoop.hbase.backup.util

Class BackupServerUtil

java.lang.Object

org.apache.hadoop.hbase.backup.util.BackupServerUtil

@InterfaceAudience.Private
 @InterfaceStability.Evolving
public final class BackupServerUtil
extends Object

A collection for methods used by multiple classes to backup HBase tables.

Field Summary

Fields

Modifier and Type	Field and Description
protected static Log	LOG
static String	LOGNAME_SEPARATOR

Method Summary

Modifier and Type	Method and Description
static void	cleanupBackupData(BackupInfo context, Configuration conf)
static void	copyTableRegionInfo(BackupInfo backupContext, Configuration conf) copy out Table RegionInfo into incremental backup image need to consider move this logic into HBackupFileSystem
static long	getFilesLength(FileSystem fs, Path dir) Get the total length of files under the given directory recursively.
static List<String>	getListOfWALFiles(Configuration c) Get list of all WAL files (WALs and archive)
static List<String>	getListOfWALFiles(Configuration c, PathFilter filter) Get list of all WAL files (WALs and archive)
static HashMap<String,Long>	getRSLogTimestampMins(HashMap<TableName,HashMap<String,Long>> rsLogTimestampMap) Loop through the RS log timestamp map for the tables, for each RS, find the min timestamp value for the RS among the tables.
static String	getUniqueWALFileNamePart(Path p) Returns WAL file name
static String	getUniqueWALFileNamePart(String walFileName) Returns WAL file name
static List<String>	getWALFilesOlderThan(Configuration c, HashMap<String,Long> hostTimestampMap) Get list of all old WAL files (WALs and archive)
static String	join(TableName[] names)
static String	parseHostNameFromLogFile(Path p) TODO: return hostname:port
static TableName[]	parseTableNames(String tables)
static ArrayList<BackupInfo>	sortHistoryListDesc(ArrayList<BackupInfo> historyList) Sort history list by start time in descending order.
static void	waitForSnapshot(HBaseProtos.SnapshotDescription snapshot, long max, SnapshotManager snapshotMgr, Configuration conf)
static void	writeRegioninfoOnFilesystem(Configuration conf, FileSystem fs, Path regionInfoDir, HRegionInfo regionInfo) Write the .regioninfo file on-disk.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static final Log LOG

LOGNAME_SEPARATOR

public static final String LOGNAME_SEPARATOR

See Also:

Constant Field Values

Method Detail

waitForSnapshot

public static void waitForSnapshot(HBaseProtos.SnapshotDescription snapshot,
                                   long max,
                                   SnapshotManager snapshotMgr,
                                   Configuration conf)
                            throws IOException

Throws:

IOException

getRSLogTimestampMins

public static HashMap<String,Long> getRSLogTimestampMins(HashMap<TableName,HashMap<String,Long>> rsLogTimestampMap)

Loop through the RS log timestamp map for the tables, for each RS, find the min timestamp value for the RS among the tables.

Parameters:

rsLogTimestampMap - timestamp map

Returns:

the min timestamp of each RS

copyTableRegionInfo

public static void copyTableRegionInfo(BackupInfo backupContext,
                                       Configuration conf)
                                throws IOException,
                                       InterruptedException

copy out Table RegionInfo into incremental backup image need to consider move this logic into HBackupFileSystem

Parameters:

backupContext - backup context

conf - configuration

Throws:

IOException - exception

InterruptedException - exception

writeRegioninfoOnFilesystem

public static void writeRegioninfoOnFilesystem(Configuration conf,
                                               FileSystem fs,
                                               Path regionInfoDir,
                                               HRegionInfo regionInfo)
                                        throws IOException

Write the .regioninfo file on-disk.

Throws:

IOException

parseHostNameFromLogFile

public static String parseHostNameFromLogFile(Path p)
                                       throws IOException

TODO: return hostname:port

Parameters:

p -

Returns:

host name: port

Throws:

IOException

getUniqueWALFileNamePart

public static String getUniqueWALFileNamePart(String walFileName)
                                       throws IOException

Returns WAL file name

Parameters:

walFileName - WAL file name

Returns:

WAL file name

Throws:

IOException - exception

IllegalArgumentException - exception

getUniqueWALFileNamePart

public static String getUniqueWALFileNamePart(Path p)
                                       throws IOException

Returns WAL file name

Parameters:

p - - WAL file path

Returns:

WAL file name

Throws:

IOException - exception

getFilesLength

public static long getFilesLength(FileSystem fs,
                                  Path dir)
                           throws IOException

Get the total length of files under the given directory recursively.

Parameters:

fs - The hadoop file system

dir - The target directory

Returns:

the total length of files

Throws:

IOException - exception

sortHistoryListDesc

public static ArrayList<BackupInfo> sortHistoryListDesc(ArrayList<BackupInfo> historyList)

Sort history list by start time in descending order.

Parameters:

historyList - history list

Returns:

sorted list of BackupCompleteData

getListOfWALFiles

public static List<String> getListOfWALFiles(Configuration c)
                                      throws IOException

Get list of all WAL files (WALs and archive)

Parameters:

c - - configuration

Returns:

list of WAL files

Throws:

IOException - exception

getListOfWALFiles

public static List<String> getListOfWALFiles(Configuration c,
                                             PathFilter filter)
                                      throws IOException

Get list of all WAL files (WALs and archive)

Parameters:

c - - configuration

Returns:

list of WAL files

Throws:

IOException - exception

getWALFilesOlderThan

public static List<String> getWALFilesOlderThan(Configuration c,
                                                HashMap<String,Long> hostTimestampMap)
                                         throws IOException

Get list of all old WAL files (WALs and archive)

Parameters:

c - - configuration

hostTimestampMap - - host timestamp map

Returns:

list of WAL files

Throws:

IOException - exception

join

public static String join(TableName[] names)

parseTableNames

public static TableName[] parseTableNames(String tables)

cleanupBackupData

public static void cleanupBackupData(BackupInfo context,
                                     Configuration conf)
                              throws IOException

Throws:

IOException