org.apache.hadoop.hbase.replication

Interface ReplicationQueues

All Known Implementing Classes:

ReplicationQueuesZKImpl

@InterfaceAudience.Private
public interface ReplicationQueues

This provides an interface for maintaining a region server's replication queues. These queues keep track of the WALs and HFile references (if hbase.replication.bulkload.enabled is enabled) that still need to be replicated to remote clusters.

Method Summary

Modifier and Type	Method and Description
void	addHFileRefs(java.lang.String peerId, java.util.List<Pair<Path,Path>> pairs) Add new hfile references to the queue.
void	addLog(java.lang.String queueId, java.lang.String filename) Add a new WAL file to the given queue.
void	addPeerToHFileRefs(java.lang.String peerId) Add a peer to hfile reference queue if peer does not exist.
java.util.SortedMap<java.lang.String,java.util.SortedSet<java.lang.String>>	claimQueues(java.lang.String regionserver) Take ownership for the set of queues belonging to a dead region server.
java.util.List<java.lang.String>	getAllQueues() Get a list of all queues for this region server.
java.util.List<java.lang.String>	getListOfReplicators() Get a list of all region servers that have outstanding replication queues.
long	getLogPosition(java.lang.String queueId, java.lang.String filename) Get the current position for a specific WAL in a given queue.
java.util.List<java.lang.String>	getLogsInQueue(java.lang.String queueId) Get a list of all WALs in the given queue.
void	init(java.lang.String serverName) Initialize the region server replication queue interface.
boolean	isThisOurZnode(java.lang.String znode) Checks if the provided znode is the same as this region server's
void	removeAllQueues() Remove all replication queues for this region server.
void	removeHFileRefs(java.lang.String peerId, java.util.List<java.lang.String> files) Remove hfile references from the queue.
void	removeLog(java.lang.String queueId, java.lang.String filename) Remove an WAL file from the given queue.
void	removeQueue(java.lang.String queueId) Remove a replication queue.
void	setLogPosition(java.lang.String queueId, java.lang.String filename, long position) Set the current position for a specific WAL in a given queue.

Method Detail

init

void init(java.lang.String serverName)
   throws ReplicationException

Initialize the region server replication queue interface.

Parameters:

serverName - The server name of the region server that owns the replication queues this interface manages.

Throws:

ReplicationException

removeQueue

void removeQueue(java.lang.String queueId)

Remove a replication queue.

Parameters:

queueId - a String that identifies the queue.

addLog

void addLog(java.lang.String queueId,
            java.lang.String filename)
     throws ReplicationException

Add a new WAL file to the given queue. If the queue does not exist it is created.

Parameters:

queueId - a String that identifies the queue.

filename - name of the WAL

Throws:

ReplicationException

removeLog

void removeLog(java.lang.String queueId,
               java.lang.String filename)

Remove an WAL file from the given queue.

Parameters:

queueId - a String that identifies the queue.

filename - name of the WAL

setLogPosition

void setLogPosition(java.lang.String queueId,
                    java.lang.String filename,
                    long position)

Set the current position for a specific WAL in a given queue.

Parameters:

queueId - a String that identifies the queue

filename - name of the WAL

position - the current position in the file

getLogPosition

long getLogPosition(java.lang.String queueId,
                    java.lang.String filename)
             throws ReplicationException

Get the current position for a specific WAL in a given queue.

Parameters:

queueId - a String that identifies the queue

filename - name of the WAL

Returns:

the current position in the file

Throws:

ReplicationException

removeAllQueues

void removeAllQueues()

Remove all replication queues for this region server.

getLogsInQueue

java.util.List<java.lang.String> getLogsInQueue(java.lang.String queueId)

Get a list of all WALs in the given queue.

Parameters:

queueId - a String that identifies the queue

Returns:

a list of WALs, null if this region server is dead and has no outstanding queues

getAllQueues

java.util.List<java.lang.String> getAllQueues()

Get a list of all queues for this region server.

Returns:

a list of queueIds, null if this region server is dead and has no outstanding queues

claimQueues

java.util.SortedMap<java.lang.String,java.util.SortedSet<java.lang.String>> claimQueues(java.lang.String regionserver)

Take ownership for the set of queues belonging to a dead region server.

Parameters:

regionserver - the id of the dead region server

Returns:

A SortedMap of the queues that have been claimed, including a SortedSet of WALs in each queue. Returns an empty map if no queues were failed-over.

getListOfReplicators

java.util.List<java.lang.String> getListOfReplicators()

Get a list of all region servers that have outstanding replication queues. These servers could be alive, dead or from a previous run of the cluster.

Returns:

a list of server names

isThisOurZnode

boolean isThisOurZnode(java.lang.String znode)

Checks if the provided znode is the same as this region server's

Parameters:

znode - to check

Returns:

if this is this rs's znode

addPeerToHFileRefs

void addPeerToHFileRefs(java.lang.String peerId)
                 throws ReplicationException

Add a peer to hfile reference queue if peer does not exist.

Parameters:

peerId - peer cluster id to be added

Throws:

ReplicationException - if fails to add a peer id to hfile reference queue

addHFileRefs

void addHFileRefs(java.lang.String peerId,
                  java.util.List<Pair<Path,Path>> pairs)
           throws ReplicationException

Add new hfile references to the queue.

Parameters:

peerId - peer cluster id to which the hfiles need to be replicated

pairs - list of pairs of { HFile location in staging dir, HFile path in region dir which will be added in the queue }

Throws:

ReplicationException - if fails to add a hfile reference

removeHFileRefs

void removeHFileRefs(java.lang.String peerId,
                     java.util.List<java.lang.String> files)

Remove hfile references from the queue.

Parameters:

peerId - peer cluster id from which this hfile references needs to be removed

files - list of hfile references to be removed