Package | Description |
---|---|
org.apache.hadoop.yarn.server.federation.cache |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.
|
org.apache.hadoop.yarn.server.federation.failover |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.
|
org.apache.hadoop.yarn.server.federation.policies |
Federation Policies.
|
org.apache.hadoop.yarn.server.federation.policies.amrmproxy |
AMRMPRoxy policies.
|
org.apache.hadoop.yarn.server.federation.policies.router |
Router policies.
|
org.apache.hadoop.yarn.server.federation.resolver |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.
|
org.apache.hadoop.yarn.server.federation.store.impl |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.
|
org.apache.hadoop.yarn.server.federation.store.records |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.
|
org.apache.hadoop.yarn.server.federation.store.records.impl.pb |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.
|
org.apache.hadoop.yarn.server.federation.store.utils |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.
|
org.apache.hadoop.yarn.server.federation.utils |
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.
|
Modifier and Type | Method and Description |
---|---|
SubClusterId |
FederationGuavaCache.getApplicationHomeSubCluster(org.apache.hadoop.yarn.api.records.ApplicationId appId) |
SubClusterId |
FederationJCache.getApplicationHomeSubCluster(org.apache.hadoop.yarn.api.records.ApplicationId appId) |
abstract SubClusterId |
FederationCache.getApplicationHomeSubCluster(org.apache.hadoop.yarn.api.records.ApplicationId appId)
Returns the home
SubClusterId for the specified
ApplicationId . |
SubClusterId |
FederationCache.ApplicationHomeSubClusterCacheResponse.getItem() |
Modifier and Type | Method and Description |
---|---|
protected FederationCache.CacheRequest<String,FederationCache.CacheResponse<SubClusterId>> |
FederationCache.buildGetApplicationHomeSubClusterRequest(String cacheKey,
org.apache.hadoop.yarn.api.records.ApplicationId applicationId)
Build GetApplicationHomeSubCluster CacheRequest.
|
static Map<SubClusterId,SubClusterInfo> |
FederationCache.buildSubClusterInfoMap(FederationCache.CacheRequest<String,?> cacheRequest)
According to the cacheRequest, build SubClusterInfoMap.
|
static Map<SubClusterId,SubClusterInfo> |
FederationCache.buildSubClusterInfoMap(GetSubClustersInfoResponse response)
According to the response, build SubClusterInfoMap.
|
List<SubClusterId> |
FederationCache.ApplicationHomeSubClusterCacheResponse.getList() |
Map<SubClusterId,SubClusterInfo> |
FederationGuavaCache.getSubClusters(boolean filterInactiveSubClusters) |
Map<SubClusterId,SubClusterInfo> |
FederationJCache.getSubClusters(boolean filterInactiveSubClusters) |
abstract Map<SubClusterId,SubClusterInfo> |
FederationCache.getSubClusters(boolean filterInactiveSubClusters)
Returns the
SubClusterInfo of all active sub cluster(s). |
Modifier and Type | Method and Description |
---|---|
void |
FederationCache.ApplicationHomeSubClusterCacheResponse.setItem(SubClusterId item) |
Modifier and Type | Method and Description |
---|---|
void |
FederationCache.ApplicationHomeSubClusterCacheResponse.setList(List<SubClusterId> list) |
Modifier and Type | Method and Description |
---|---|
static <T> T |
FederationProxyProviderUtil.createRMProxy(org.apache.hadoop.conf.Configuration configuration,
Class<T> protocol,
SubClusterId subClusterId,
org.apache.hadoop.security.UserGroupInformation user)
Create a proxy for the specified protocol in the context of Federation.
|
static <T> T |
FederationProxyProviderUtil.createRMProxy(org.apache.hadoop.conf.Configuration configuration,
Class<T> protocol,
SubClusterId subClusterId,
org.apache.hadoop.security.UserGroupInformation user,
org.apache.hadoop.security.token.Token<? extends org.apache.hadoop.security.token.TokenIdentifier> token)
Create a proxy for the specified protocol in the context of Federation.
|
Modifier and Type | Method and Description |
---|---|
SubClusterId |
FederationPolicyInitializationContext.getHomeSubcluster()
Returns the current home sub-cluster.
|
SubClusterId |
RouterPolicyFacade.getHomeSubcluster(org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext,
List<SubClusterId> blackListSubClusters)
This method provides a wrapper of all policy functionalities for routing .
|
SubClusterId |
RouterPolicyFacade.getReservationHomeSubCluster(org.apache.hadoop.yarn.api.protocolrecords.ReservationSubmissionRequest request)
This method provides a wrapper of all policy functionalities for routing a
reservation.
|
Modifier and Type | Method and Description |
---|---|
protected Map<SubClusterId,SubClusterInfo> |
AbstractConfigurableFederationPolicy.getActiveSubclusters()
This methods gets active subclusters map from the
FederationStateStoreFacade and validate it not being null/empty. |
Modifier and Type | Method and Description |
---|---|
static FederationAMRMProxyPolicy |
FederationPolicyUtils.loadAMRMPolicy(String queue,
FederationAMRMProxyPolicy oldPolicy,
org.apache.hadoop.conf.Configuration conf,
FederationStateStoreFacade federationFacade,
SubClusterId homeSubClusterId)
Get AMRMProxy policy from state store, using default queue and
configuration as fallback.
|
void |
FederationPolicyInitializationContext.setHomeSubcluster(SubClusterId homeSubcluster)
Sets in the context the home sub-cluster.
|
Modifier and Type | Method and Description |
---|---|
SubClusterId |
RouterPolicyFacade.getHomeSubcluster(org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext,
List<SubClusterId> blackListSubClusters)
This method provides a wrapper of all policy functionalities for routing .
|
static void |
FederationPolicyUtils.validateSubClusterAvailability(Collection<SubClusterId> activeSubClusters,
Collection<SubClusterId> blackListSubClusters)
Validate if there is any active subcluster that is not blacklisted, it will
throw an exception if there are no usable subclusters.
|
static void |
FederationPolicyUtils.validateSubClusterAvailability(Collection<SubClusterId> activeSubClusters,
Collection<SubClusterId> blackListSubClusters)
Validate if there is any active subcluster that is not blacklisted, it will
throw an exception if there are no usable subclusters.
|
Constructor and Description |
---|
FederationPolicyInitializationContext(SubClusterPolicyConfiguration policy,
SubClusterResolver resolver,
FederationStateStoreFacade storeFacade,
SubClusterId home) |
RouterPolicyFacade(org.apache.hadoop.conf.Configuration conf,
FederationStateStoreFacade facade,
SubClusterResolver resolver,
SubClusterId homeSubcluster) |
Modifier and Type | Method and Description |
---|---|
protected SubClusterId |
LocalityMulticastAMRMProxyPolicy.getSubClusterForUnResolvedRequest(LocalityMulticastAMRMProxyPolicy.AllocationBookkeeper bookKeeper,
long allocationId)
For unit test to override.
|
protected SubClusterId |
LocalityMulticastAMRMProxyPolicy.routeNodeRequestIfNeeded(SubClusterId targetId,
int maxThreshold,
Set<SubClusterId> activeAndEnabledSCs)
When certain subcluster is too loaded, reroute Node requests going there.
|
Modifier and Type | Method and Description |
---|---|
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
BroadcastAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters) |
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
FederationAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters)
Splits the
ResourceRequest s from the client across one or more
sub-clusters based on the policy semantics (e.g., broadcast, load-based). |
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
HomeAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters) |
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
RejectAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters) |
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
LocalityMulticastAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters) |
Modifier and Type | Method and Description |
---|---|
void |
FederationAMRMProxyPolicy.notifyOfResponse(SubClusterId subClusterId,
org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse response)
This method should be invoked to notify the policy about responses being
received.
|
void |
AbstractAMRMProxyPolicy.notifyOfResponse(SubClusterId subClusterId,
org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse response) |
void |
LocalityMulticastAMRMProxyPolicy.notifyOfResponse(SubClusterId subClusterId,
org.apache.hadoop.yarn.api.protocolrecords.AllocateResponse response) |
protected SubClusterId |
LocalityMulticastAMRMProxyPolicy.routeNodeRequestIfNeeded(SubClusterId targetId,
int maxThreshold,
Set<SubClusterId> activeAndEnabledSCs)
When certain subcluster is too loaded, reroute Node requests going there.
|
Modifier and Type | Method and Description |
---|---|
protected SubClusterId |
LocalityMulticastAMRMProxyPolicy.routeNodeRequestIfNeeded(SubClusterId targetId,
int maxThreshold,
Set<SubClusterId> activeAndEnabledSCs)
When certain subcluster is too loaded, reroute Node requests going there.
|
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
BroadcastAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters) |
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
FederationAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters)
Splits the
ResourceRequest s from the client across one or more
sub-clusters based on the policy semantics (e.g., broadcast, load-based). |
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
HomeAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters) |
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
RejectAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters) |
Map<SubClusterId,List<org.apache.hadoop.yarn.api.records.ResourceRequest>> |
LocalityMulticastAMRMProxyPolicy.splitResourceRequests(List<org.apache.hadoop.yarn.api.records.ResourceRequest> resourceRequests,
Set<SubClusterId> timedOutSubClusters) |
Modifier and Type | Method and Description |
---|---|
protected SubClusterId |
RejectRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected SubClusterId |
LoadBasedRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected SubClusterId |
UniformRandomRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected SubClusterId |
WeightedRandomRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected abstract SubClusterId |
AbstractRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubClusters)
This method is implemented by the specific policy, and it is used to route
both reservations, and applications among a given set of
sub-clusters.
|
protected SubClusterId |
PriorityRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected SubClusterId |
HashBasedRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
SubClusterId |
LocalityRouterPolicy.getHomeSubcluster(org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext,
List<SubClusterId> blackListSubClusters) |
SubClusterId |
AbstractRouterPolicy.getHomeSubcluster(org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appContext,
List<SubClusterId> blackLists)
Simply picks from alphabetically-sorted active subclusters based on the
hash of query name.
|
SubClusterId |
FederationRouterPolicy.getHomeSubcluster(org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext,
List<SubClusterId> blackListSubClusters)
Determines the sub-cluster that the user application submission should be
routed to.
|
SubClusterId |
AbstractRouterPolicy.getReservationHomeSubcluster(org.apache.hadoop.yarn.api.protocolrecords.ReservationSubmissionRequest request)
This method provides a wrapper of all policy functionalities for routing a
reservation.
|
SubClusterId |
FederationRouterPolicy.getReservationHomeSubcluster(org.apache.hadoop.yarn.api.protocolrecords.ReservationSubmissionRequest request)
Determines the sub-cluster where a ReservationSubmissionRequest should be
sent to.
|
Modifier and Type | Method and Description |
---|---|
protected Map<SubClusterId,SubClusterInfo> |
AbstractRouterPolicy.prefilterSubClusters(org.apache.hadoop.yarn.api.records.ReservationId reservationId,
Map<SubClusterId,SubClusterInfo> activeSubClusters)
Filter chosen SubCluster based on reservationId.
|
Modifier and Type | Method and Description |
---|---|
protected SubClusterId |
RejectRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected SubClusterId |
LoadBasedRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected SubClusterId |
UniformRandomRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected SubClusterId |
WeightedRandomRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected abstract SubClusterId |
AbstractRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubClusters)
This method is implemented by the specific policy, and it is used to route
both reservations, and applications among a given set of
sub-clusters.
|
protected SubClusterId |
PriorityRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
protected SubClusterId |
HashBasedRouterPolicy.chooseSubCluster(String queue,
Map<SubClusterId,SubClusterInfo> preSelectSubclusters) |
SubClusterId |
LocalityRouterPolicy.getHomeSubcluster(org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext,
List<SubClusterId> blackListSubClusters) |
SubClusterId |
AbstractRouterPolicy.getHomeSubcluster(org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appContext,
List<SubClusterId> blackLists)
Simply picks from alphabetically-sorted active subclusters based on the
hash of query name.
|
SubClusterId |
FederationRouterPolicy.getHomeSubcluster(org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext,
List<SubClusterId> blackListSubClusters)
Determines the sub-cluster that the user application submission should be
routed to.
|
protected Map<SubClusterId,SubClusterInfo> |
AbstractRouterPolicy.prefilterSubClusters(org.apache.hadoop.yarn.api.records.ReservationId reservationId,
Map<SubClusterId,SubClusterInfo> activeSubClusters)
Filter chosen SubCluster based on reservationId.
|
Modifier and Type | Method and Description |
---|---|
SubClusterId |
AbstractSubClusterResolver.getSubClusterForNode(String nodename) |
SubClusterId |
SubClusterResolver.getSubClusterForNode(String nodename)
Obtain the sub-cluster that a specified node belongs to.
|
SubClusterId |
DefaultSubClusterResolverImpl.getSubClusterForNode(String nodename) |
Modifier and Type | Method and Description |
---|---|
Map<String,SubClusterId> |
AbstractSubClusterResolver.getNodeToSubCluster() |
Map<String,Set<SubClusterId>> |
AbstractSubClusterResolver.getRackToSubClusters() |
Set<SubClusterId> |
AbstractSubClusterResolver.getSubClustersForRack(String rackname) |
Set<SubClusterId> |
SubClusterResolver.getSubClustersForRack(String rackname)
Obtain the sub-clusters that have nodes on a specified rack.
|
Set<SubClusterId> |
DefaultSubClusterResolverImpl.getSubClustersForRack(String rackname) |
Modifier and Type | Method and Description |
---|---|
Map<SubClusterId,SubClusterInfo> |
MemoryFederationStateStore.getMembership() |
Modifier and Type | Method and Description |
---|---|
void |
MemoryFederationStateStore.setExpiredHeartbeat(SubClusterId subClusterId,
long heartBearTime) |
void |
MemoryFederationStateStore.setSubClusterLastHeartbeat(SubClusterId subClusterId,
long lastHeartbeat) |
Modifier and Type | Method and Description |
---|---|
void |
MemoryFederationStateStore.setMembership(Map<SubClusterId,SubClusterInfo> membership) |
Modifier and Type | Method and Description |
---|---|
abstract SubClusterId |
AddApplicationHomeSubClusterResponse.getHomeSubCluster()
Get the home sub-cluster that this application has been assigned to.
|
abstract SubClusterId |
ReservationHomeSubCluster.getHomeSubCluster()
Get the
SubClusterId representing the unique identifier of the home
subcluster in which the reservation is mapped to. |
abstract SubClusterId |
ApplicationHomeSubCluster.getHomeSubCluster()
Get the
SubClusterId representing the unique identifier of the home
subcluster in which the ApplicationMaster of the application is running. |
abstract SubClusterId |
AddReservationHomeSubClusterResponse.getHomeSubCluster()
Get the home sub-cluster that this Reservation has been assigned to.
|
abstract SubClusterId |
SubClusterDeregisterRequest.getSubClusterId()
Get the
SubClusterId representing the unique identifier of the
subcluster. |
abstract SubClusterId |
GetSubClusterInfoRequest.getSubClusterId()
Get the
SubClusterId representing the unique identifier of the
subcluster. |
abstract SubClusterId |
SubClusterHeartbeatRequest.getSubClusterId()
Get the
SubClusterId representing the unique identifier of the
subcluster. |
abstract SubClusterId |
SubClusterInfo.getSubClusterId()
Get the
SubClusterId representing the unique identifier of the
subcluster. |
abstract SubClusterId |
GetApplicationsHomeSubClusterRequest.getSubClusterId()
Get the
SubClusterId representing the unique identifier of the
subcluster. |
static SubClusterId |
SubClusterId.newInstance(Integer subClusterId) |
static SubClusterId |
SubClusterId.newInstance(String subClusterId) |
SubClusterId |
SubClusterIdInfo.toId()
Get the sub-cluster identifier as
SubClusterId . |
Modifier and Type | Method and Description |
---|---|
int |
SubClusterId.compareTo(SubClusterId other) |
static ApplicationHomeSubCluster |
ApplicationHomeSubCluster.newInstance(org.apache.hadoop.yarn.api.records.ApplicationId appId,
long createTime,
SubClusterId homeSubCluster) |
static ApplicationHomeSubCluster |
ApplicationHomeSubCluster.newInstance(org.apache.hadoop.yarn.api.records.ApplicationId appId,
long createTime,
SubClusterId homeSubCluster,
org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext) |
static ApplicationHomeSubCluster |
ApplicationHomeSubCluster.newInstance(org.apache.hadoop.yarn.api.records.ApplicationId appId,
SubClusterId homeSubCluster) |
static GetApplicationHomeSubClusterResponse |
GetApplicationHomeSubClusterResponse.newInstance(org.apache.hadoop.yarn.api.records.ApplicationId appId,
SubClusterId homeSubCluster) |
static ApplicationHomeSubCluster |
ApplicationHomeSubCluster.newInstance(org.apache.hadoop.yarn.api.records.ApplicationId appId,
SubClusterId homeSubCluster,
org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext) |
static GetApplicationHomeSubClusterResponse |
GetApplicationHomeSubClusterResponse.newInstance(org.apache.hadoop.yarn.api.records.ApplicationId appId,
SubClusterId homeSubCluster,
long createTime) |
static GetApplicationHomeSubClusterResponse |
GetApplicationHomeSubClusterResponse.newInstance(org.apache.hadoop.yarn.api.records.ApplicationId appId,
SubClusterId homeSubCluster,
long createTime,
org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext context) |
static ReservationHomeSubCluster |
ReservationHomeSubCluster.newInstance(org.apache.hadoop.yarn.api.records.ReservationId resId,
SubClusterId homeSubCluster) |
static AddApplicationHomeSubClusterResponse |
AddApplicationHomeSubClusterResponse.newInstance(SubClusterId homeSubCluster) |
static GetSubClusterInfoRequest |
GetSubClusterInfoRequest.newInstance(SubClusterId subClusterId) |
static AddReservationHomeSubClusterResponse |
AddReservationHomeSubClusterResponse.newInstance(SubClusterId homeSubCluster) |
static GetApplicationsHomeSubClusterRequest |
GetApplicationsHomeSubClusterRequest.newInstance(SubClusterId subClusterId) |
static SubClusterHeartbeatRequest |
SubClusterHeartbeatRequest.newInstance(SubClusterId subClusterId,
long lastHeartBeat,
SubClusterState state,
String capability) |
static SubClusterInfo |
SubClusterInfo.newInstance(SubClusterId subClusterId,
String amRMServiceAddress,
String clientRMServiceAddress,
String rmAdminServiceAddress,
String rmWebServiceAddress,
long lastHeartBeat,
SubClusterState state,
long lastStartTime,
String capability) |
static SubClusterInfo |
SubClusterInfo.newInstance(SubClusterId subClusterId,
String amRMServiceAddress,
String clientRMServiceAddress,
String rmAdminServiceAddress,
String rmWebServiceAddress,
SubClusterState state,
long lastStartTime,
String capability) |
static SubClusterInfo |
SubClusterInfo.newInstance(SubClusterId subClusterId,
String rmWebServiceAddress,
SubClusterState state,
long lastStartTime,
long lastHeartBeat,
String capability) |
static SubClusterDeregisterRequest |
SubClusterDeregisterRequest.newInstance(SubClusterId subClusterId,
SubClusterState subClusterState) |
static SubClusterHeartbeatRequest |
SubClusterHeartbeatRequest.newInstance(SubClusterId subClusterId,
SubClusterState state,
String capability) |
abstract void |
AddApplicationHomeSubClusterResponse.setHomeSubCluster(SubClusterId homeSubCluster)
Set the home sub-cluster that this application has been assigned to.
|
abstract void |
ReservationHomeSubCluster.setHomeSubCluster(SubClusterId subClusterId)
Set the
SubClusterId representing the unique identifier of the home
subcluster in which the ReservationMaster of the reservation is running. |
abstract void |
ApplicationHomeSubCluster.setHomeSubCluster(SubClusterId homeSubCluster)
Set the
SubClusterId representing the unique identifier of the home
subcluster in which the ApplicationMaster of the application is running. |
abstract void |
AddReservationHomeSubClusterResponse.setHomeSubCluster(SubClusterId homeSubCluster)
Set the home sub-cluster that this Reservation has been assigned to.
|
abstract void |
SubClusterDeregisterRequest.setSubClusterId(SubClusterId subClusterId)
Set the
SubClusterId representing the unique identifier of the
subcluster. |
abstract void |
GetSubClusterInfoRequest.setSubClusterId(SubClusterId subClusterId)
Set the
SubClusterId representing the unique identifier of the
subcluster. |
abstract void |
SubClusterHeartbeatRequest.setSubClusterId(SubClusterId subClusterId)
Set the
SubClusterId representing the unique identifier of the
subCluster. |
abstract void |
SubClusterInfo.setSubClusterId(SubClusterId subClusterId)
Set the
SubClusterId representing the unique identifier of the
subCluster. |
abstract void |
GetApplicationsHomeSubClusterRequest.setSubClusterId(SubClusterId subClusterId)
Set the
SubClusterId representing the unique identifier of the
subcluster. |
Constructor and Description |
---|
SubClusterIdInfo(SubClusterId subClusterId) |
Modifier and Type | Class and Description |
---|---|
class |
SubClusterIdPBImpl
Protocol buffer based implementation of
SubClusterId . |
Modifier and Type | Method and Description |
---|---|
SubClusterId |
ApplicationHomeSubClusterPBImpl.getHomeSubCluster() |
SubClusterId |
ReservationHomeSubClusterPBImpl.getHomeSubCluster() |
SubClusterId |
AddApplicationHomeSubClusterResponsePBImpl.getHomeSubCluster() |
SubClusterId |
AddReservationHomeSubClusterResponsePBImpl.getHomeSubCluster() |
SubClusterId |
SubClusterHeartbeatRequestPBImpl.getSubClusterId() |
SubClusterId |
GetSubClusterInfoRequestPBImpl.getSubClusterId() |
SubClusterId |
GetApplicationsHomeSubClusterRequestPBImpl.getSubClusterId() |
SubClusterId |
SubClusterInfoPBImpl.getSubClusterId() |
SubClusterId |
SubClusterDeregisterRequestPBImpl.getSubClusterId() |
Modifier and Type | Method and Description |
---|---|
void |
ApplicationHomeSubClusterPBImpl.setHomeSubCluster(SubClusterId paramHomeSubCluster) |
void |
ReservationHomeSubClusterPBImpl.setHomeSubCluster(SubClusterId subClusterId) |
void |
AddApplicationHomeSubClusterResponsePBImpl.setHomeSubCluster(SubClusterId homeSubCluster) |
void |
AddReservationHomeSubClusterResponsePBImpl.setHomeSubCluster(SubClusterId homeSubCluster) |
void |
SubClusterHeartbeatRequestPBImpl.setSubClusterId(SubClusterId subClusterId) |
void |
GetSubClusterInfoRequestPBImpl.setSubClusterId(SubClusterId subClusterId) |
void |
GetApplicationsHomeSubClusterRequestPBImpl.setSubClusterId(SubClusterId subClusterId) |
void |
SubClusterInfoPBImpl.setSubClusterId(SubClusterId subClusterId) |
void |
SubClusterDeregisterRequestPBImpl.setSubClusterId(SubClusterId subClusterId) |
Modifier and Type | Method and Description |
---|---|
protected static void |
FederationMembershipStateStoreInputValidator.checkSubClusterId(SubClusterId subClusterId)
Validate if the SubCluster Id is present or not.
|
static boolean |
FederationStateStoreUtils.filterHomeSubCluster(SubClusterId filterSubCluster,
SubClusterId homeSubCluster)
Filter HomeSubCluster based on Filter SubCluster.
|
Modifier and Type | Method and Description |
---|---|
SubClusterId |
FederationStateStoreFacade.addApplicationHomeSubCluster(ApplicationHomeSubCluster appHomeSubCluster)
Adds the home
SubClusterId for the specified ApplicationId . |
SubClusterId |
FederationStateStoreFacade.addReservationHomeSubCluster(ReservationHomeSubCluster appHomeSubCluster)
Adds the home
SubClusterId for the specified ReservationId . |
SubClusterId |
FederationStateStoreFacade.getApplicationHomeSubCluster(org.apache.hadoop.yarn.api.records.ApplicationId appId)
Returns the home
SubClusterId for the specified
ApplicationId . |
static SubClusterId |
FederationStateStoreFacade.getRandomActiveSubCluster(Map<SubClusterId,SubClusterInfo> activeSubClusters,
List<SubClusterId> blackList)
Randomly pick ActiveSubCluster.
|
SubClusterId |
FederationStateStoreFacade.getReservationHomeSubCluster(org.apache.hadoop.yarn.api.records.ReservationId reservationId)
Returns the home
SubClusterId for the specified ReservationId . |
Modifier and Type | Method and Description |
---|---|
Map<SubClusterId,SubClusterInfo> |
FederationStateStoreFacade.getSubClusters(boolean filterInactiveSubClusters)
Returns the
SubClusterInfo of all active sub cluster(s). |
Map<SubClusterId,SubClusterInfo> |
FederationStateStoreFacade.getSubClusters(boolean filterInactiveSubClusters,
boolean flushCache)
Updates the cache with the central
FederationStateStore and returns
the SubClusterInfo of all active sub cluster(s). |
Modifier and Type | Method and Description |
---|---|
void |
FederationStateStoreFacade.addOrUpdateApplicationHomeSubCluster(org.apache.hadoop.yarn.api.records.ApplicationId applicationId,
SubClusterId subClusterId,
int retryCount,
org.apache.hadoop.yarn.api.records.ApplicationSubmissionContext appSubmissionContext)
Add or Update ApplicationHomeSubCluster.
|
void |
FederationStateStoreFacade.addOrUpdateReservationHomeSubCluster(org.apache.hadoop.yarn.api.records.ReservationId reservationId,
SubClusterId subClusterId,
int retryCount)
Add or Update ReservationHomeSubCluster.
|
boolean |
FederationStateStoreFacade.deregisterSubCluster(SubClusterId subClusterId,
SubClusterState subClusterState)
Deregister subCluster, Update the subCluster state to
SC_LOST、SC_DECOMMISSIONED etc.
|
SubClusterInfo |
FederationStateStoreFacade.getSubCluster(SubClusterId subClusterId)
Returns the
SubClusterInfo for the specified SubClusterId . |
SubClusterInfo |
FederationStateStoreFacade.getSubCluster(SubClusterId subClusterId,
boolean flushCache)
Updates the cache with the central
FederationStateStore and returns
the SubClusterInfo for the specified SubClusterId . |
void |
FederationStateStoreFacade.updateApplicationHomeSubCluster(SubClusterId subClusterId,
org.apache.hadoop.yarn.api.records.ApplicationId applicationId,
ApplicationHomeSubCluster homeSubCluster)
Update ApplicationHomeSubCluster to FederationStateStore.
|
void |
FederationStateStoreFacade.updateReservationHomeSubCluster(SubClusterId subClusterId,
org.apache.hadoop.yarn.api.records.ReservationId reservationId,
ReservationHomeSubCluster homeSubCluster)
Update Reservation And HomeSubCluster Mapping.
|
Modifier and Type | Method and Description |
---|---|
static SubClusterId |
FederationStateStoreFacade.getRandomActiveSubCluster(Map<SubClusterId,SubClusterInfo> activeSubClusters,
List<SubClusterId> blackList)
Randomly pick ActiveSubCluster.
|
static SubClusterId |
FederationStateStoreFacade.getRandomActiveSubCluster(Map<SubClusterId,SubClusterInfo> activeSubClusters,
List<SubClusterId> blackList)
Randomly pick ActiveSubCluster.
|
Copyright © 2008–2024 Apache Software Foundation. All rights reserved.