VMWARE VREALIZE OPERATIONS MANAGEMENT PACK FOR Apache Hadoop · 3 Blue Medora VMware vRealize...

VMWARE VREALIZE OPERATIONS MANAGEMENT PACK FOR

Apache Hadoop

User Guide

2 Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop User Guide

NOTE: This document supports the version of each product listed, as well as all subsequent versions, until a new edition replaces it.

You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com.

The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected].

1. Purpose ..................................................................................................................................................................... 32. Introduction to the Management Pack ...................................................................................... 3

2.1 How the Management Pack Collects Data ............................................................ 32.2 Data the Management Pack Collects .......................................................................... 32.3 Inventory Tree (Traversal Spec) .......................................................................................... 42.4 External Relationships ................................................................................................................ 4

3. Dashboards ........................................................................................................................................................... 53.1 Apache Hadoop Overview ...................................................................................................... 53.2 Apache Hadoop Health Investigation .......................................................................... 63.3 Apache Hadoop HDFS Overview .................................................................................... 73.4 Apache Hadoop YARN Overview .................................................................................... 83.5 Apache Hadoop Node Deep Dive ................................................................................... 93.6 VM to Apache Hadoop Node............................................................................................10

4. Views .........................................................................................................................................................................115. Reports ...................................................................................................................................................................136. Alerts .........................................................................................................................................................................147. Analysis Badges ............................................................................................................................................148. Troubleshooting the Management Pack ...............................................................................15

8.1 Troubleshooting an Adapter Instance ......................................................................158.2 Test Connection Failures .......................................................................................................158.3 Viewing System Log Files.....................................................................................................15

9. Appendix I: Metrics ....................................................................................................................................1610. Appendix II: Alerts ....................................................................................................................................4511. Appendix III: Capacity Definitions ............................................................................................46

TABLE OF CONTENTS


1. PurposeThe Blue Medora VMware vRealize Operations (vROps) Management Pack for Apache Hadoop User Guide describes the primary features of the Management Pack for Apache Hadoop, including dashboards, views, reports, alerts, and metrics that allow users to optimize the monitoring and management of Apache Hadoop resources from within vRealize Operations.

2. Introduction to the Management PackThe Management Pack for Apache Hadoop is an embedded adapter for vRealize Operations (vROps) that monitors Apache Hadoop systems remotely to retrieve performance data regarding Apache Hadoop resources.

This section includes the following topics:• How the Management Pack Collects Data• Data the Management Pack Collects

2.1 How the Management Pack Collects DataDuring each data collection cycle, the Management Pack opens a HTTP connection to the specified NameNode and ResourceManager JMX hosts to retrieve resource metrics for HDFS & YARN, respectively. After connecting to the NameNode and ResourceManager JMX endpoints, the Management Pack discovers lower-level DataNode and NodeManager resources and connects to them directly to retrieve metrics.

NOTE: The advanced configuration Collection Mode setting allows you to operate in “Light” mode, during which the Management Pack connects to top-level NameNode and ResourceManager resources only, but still provides select alerting for DataNodes and NodeManagers. Refer to the accompanying Blue Medora VMware vRealize Operations Management Pack for Apache Hadoop Installation & Configuration Guide.

The collection interval for the adapter instance resource determines how often the Management Pack collects data. The default collection interval is five minutes.

2.2 Data the Management Pack CollectsThe Management Pack can collect performance data, relationships (associations), and events for the following Apache Hadoop resources:

1. Apache Hadoop Cluster 2. Apache Hadoop NameNode 3. Apache Hadoop ResourceManager 4. Apache Hadoop DataNode 5. Apache Hadoop NodeManager

Figure 1: Apache Hadoop Relationships Diagram


2.3 Inventory Tree (Traversal Spec)The Inventory Tree (Traversal Spec) feature within vROps allows you to easily navigate your Hadoop environment. The hierarchical structure implicitly shows relationships among resource kinds, enabling quick drill-downs to root-cause issues.

2.4 External RelationshipsThe Management Pack for Apache Hadoop includes external relationships for Blue Medora True Visibility Suite customers who are also using Blue Medora’s vROps Management Packs for Nutanix or KVM as well as external relationships to the VMware virtual layer. The following external relationships can be discovered:

• VMware VM -> NameNode • VMware VM -> DataNode • VMware VM -> ResourceManager • VMware VM -> NodeManager • Nutanix VM -> NameNode • Nutanix VM -> DataNode • Nutanix VM -> ResourceManager • Nutanix VM -> NodeManager • KVM VM -> NameNode • KVM VM -> DataNode • KVM VM -> ResourceManager • KVM VM -> NodeManager

Figure 2: Example Hadoop Traversal Spec


3. DashboardsDashboards are the primary user interface that allow users to monitor Apache Hadoop resources from within vRealize Operations.

The following dashboards are available in the Management Pack:

•Apache Hadoop Overview•Apache Hadoop Health Investigation•Apache Hadoop HDFS Overview•Apache Hadoop YARN Overview•Apache Hadoop Node Deep Dive•VM to Apache Hadoop Node

3.1 Apache Hadoop OverviewThe Apache Hadoop Overview dashboard displays heat maps depicting the overall health of Apache Hadoop Clusters, ResourceManagers, NameNodes, NodeManagers, and DataNodes. Figure 3: Apache Hadoop Overview Dashboard


3.2 Apache Hadoop Health InvestigationThe Apache Hadoop Health Investigation dashboard provides an efficent way to navigate and investigate the health and performance of your entire Hadoop Cluster environment. Select an Apache Hadoop resource from the Environment Overview widget to populate its health status, top alerts, and key performance metrics.

Figure 4: Apache Hadoop Health Investigation


3.3 Apache Hadoop HDFS OverviewThe Apache Hadoop HDFS Overview dashboard enables an overview of your HDFS resources by allowing you to select a Apache Hadoop NameNode and related DataNode to view properties and selected metrics about the parent-child resources, side-by-side.

Figure 5: Apache Hadoop HDFS Overview Dashboard


3.4 Apache Hadoop YARN OverviewThe Apache Hadoop YARN Overview dashboard enables an overview of your YARN resources by allowing you to select a Apache Hadoop ResourceManager and related NodeManager to view properties and selected metrics about the parent-child resources, side-by-side.

Figure 6: Apache Hadoop YARN Overview Dashboard


3.5 Apache Hadoop Node Deep DiveThe Apache Hadoop Node Deep Dive dashboard allows you to select an Apache Hadoop node and related virtual machines, datastore, and host for a deep-dive view of common KPIs for Hadoop nodes displayed as sparkline scoreboards for each of the selected resources.

Figure 7: Apache Hadoop Node Deep Dive Dashboard


3.6 VM to Apache Hadoop NodeThe VM to Apache Hadoop Node dashboard allows you to select any VMware, Nutanix, or KVM virtual machine and a related Apache Hadoop node to view sparkline scoreboards highlighting KPIs for both resources.

Figure 8: VM to Apache Hadoop Node Dashboard


4. ViewsThe Management Pack for Apache Hadoop contains custom views, which allow the user to view statistics of metrics for Apache Hadoop resources. Views provide a “big picture” look at resources, as opposed to a more in depth view.

The following views are available in the Management Pack:

• Apache Hadoop Cluster KPIs• Apache Hadoop Cluster Utilization and Health• Apache Hadoop OS and Java Configuration• Apache Hadoop HDFS Capacity and Health• Apache Hadoop YARN Capacity and Health• Apache Hadoop NameNode Capacities• Apache Hadoop NameNode Capacity and Health• Apache Hadoop NameNode KPIs• Apache Hadoop NameNode OS and Java Configuration• Apache Hadoop NameNode Properties• Apache Hadoop ResourceManager Capacities• Apache Hadoop ResourceManager Utilization and Health• Apache Hadoop ResourceManager KPIs• Apache Hadoop ResourceManager OS and Java Configuration• Apache Hadoop ResourceManager Properties• Apache Hadoop DataNode Capacities• Apache Hadoop DataNode Capacity and Health• Apache Hadoop DataNode KPIs• Apache Hadoop DataNode OS and Java Configuration• Apache Hadoop DataNode Properties• Apache Hadoop NodeManager Capacities• Apache Hadoop NodeManager Utilization and Health• Apache Hadoop NodeManager KPIs• Apache Hadoop NodeManager OS and Java Configuration• Apache Hadoop NodeManager Properties


To access the Management Pack views, go to Environment > Apache Hadoop Clusters and click the desired object (resource kind). Select the Details tab, then Views. Select the desired view from the list to populate the statistics below.

For the full list of views for the Management Pack, go to Home > Content > Views.

Figure 9: Accessing Apache Hadoop Views


5. ReportsThe Management Pack for Apache Hadoop contains the following out-of-the-box reports. The reports can be exported and easily shared with key stakeholders in either .pdf or .csv formats.

• Apache Hadoop Capacities• Apache Hadoop Health and Availability• Apache Hadoop HDFS Capacity and Health• Apache Hadoop YARN Capacity and Health• Apache Hadoop KPIs• Apache Hadoop OS and Java Configuration• Apache Hadoop Properties

To access the Management Packs reports, go to Environment > Apache Hadoop Clusters and click the desired object (resource kind). Select the Reports tab, then Report Templates.

To run the selected report, click the Run Template icon ( ).

Figure 10: Accessing Apache Hadoop Reports


6. AlertsThe Management Pack for Apache Hadoop pulls Apache Hadoop health indicators and displays them in vRealize Operations as alerts. The critical levels of each alert are closely mapped from Apache Hadoop to vROps. Refer to “10. Appendix II: Alerts” for the full list of alerts, symptoms, and recommendations provided by this Management Pack.

Figure 11: Alert Example

7. Analysis BadgesUsing the predictive analytics capabilities of the vROps Analysis Badges through capacity definitions, theManagement Pack populates capacity and utilization breakdowns for Apache Hadoop resources. Refer to “11. Appendix III: Capacity Definitions” for the list of capacity definitions.

Figure 12: Analysis Badge Example


8. Troubleshooting the Management PackKnown troubleshooting information can help you diagnose and correct common problems with the Management Pack for Apache Hadoop.

This section includes the following topics:• Troubleshooting an Adapter Instance• Test Connection Failures• Viewing System Log Files

8.1 Troubleshooting an Adapter InstancePerform these general troubleshooting steps to diagnose and correct problems with an adapter instance:

• Edit the adapter instance and click Test Connection to verify the connection to vROps. Refer to section “8.2 Test Connection Failures”.

• View the collection status and collection state for the adapter instance resource on the Environment Overview page in vROps.

• Check the adapter and collector logs for errors. Refer to section “8.3 Viewing System Log Files”, for details.

8.2 Test Connection FailuresWhen clicking Test Connection in the Manage Solution window after configuring an adapter instance, the following connection errors are possible.

8.2.1 Network Unreachable / Connection Timed OutError: The following connectivity error can occur on YARN and/or HDFS: “Network is unreachable or connection timed out. Ensure host and port are correct. URL: http://<host>:<port>/jmx.”Action: In the Manage Solution window, ensure the NameNode and ResourceManager JMX hosts and ports match those of your JMX endpoints. You can verify your configuration by running the following command from your vROps system: curl <http://<host>:<port>/jmx>

8.3 Viewing System Log FilesYou can view Apache Hadoop adapter errors in the adapter and collector log files. You can view the adapter and collector log files in the vROps user interface or in an external log viewer.

• The adapter log files are in the $VCOPS_BASE/user/log/adapters/ApacheHadoopAdapter/ folder. • The collector log files are in the $VCOPS_BASE/user/log/ folder.

The logging level is set to WARNING by default. To troubleshoot issues, set the logging level to INFO. To view detailed messages, including micro steps, queries, and returned results, set the logging level to DEBUG.

You can set the base log level for the collector via Administration -> Support -> Logs -> Select COLLECTOR folder -> Select Edit Properties icon -> Edit Root logger level.

NOTE: If you set the logging level to DEBUG, log files can become large very quickly. Set the logging level to DEBUG only for short periods of time.

For complete information about viewing log files and modifying log levels, refer to the vROps online help.


9. Appendix I: MetricsThe Management Pack for Apache Hadoop collects the following metrics by Apache Hadoop Resource Kinds.

Table 1: Management Pack Metrics

RESOURCE KIND RESOURCE GROUP

RESOURCE ATTRIBUTE

ATTRIBUTE TYPE

ATTRIBUTE DESCRIPTION

Hadoop Cluster Details NodeManagers Active float NodeManagers Active

Hadoop Cluster Details NodeManagers Decommissioned

float NodeManagers Decommis-sioned

Hadoop Cluster Details NodeManagers Lost float NodeManagers Lost

Hadoop Cluster Details NodeManagers Rebooted

float NodeManagers Rebooted

Hadoop Cluster Details NodeManagers Unhealthy

float NodeManagers Unhealthy

Hadoop Cluster Details Sum of Containers Completed from NodeManager Descendants

float Sum of Containers Completed from NodeManager Descen-dants

Hadoop Cluster Details Sum of Containers Failed from NodeManager Descendants

float Sum of Containers Failed from NodeManager Descendants

Hadoop Cluster Details Sum of Containers Initializing from NodeManager Descendants

float Sum of Containers Initializing from NodeManager Descen-dants

Hadoop Cluster Details Sum of Containers Killed from NodeManager Descendants

float Sum of Containers Killed from NodeManager Descendants

Hadoop Cluster Details Sum of Containers Launched from NodeManager Descendants

float Sum of Containers Launched from NodeManager Descen-dants

Hadoop Cluster Details Sum of Containers Running from NodeManager Descendants

float Sum of Containers Running from NodeManager Descen-dants

Hadoop Cluster Details Sum of Users Active from ResourceManager Descendants

float Sum of Users Active from Re-sourceManager Descendants

Hadoop Cluster Details Unique Child Hostnames

integer Unique Child Hostnames

Hadoop Cluster Relationships Hadoop Tag Parents string List of parent Hadoop Tag resources

Hadoop Cluster Relationships NameNode Children string List of child NameNode re-sources

Hadoop Cluster Relationships ResourceManager Children

string List of child ResourceManager resources



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop Tag Relationships Cluster Children string List of children Cluster resourc-es

Hadoop Related KVM VMs

Relationships KVM Virtual Machine Children

string List of children KVM Virtual Machine resources

Hadoop Related Nutanix VMs

Relationships Nutanix Virtual Machine Children

string List of children Nutanix Virtual Machine resources

Hadoop Related VMs

Relationships VMware Virtual Machine Children

string List of children VMware Virtual Machine resources

Hadoop External Resources

Relationships KVM Virtual Machine Children

string List of children KVM Virtual Machine resources


Relationships VMware Virtual Machine Children

string List of children VMware Virtual Machine resources


Relationships Nutanix Virtual Machine Children

string List of children Nutanix Virtual Machine resources

Hadoop DataNode CPU Process CPU Load float Attribute ProcessCpuLoad from Bean java.lang:type=Operat-ingSystem

Hadoop DataNode CPU System CPU Load float Attribute SystemCpuLoad from Bean java.lang:type=Operat-ingSystem

Hadoop DataNode CPU Threads In BLOCKED State

integer Attribute ThreadsBlocked from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode CPU Threads In NEW State integer Attribute ThreadsNew from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode CPU Threads In RUNNABLE State

integer Attribute ThreadsRunnable from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode CPU Threads In TERMINATED State

integer Attribute ThreadsTerminated from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode CPU Threads In TIMED_WAITING State

integer Attribute ThreadsTimedWaiting from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode CPU Threads In WAITING State

integer Attribute ThreadsWaiting from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode Details JVM Version string Attribute SystemProperties from Bean java.lang:type=Run-time

Hadoop DataNode Details Metric Endpoint string Metric Endpoint

Hadoop DataNode Details OS Name string Attribute Name from Bean java.lang:type=OperatingSystem

Hadoop DataNode Details OS Version string Attribute Version from Bean java.lang:type=OperatingSys-tem



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop DataNode Details Tag Hostname string Attribute tag.Hostname from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Details Total ERROR Log Messages

float Attribute LogError from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop DataNode Details Total FATAL Log Messages

float Attribute LogFatal from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop DataNode Details Total INFO Log Messages

float Attribute LogInfo from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop DataNode Details Total WARN Log Messages

float Attribute LogWarn from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop DataNode Details Version string Attribute Version from Bean Hadoop:service=DataN-ode,name=DataNodeInfo

Hadoop DataNode Disk Blocks Read float Attribute BlocksRead from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*

Hadoop DataNode Disk Blocks Removed float Attribute BlocksRemoved from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*

Hadoop DataNode Disk Blocks Replicated float Attribute BlocksReplicated from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*

Hadoop DataNode Disk Blocks Written float Attribute BlocksWritten from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*

Hadoop DataNode Disk Cache Capacity float Attribute CacheCapacity from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*

Hadoop DataNode Disk Cache Used float Attribute CacheUsed from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*

Hadoop DataNode Disk Cached integer Attribute NumBlocksCached from Bean Hadoop:service=-DataNode,name=FSDataset-State-.*

Hadoop DataNode Disk Capacity Lost Due To Volume Failure

float Attribute EstimatedCapacity-LostTotal from Bean Hadoop:-service=DataNode,name=FS-DatasetState-.*

Hadoop DataNode Disk Capacity Used float Capacity Used



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop DataNode Disk Capacity Used Ratio float Capacity Used Ratio

Hadoop DataNode Disk Data Read float Attribute BytesRead from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*

Hadoop DataNode Disk Data Written float Attribute BytesWritten from Bean Hadoop:service=DataN-ode,name=DataNodeActivity-.*

Hadoop DataNode Disk Disk Capacity float Attribute Capacity from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*

Hadoop DataNode Disk Disk Remaining float Attribute Remaining from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*

Hadoop DataNode Disk Distributed File System Used

float Attribute DfsUsed from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*

Hadoop DataNode Disk Failed To Cache integer Attribute NumBlocksFailedTo-Cache from Bean Hadoop:ser-vice=DataNode,name=FSData-setState-.*

Hadoop DataNode Disk Failed To Uncache integer Attribute NumBlocksFailed-ToUncache from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*

Hadoop DataNode Disk Failed Volumes integer Attribute NumFailedVolumes from Bean Hadoop:service=-DataNode,name=FSDataset-State-.*

Hadoop DataNode Disk Last Volume Failure Date (from Unix epoch)

float Attribute LastVolumeFailure-Date from Bean Hadoop:ser-vice=DataNode,name=FSData-setState-.*

Hadoop DataNode Disk Read Blocks Diff float Read Blocks Diff

Hadoop DataNode Disk Reads Diff float Reads Diff

Hadoop DataNode Disk Removed Diff float Removed Diff

Hadoop DataNode Disk Replicated Diff float Replicated Diff

Hadoop DataNode Disk Storage Info string Attribute StorageInfo from Bean Hadoop:service=DataN-ode,name=FSDatasetState-.*

Hadoop DataNode Disk Write Blocks Diff float Write Blocks Diff

Hadoop DataNode Disk Writes Diff float Writes Diff

Hadoop DataNode Memory Current Heap Memory Committed

float Attribute MemHeapCommit-tedM from Bean Hadoop:ser-vice=\w+,name=JvmMetrics

Hadoop DataNode Memory Current Heap Memory Used

float Attribute MemHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop DataNode Memory Current Non-heap Memory Committed

float Attribute MemNonHeapCom-mittedM from Bean Hadoop:-service=\w+,name=JvmMetrics

Hadoop DataNode Memory Current Non-heap Memory Used

float Attribute MemNonHeapUsedM from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode Memory Free Physical Memory float Attribute FreePhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem

Hadoop DataNode Memory Garbage Collection Count

integer Attribute GcCount from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop DataNode Memory Garbage Collection Count Mark Sweep Compact

integer Attribute GcCountMarkSweep-Compact from Bean Hadoop:-service=\w+,name=JvmMetrics

Hadoop DataNode Memory Garbage Collection Time

integer Attribute GcTimeMillis from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode Memory Garbage Collection Time Mark Sweep Compact

integer Attribute GcTimeMillisMark-SweepCompact from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop DataNode Memory Maximum Heap Memory Size

float Attribute MemHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode Memory Maximum Memory Size float Attribute MemMaxM from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop DataNode Memory Maximum Non-heap Memory Size

float Attribute MemNonHeapMaxM from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop DataNode Memory Total Physical Memory float Attribute TotalPhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem

Hadoop DataNode Memory Used Physical Memory float Used Physical Memory

Hadoop DataNode Memory Used Physical Memory float Used Physical Memory

Hadoop DataNode Status Node Status string Node Status

Hadoop DataNode Status Power State string Power State

Hadoop DataNode Uncategorized Group Resolution Average Time

float Attribute GetGroupsAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics

Hadoop DataNode Uncategorized Group Resolutions integer Attribute GetGroupsNumOps from Bean Hadoop:service=\w+,name=UgiMetrics

Hadoop DataNode Uncategorized Kerberos Login Failure Average Time

float Attribute LoginFailureAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop DataNode Uncategorized Kerberos Login Failures integer Attribute LoginFailureNumOps from Bean Hadoop:service=\w+,name=UgiMetrics

Hadoop DataNode Uncategorized Kerberos Login Success Average Time

float Attribute LoginSuccessAvgTime from Bean Hadoop:service=\w+,name=UgiMetrics

Hadoop DataNode Uncategorized Kerberos Login Successes

integer Attribute LoginSuccessNu-mOps from Bean Hadoop:ser-vice=\w+,name=UgiMetrics

Hadoop DataNode Uncategorized Publish Average Time float Attribute PublishAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Uncategorized Publish Operations integer Attribute PublishNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Uncategorized Publishes Dropped integer Attribute DroppedPubAll from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Uncategorized Sinks Total integer Attribute NumAllSinks from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Uncategorized Snapshot Average Time float Attribute SnapshotAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Uncategorized Snapshot Operations integer Attribute SnapshotNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Uncategorized Sources Active integer Attribute NumActiveSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Uncategorized Sources Total integer Attribute NumAllSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop DataNode Relationships KVM Virtual Machine Parents

string List of parent KVM Virtual Ma-chine resources

Hadoop DataNode Relationships NameNode Parents string List of parent NameNode resources

Hadoop DataNode Relationships Nutanix Virtual Machine Parents

string List of parent Nutanix Virtual Machine resources

Hadoop DataNode Relationships Virtual Machine Parents string List of parent Virtual Machine resources



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode CPU Process CPU Load float Attribute ProcessCpuLoad from Bean java.lang:type=Operat-ingSystem

Hadoop NameNode CPU System CPU Load float Attribute SystemCpuLoad from Bean java.lang:type=Operat-ingSystem

Hadoop NameNode CPU Threads In BLOCKED State


Hadoop NameNode CPU Threads In NEW State integer Attribute ThreadsNew from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop NameNode CPU Threads In RUNNABLE State


Hadoop NameNode CPU Threads In TERMINATED State


Hadoop NameNode CPU Threads In TIMED_WAITING State


Hadoop NameNode CPU Threads In WAITING State


Hadoop NameNode Details Active Nodes string Isolated hostnames in LiveNodes entry from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Details Connections integer Attribute TotalLoad from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Details Dead Nodes string Attribute DeadNodes from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Details Decommissioned Nodes

string Attribute DecomNodes from Bean Hadoop:-service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Details Distinct Version Count integer Attribute DistinctVersion-Count from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Details Get Edit Average Time float Attribute GetEditAvg-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Get Edit Operations integer Attribute GetEditNu-mOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Details Get Image Average Time

float Attribute GetImageAvg-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Get Image Operations integer Attribute GetImageNu-mOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Get Link Target Operations

integer Attribute GetLinkTarge-tOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Get Listing Operations integer Attribute GetListin-gOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Hadoop Detailed Version

string Attribute Version from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Details Hadoop Version string Attribute SoftwareVer-sion from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Details JVM Version string Attribute SystemProperties from Bean java.lang:type=Run-time

Hadoop NameNode Details Last Written Transaction ID

integer Attribute LastWritten-TransactionId from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Details List Snapshottable Directory Operations

integer Attribute ListSnapshot-tableDirOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Maximum Objects integer Attribute MaxObjects from Bean Hadoop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Details Metric Endpoint string Metric Endpoint

Hadoop NameNode Details OS Name string Attribute Name from Bean java.lang:type=OperatingSystem

Hadoop NameNode Details OS Version string Attribute Version from Bean java.lang:type=OperatingSys-tem

Hadoop NameNode Details Pending DataNode Messages

integer Attribute PendingDataNode-MessageCount from Bean Hadoop:service=NameNo-de,name=FSNamesystem



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Details Put Image Average Time

float Attribute PutImageAvg-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Put Image Operations integer Attribute PutImageNu-mOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Rename Snapshot Operations

integer Attribute RenameSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Safe Mode string Attribute Safemode from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Details Safe Mode Time integer Attribute SafeMode-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Snapshot Diff Report Operations

integer Attribute SnapshotDif-fReportOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Stale Storages integer Attribute NumStaleStor-ages from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Details Startup Completion float Attribute PercentComplete from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Startup Elapsed Time integer Attribute ElapsedTime from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Startup Loading Edits Completion

float Attribute LoadingEditsPer-centComplete from Bean Hadoop:service=NameNo-de,name=StartupProgress

Hadoop NameNode Details Startup Loading Edits Count

integer Attribute LoadingEditsCount from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Startup Loading Edits Elapsed Time

integer Attribute LoadingEditsElapsed-Time from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Startup Loading Edits Total

integer Attribute LoadingEditsTo-tal from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Details Startup Safe Mode Completion

float Attribute SafeModePer-centComplete from Bean Hadoop:service=NameNo-de,name=StartupProgress

Hadoop NameNode Details Startup Safe Mode Count

integer Attribute SafeModeCount from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Startup Safe Mode Elapsed Time

integer Attribute SafeModeElapsed-Time from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Startup Safe Mode Total

integer Attribute SafeModeTotal from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Startup Saving Checkpoint Completion

float Attribute SavingCheckpoint-PercentComplete from Bean Hadoop:service=NameNo-de,name=StartupProgress

Hadoop NameNode Details Startup Saving Checkpoint Count

integer Attribute SavingCheckpoint-Count from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Startup Saving Checkpoint Elapsed Time

integer Attribute SavingCheck-pointElapsedTime from Bean Hadoop:service=NameNo-de,name=StartupProgress

Hadoop NameNode Details Startup Saving Checkpoint Total

integer Attribute SavingCheckpoint-Total from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Details Storage Block Report Operations

integer Attribute StorageBlock-ReportOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Syncs Average Time float Attribute SyncsAvg-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Syncs Operations integer Attribute SyncsNu-mOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Tag Hostname string Attribute tag.Hostname from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Details Time Since Last Loaded Edits

integer Attribute MillisSinceLas-tLoadedEdits from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Details Total ERROR Log Messages


Hadoop NameNode Details Total FATAL Log Messages


Hadoop NameNode Details Total INFO Log Messages


Hadoop NameNode Details Total WARN Log Messages


Hadoop NameNode Details Transactions Average Time

float Attribute Transaction-sAvgTime from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Transactions Batched In Sync

integer Attribute Transactions-BatchedInSync from Bean Hadoop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Transactions Operations

integer Attribute Transaction-sNumOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Details Transactions Since Last Checkpoint

integer Attribute TransactionsSince-LastCheckpoint from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Details Transactions Since Last Log Roll

integer Attribute TransactionsSin-ceLastLogRoll from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Details Volume Failures Total integer Attribute VolumeFail-uresTotal from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Disk Add Block Operations integer Attribute AddBlock-Ops from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Block Deletion Start Date (from Unix epoch)

float Attribute BlockDeletion-StartTime from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Disk Block Operations Batched

integer Attribute BlockOps-Batched from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Block Operations Queued

integer Attribute BlockOps-Queued from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Block Pool Used Percent

float Attribute PercentBlock-PoolUsed from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Block Pool Used Space float Attribute BlockPoolUsed-Space from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Block Received And Deleted Operations

integer Attribute BlockReceive-dAndDeletedOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Block Report Average Time

float Attribute BlockRepor-tAvgTime from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Block Report Operations

integer Attribute BlockReport-NumOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Blocks Missing integer Attribute NumberOfMiss-ingBlocks from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Blocks Missing With Replication Factor One

integer Attribute NumberOfMiss-ingBlocksWithReplica-tionFactorOne from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Cache Capacity float Attribute CacheCa-pacity from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Cache Report Average Time

float Attribute CacheRepor-tAvgTime from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Cache Report Operations

integer Attribute CacheReport-NumOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Disk Cache Used float Attribute CacheUsed from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Capacity integer Attribute BlockCa-pacity from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Capacity Lost Due To Volume Failure

float Attribute EstimatedCa-pacityLostTotal from Bean Hadoop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Disk Capacity Remaining float Attribute CapacityRe-maining from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Capacity Total float Attribute Capacity-Total from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Capacity Used float Attribute CapacityU-sed from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Capacity Used Non-distributed File System

float Attribute CapacityUsed-NonDFS from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Capacity Used Ratio float Capacity Used Ratio

Hadoop NameNode Disk Corrupt integer Attribute CorruptBlocks from Bean Hadoop:-service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Create File Operations integer Attribute CreateFile-Ops from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Create Snapshot Operations

integer Attribute CreateSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Create Symlink Operations

integer Attribute CreateSym-linkOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk DataNodes Dead integer Attribute NumDeadDat-aNodes from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Disk DataNodes Stale integer Attribute StaleDataN-odes from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Delete File Operations integer Attribute DeleteFile-Ops from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Delete Snapshot Operations

integer Attribute DeleteSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Disallow Snapshot Operations

integer Attribute DisallowSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Excess integer Attribute ExcessBlocks from Bean Hadoop:-service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Expired Heartbeats integer Attribute ExpiredHeart-beats from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk File Info Operations integer Attribute FileInfoOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk File System Image Load Time

integer Attribute FsImageLoad-Time from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk File System State string Attribute FSState from Bean Hadoop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Disk Files Appended integer Attribute FilesAppend-ed from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Files Created integer Attribute FilesCreat-ed from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Files Deleted integer Attribute FilesDelet-ed from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Files In Get Listing Operations

integer Attribute FilesInGetLis-tingOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Disk Files Renamed integer Attribute FilesRenamed from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Files Total integer Attribute FilesTotal from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Files Truncated integer Attribute FilesTrun-cated from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Get Additional Datanode Operations

integer Attribute GetAdditional-DatanodeOps from Bean Hadoop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Get Block Locations integer Attribute GetBlockLo-cations from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Last Checkpoint Date (from Unix epoch)

float Attribute LastCheck-pointTime from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Missing integer Attribute MissingBlocks from Bean Hadoop:-service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Missing With Replication Factor One

integer Attribute MissingReplOne-Blocks from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Non-distributed File System Used Space

float Attribute NonDfsUsed-Space from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Pending Deletion integer Attribute PendingDele-tionBlocks from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Pending Replication integer Attribute PendingRepli-cationBlocks from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Postponed Mis-replicated

integer Attribute PostponedMis-replicatedBlocks from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Scheduled Replication integer Attribute ScheduledRep-licationBlocks from Bean Hadoop:service=NameNo-de,name=FSNamesystem



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Disk Snapshots integer Attribute Snapshots from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Snapshottable Directories

integer Attribute Snapshottable-Directories from Bean Hadoop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Disk Space Free float Attribute Free from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Space Free Percent float Attribute PercentRemain-ing from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Space Total float Attribute Total from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Space Used float Attribute Used from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Space Used Percent float Attribute PercentUsed from Bean Hadoop:-service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Startup Loading File System Image Completion

float Attribute LoadingFsImage-PercentComplete from Bean Hadoop:service=NameNo-de,name=StartupProgress

Hadoop NameNode Disk Startup Loading File System Image Count

integer Attribute LoadingFsImage-Count from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Disk Startup Loading File System Image Elapsed Time

integer Attribute LoadingFsIma-geElapsedTime from Bean Hadoop:service=NameNo-de,name=StartupProgress

Hadoop NameNode Disk Startup Loading File System Image Total

integer Attribute LoadingFsImage-Total from Bean Hadoop:ser-vice=NameNode,name=Start-upProgress

Hadoop NameNode Disk Total integer Attribute TotalBlocks from Bean Hadoop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Disk Total File Operations integer Attribute TotalFileOps from Bean Hadoop:-service=NameNo-de,name=NameNodeActivity

Hadoop NameNode Disk Total Files integer Attribute TotalFiles from Bean Hadoop:service=NameNo-de,name=NameNodeInfo



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Disk Under-replicated integer Attribute UnderReplicat-edBlocks from Bean Ha-doop:service=NameNo-de,name=FSNamesystem

Hadoop NameNode Memory Current Heap Memory Committed


Hadoop NameNode Memory Current Heap Memory Used


Hadoop NameNode Memory Current Non-heap Memory Committed


Hadoop NameNode Memory Current Non-heap Memory Used


Hadoop NameNode Memory Free Physical Memory float Attribute FreePhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem

Hadoop NameNode Memory Garbage Collection Count


Hadoop NameNode Memory Garbage Collection Count Mark Sweep Compact


Hadoop NameNode Memory Garbage Collection Time


Hadoop NameNode Memory Garbage Collection Time Mark Sweep Compact


Hadoop NameNode Memory Maximum Heap Memory Size


Hadoop NameNode Memory Maximum Memory Size float Attribute MemMaxM from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop NameNode Memory Maximum Non-heap Memory Size


Hadoop NameNode Memory Retry Cache Clears integer Attribute CacheCleared from Bean Hadoop:ser-vice=NameNode,name=Retry-Cache.NameNodeRetryCache

Hadoop NameNode Memory Retry Cache Hits integer Attribute CacheHit from Bean Hadoop:service=NameNo-de,name=RetryCache.NameNodeRetryCache



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Memory Retry Cache Updates integer Attribute CacheUpdated from Bean Hadoop:ser-vice=NameNode,name=Retry-Cache.NameNodeRetryCache

Hadoop NameNode Memory Total Physical Memory float Attribute TotalPhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem

Hadoop NameNode Memory Used Physical Memory float Used Physical Memory

Hadoop NameNode Memory Used Physical Memory float Used Physical Memory

Hadoop NameNode Status DataNodes Decommissioned Dead

integer Attribute NumDecom-DeadDataNodes from Bean Hadoop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Status DataNodes Decommissioned Live

integer Attribute NumDecomLive-DataNodes from Bean Hadoop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Status DataNodes Decommissioning

integer Attribute NumDecommis-sioningDataNodes from Bean Hadoop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Status DataNodes Live integer Attribute NumLiveDat-aNodes from Bean Ha-doop:service=NameNo-de,name=FSNamesystemState

Hadoop NameNode Status High Availability State string Attribute tag.HAState from Bean Hadoop:-service=NameNo-de,name=FSNamesystem

Hadoop NameNode Status High Availibity Failover Occurred

string High Availibity Failover Oc-curred

Hadoop NameNode Status Last High Availability Transition Time

integer Attribute LastHATransi-tionTime from Bean Ha-doop:service=NameNo-de,name=NameNodeStatus

Hadoop NameNode Status Node Status string Node Status

Hadoop NameNode Status Power State string Power State

Hadoop NameNode Status State string Attribute State from Bean Hadoop:service=NameNo-de,name=NameNodeStatus

Hadoop NameNode Status Upgrade Finalized string Attribute UpgradeFi-nalized from Bean Ha-doop:service=NameNo-de,name=NameNodeInfo

Hadoop NameNode Uncategorized Group Resolution Average Time




RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode Uncategorized Group Resolutions integer Attribute GetGroupsNumOps from Bean Hadoop:service=\w+,name=UgiMetrics

Hadoop NameNode Uncategorized Kerberos Login Failure Average Time


Hadoop NameNode Uncategorized Kerberos Login Failures integer Attribute LoginFailureNumOps from Bean Hadoop:service=\w+,name=UgiMetrics

Hadoop NameNode Uncategorized Kerberos Login Success Average Time


Hadoop NameNode Uncategorized Kerberos Login Successes


Hadoop NameNode Uncategorized Publish Average Time float Attribute PublishAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NameNode Uncategorized Publish Operations integer Attribute PublishNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NameNode Uncategorized Publishes Dropped integer Attribute DroppedPubAll from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NameNode Uncategorized Sinks Total integer Attribute NumAllSinks from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NameNode Uncategorized Snapshot Average Time float Attribute SnapshotAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NameNode Uncategorized Snapshot Operations integer Attribute SnapshotNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NameNode Uncategorized Sources Active integer Attribute NumActiveSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NameNode Uncategorized Sources Total integer Attribute NumAllSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NameNode User Configu-ration

Allow Snapshot Operations

string Attribute AllowSnap-shotOps from Bean Ha-doop:service=NameNo-de,name=NameNodeActivity

Hadoop NameNode User Configu-ration

Security Enabled string Attribute SecurityEnabled from Bean Hadoop:-service=NameNo-de,name=NameNodeStatus

Hadoop NameNode Relationships Cluster Parents string List of parent Cluster resources

Hadoop NameNode Relationships DataNode Children string List of child DataNode resourc-es

Hadoop NameNode Relationships KVM Virtual Machine Parents


Hadoop NameNode Relationships Nutanix Virtual Machine Parents


Hadoop NameNode Relationships Virtual Machine Parents string List of parent Virtual Machine resources

Hadoop NodeManager

CPU Process CPU Load float Attribute ProcessCpuLoad from Bean java.lang:type=Operat-ingSystem

Hadoop NodeManager

CPU System CPU Load float Attribute SystemCpuLoad from Bean java.lang:type=Operat-ingSystem

Hadoop NodeManager

CPU Threads In BLOCKED State


Hadoop NodeManager

CPU Threads In NEW State integer Attribute ThreadsNew from Bean Hadoop:service=\w+,name=JvmMetrics

Hadoop NodeManager

CPU Threads In RUNNABLE State


Hadoop NodeManager

CPU Threads In TERMINATED State


Hadoop NodeManager

CPU Threads In TIMED_WAITING State


Hadoop NodeManager

CPU Threads In WAITING State


Hadoop NodeManager

CPU Virtual Cores Allocated integer Attribute AllocatedVCores from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics

Hadoop NodeManager

CPU Virtual Cores Allocated Ratio

float Virtual Cores Allocated Ratio



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NodeManager

CPU Virtual Cores Available integer Attribute AvailableVCores from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics

Hadoop NodeManager

CPU Virtual Cores Total float Virtual Cores Total

Hadoop NodeManager

Details Container Launch Duration Average Time

float Attribute ContainerLaunch-DurationAvgTime from Bean Hadoop:service=NodeMan-ager,name=NodeManagerMet-rics

Hadoop NodeManager

Details Container Launch Duration Operations

integer Attribute ContainerLaunch-DurationNumOps from Bean Hadoop:service=NodeMan-ager,name=NodeManagerMet-rics

Hadoop NodeManager

Details Containers Allocated integer Attribute AllocatedContainers from Bean Hadoop:service=No-deManager,name=NodeMana-gerMetrics

Hadoop NodeManager

Details Containers Completed integer Attribute ContainersCompleted from Bean Hadoop:service=No-deManager,name=NodeMana-gerMetrics

Hadoop NodeManager

Details Containers Completed Diff

integer Containers Completed Diff

Hadoop NodeManager

Details Containers Failed integer Attribute ContainersFailed from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics

Hadoop NodeManager

Details Containers Failed Diff integer Containers Failed Diff

Hadoop NodeManager

Details Containers Initializing integer Attribute ContainersIniting from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics

Hadoop NodeManager

Details Containers Killed integer Attribute ContainersKilled from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics

Hadoop NodeManager

Details Containers Killed Diff integer Containers Killed Diff

Hadoop NodeManager

Details Containers Launched integer Attribute ContainersLaunched from Bean Hadoop:service=No-deManager,name=NodeMana-gerMetrics

Hadoop NodeManager

Details Containers Launched Diff

integer Containers Launched Diff



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NodeManager

Details Containers Running integer Attribute ContainersRunning from Bean Hadoop:service=No-deManager,name=NodeMana-gerMetrics

Hadoop NodeManager

Details JVM Version string Attribute SystemProperties from Bean java.lang:type=Run-time

Hadoop NodeManager

Details Metric Endpoint string Metric Endpoint

Hadoop NodeManager

Details OS Name string Attribute Name from Bean java.lang:type=OperatingSystem

Hadoop NodeManager

Details OS Version string Attribute Version from Bean java.lang:type=OperatingSys-tem

Hadoop NodeManager

Details Tag Hostname string Attribute tag.Hostname from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Details Total ERROR Log Messages


Hadoop NodeManager

Details Total FATAL Log Messages


Hadoop NodeManager

Details Total INFO Log Messages


Hadoop NodeManager

Details Total WARN Log Messages


Hadoop NodeManager

Memory Current Heap Memory Committed


Hadoop NodeManager

Memory Current Heap Memory Used


Hadoop NodeManager

Memory Current Non-heap Memory Committed


Hadoop NodeManager

Memory Current Non-heap Memory Used


Hadoop NodeManager

Memory Free Physical Memory float Attribute FreePhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem

Hadoop NodeManager

Memory Garbage Collection Count




RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NodeManager

Memory Garbage Collection Count Mark Sweep Compact


Hadoop NodeManager

Memory Garbage Collection Time


Hadoop NodeManager

Memory Garbage Collection Time Mark Sweep Compact


Hadoop NodeManager

Memory Maximum Heap Memory Size


Hadoop NodeManager

Memory Maximum Memory Size float Attribute MemMaxM from Bean Hadoop:service=\w+,name=-JvmMetrics

Hadoop NodeManager

Memory Maximum Non-heap Memory Size


Hadoop NodeManager

Memory Memory Allocated float Attribute AllocatedGB from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics

Hadoop NodeManager

Memory Memory Allocated Ratio float Memory Allocated Ratio

Hadoop NodeManager

Memory Memory Available float Attribute AvailableGB from Bean Hadoop:service=NodeM-anager,name=NodeManager-Metrics

Hadoop NodeManager

Memory Total Physical Memory float Attribute TotalPhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem

Hadoop NodeManager

Memory Used Physical Memory float Used Physical Memory

Hadoop NodeManager


Hadoop NodeManager

Status Node Status string Node Status

Hadoop NodeManager

Status Power State string Power State

Hadoop NodeManager

Uncategorized Group Resolution Average Time


Hadoop NodeManager

Uncategorized Group Resolutions integer Attribute GetGroupsNumOps from Bean Hadoop:service=\w+,name=UgiMetrics



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NodeManager

Uncategorized Kerberos Login Failure Average Time


Hadoop NodeManager

Uncategorized Kerberos Login Failures integer Attribute LoginFailureNumOps from Bean Hadoop:service=\w+,name=UgiMetrics

Hadoop NodeManager

Uncategorized Kerberos Login Success Average Time


Hadoop NodeManager

Uncategorized Kerberos Login Successes


Hadoop NodeManager

Uncategorized Publish Average Time float Attribute PublishAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Uncategorized Publish Operations integer Attribute PublishNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Uncategorized Publishes Dropped integer Attribute DroppedPubAll from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Uncategorized Sinks Total integer Attribute NumAllSinks from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Uncategorized Snapshot Average Time float Attribute SnapshotAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Uncategorized Snapshot Operations integer Attribute SnapshotNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Uncategorized Sources Active integer Attribute NumActiveSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Uncategorized Sources Total integer Attribute NumAllSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats

Hadoop NodeManager

Relationships KVM Virtual Machine Parents


Hadoop NodeManager

Relationships Nutanix Virtual Machine Parents


Hadoop NodeManager

Relationships ResourceManager Parents

string List of parent ResourceManager resources



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE


Hadoop NodeManager

Relationships Virtual Machine Parents string List of parent Virtual Machine resources

Hadoop ResourceManager

CPU Process CPU Load float Attribute ProcessCpuLoad from Bean java.lang:type=Operat-ingSystem


CPU System CPU Load float Attribute SystemCpuLoad from Bean java.lang:type=Operat-ingSystem


CPU Threads In BLOCKED State



CPU Threads In NEW State integer Attribute ThreadsNew from Bean Hadoop:service=\w+,name=JvmMetrics


CPU Threads In RUNNABLE State



CPU Threads In TERMINATED State



CPU Threads In TIMED_WAITING State



CPU Threads In WAITING State



Details Active Nodes string Isolated hostnames in LiveNodeManagers entry from Bean Hadoop:service=Re-sourceManager,name=RMN-MInfo


Details Application Master Launch Delay Average Time

float Attribute AMLaunchDelayAvg-Time from Bean Hadoop:ser-vice=ResourceManager,name=-ClusterMetrics


Details Application Master Launch Delay Operations

integer Attribute AMLaunchDelayNu-mOps from Bean Hadoop:ser-vice=ResourceManager,name=-ClusterMetrics


Details Application Master Register Delay Average Time

float Attribute AMRegisterDelayAvg-Time from Bean Hadoop:ser-vice=ResourceManager,name=-ClusterMetrics


Details Application Master Register Delay Operations

integer Attribute AMRegisterDelayNu-mOps from Bean Hadoop:ser-vice=ResourceManager,name=-ClusterMetrics



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE



Details Applications Active integer Attribute ActiveApplications from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root


Details Applications Completed integer Attribute AppsCompleted from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root


Details Applications Failed integer Attribute AppsFailed from Bean Hadoop:service=ResourceMan-ager,name=QueueMetrics,q0=-root


Details Applications Killed integer Attribute AppsKilled from Bean Hadoop:service=ResourceMan-ager,name=QueueMetrics,q0=-root


Details Applications Pending integer Attribute AppsPending from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root


Details Applications Running integer Attribute AppsRunning from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root


Details Applications Submitted integer Attribute AppsSubmitted from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root


Details Apps Completed Diff integer Apps Completed Diff


Details Apps Failed Diff integer Apps Failed Diff


Details Apps Killed Diff integer Apps Killed Diff


Details JVM Version string Attribute SystemProperties from Bean java.lang:type=Run-time


Details Metric Endpoint string Metric Endpoint


Details OS Name string Attribute Name from Bean java.lang:type=OperatingSystem


Details OS Version string Attribute Version from Bean java.lang:type=OperatingSys-tem


Details Tag Hostname string Attribute tag.Hostname from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE



Details Total ERROR Log Messages



Details Total FATAL Log Messages



Details Total INFO Log Messages



Details Total WARN Log Messages



Details Users Active integer Attribute ActiveUsers from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root


Memory Current Heap Memory Committed



Memory Current Heap Memory Used



Memory Current Non-heap Memory Committed



Memory Current Non-heap Memory Used



Memory Free Physical Memory float Attribute FreePhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem


Memory Garbage Collection Count



Memory Garbage Collection Count Mark Sweep Compact



Memory Garbage Collection Time



Memory Garbage Collection Time Mark Sweep Compact



Memory Maximum Heap Memory Size




RESOURCE ATTRIBUTE

ATTRIBUTE TYPE



Memory Maximum Memory Size float Attribute MemMaxM from Bean Hadoop:service=\w+,name=-JvmMetrics


Memory Maximum Non-heap Memory Size



Memory Queue Memory Allocated

float Attribute AllocatedMB from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root


Memory Queue Memory Available

float Attribute AvailableMB from Bean Hadoop:service=Re-sourceManager,name=Queue-Metrics,q0=root


Memory Total Physical Memory float Attribute TotalPhysicalMemo-rySize from Bean java.lang:-type=OperatingSystem






Status High Availability Failover Occurred

string High Availability Failover Oc-curred


Status High Availability State string High Availability State


Status Node Status string Node Status


Status NodeManagers Active integer Attribute NumActiveNMs from Bean Hadoop:service=Re-sourceManager,name=Cluster-Metrics


Status NodeManagers Decommissioned

integer Attribute NumDecommis-sionedNMs from Bean Ha-doop:service=ResourceMan-ager,name=ClusterMetrics


Status NodeManagers Lost integer Attribute NumLostNMs from Bean Hadoop:service=Re-sourceManager,name=Cluster-Metrics


Status NodeManagers Rebooted

integer Attribute NumRebootedNMs from Bean Hadoop:service=Re-sourceManager,name=Cluster-Metrics


Status NodeManagers Unhealthy

integer Attribute NumUnhealthyNMs from Bean Hadoop:service=Re-sourceManager,name=Cluster-Metrics


Status Power State string Power State



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE



Uncategorized Group Resolution Average Time



Uncategorized Group Resolutions integer Attribute GetGroupsNumOps from Bean Hadoop:service=\w+,name=UgiMetrics


Uncategorized Kerberos Login Failure Average Time



Uncategorized Kerberos Login Failures integer Attribute LoginFailureNumOps from Bean Hadoop:service=\w+,name=UgiMetrics


Uncategorized Kerberos Login Success Average Time



Uncategorized Kerberos Login Successes



Uncategorized Publish Average Time float Attribute PublishAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats


Uncategorized Publish Operations integer Attribute PublishNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats


Uncategorized Publishes Dropped integer Attribute DroppedPubAll from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats


Uncategorized Sinks Total integer Attribute NumAllSinks from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats


Uncategorized Snapshot Average Time float Attribute SnapshotAvgTime from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats


Uncategorized Snapshot Operations integer Attribute SnapshotNumOps from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats


Uncategorized Sources Active integer Attribute NumActiveSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats


Uncategorized Sources Total integer Attribute NumAllSources from Bean Hadoop:service=\w+,name=MetricsSystem,sub-=Stats



RESOURCE ATTRIBUTE

ATTRIBUTE TYPE



Relationships Cluster Parents string List of parent Cluster resources


Relationships KVM Virtual Machine Parents



Relationships NodeManager Children string List of child NodeManager resources


Relationships Nutanix Virtual Machine Parents



Relationships Virtual Machine Parents string List of parent Virtual Machine resources

10. Appendix II: AlertsThe vROps Management Pack for Apache Hadoop creates alerts based on various symptoms that it detects in the environment. See the table below for details regarding each alert.

Table 2: Management Pack Alerts

NAME DESCRIPTION SYMPTOM RECOMMENDATION

Node Managers Unhealthy Immediate

Node Manager(s) have failed YARN health checks.

Node Managers Unhealthy Check that NodeManagers have adequate disk space available.

Node Managers Unhealthy Critical

Node Manager(s) have failed YARN health checks.

Node Managers Unhealthy Check that NodeManagers have adequate disk space available.

NameNode High Availability State Changed

NameNode is now the active NameNode.

NameNode High Availability Failover Occurred

If unplanned, check the status of the previously active NameNode.

NameNode Missing Blocks Blocks missing. NameNode may be unhealthy.

NameNode Missing Blocks Check for NameNode in maintenance.

NameNode Unreachable NameNode is unreachable. NameNode Unreachable Check the NameNode to ensure it is functional.

NameNode Volume Failures

At least one volume has failed.


Replace volume or NameNode to prevent data loss.


At least one volume has failed.


Replace volume or NameNode to prevent data loss.

NameNode Dead DataNodes

At least one DataNode is dead.

NameNode Number of DataNodes Dead

Replace DataNode to prevent data loss.

DataNode Used Capacity Used disk capacity threshold exceeded.

DataNode Used Capacity Add disks to DataNode.

DataNode Unreachable DataNode is unreachable. DataNode Unreachable Check the DataNode to ensure it is functional.

DataNode Dead DataNode is Dead. DataNode Dead Check the DataNode to ensure it is functional.


NAME DESCRIPTION SYMPTOM RECOMMENDATION

DataNode Decommissioned

DataNode is Decommissioned.

DataNode Decommissioned

Check the DataNode to ensure it is functional.

ResourceManager Unreachable

ResourceManager is unreachable

ResourceManager Unreachable

Check the ResourceManager to ensure it is functional.

ResourceManager Used Memory

Used disk capacity threshold exceeded.


Add DataNodes or disks to existing DataNodes.


Used disk capacity threshold exceeded.


Add DataNodes or disks to existing DataNodes.

ResourceManager High Availability State Changed

ResourceManager is now the active ResourceManager.

ResourceManager High Availability Failover Occurred

If unplanned, check the status of the previously active ResourceManager.

NodeManager Unreachable

NodeManager is unreachable.

NodeManager Unreachable

Check the NodeManager to ensure it is functional.

11. Appendix III: Capacity DefinitionsThe Management Pack for Apache Hadoop uses the following capacity definitions, which help determine the value of Analysis Badges for Apache Hadoop virtual machines and host systems within vRealize Operations (refer to section “7. Analysis Badges”).

Table 3: Capacity Definitions

CONTAINER USE IN WORKLOAD?

Apache Hadoop Name Node

vRealize Calculated Disk Capacity yes

vRealize Calculated OS Memory Capacity yes

Apache Hadoop Data Node

vRealize Calculated Disk Capacity yes


Apache Hadoop Resource Manager


Apache Hadoop Node Manager


vRealize Calculated VCores Capacity yes

You can find the most up-to-date technical documentation on the Blue Medora support site at: http://support.bluemedora.com.

The Blue Medora website also provides the latest product updates. If you have comments about this documentation, submit your feedback to: [email protected].

Copyright © 2017 Blue Medora Inc. All rights reserved. U.S. and international copyright and intellectual property laws protect this product. Blue Medora is a registered trademark or trademark of Blue Medora in the United States and/or other jurisdictions.

The Hadoop name (including Apache Hadoop) and logo are trademarks or registered trademarks of the Apache Hadoop project in the United States and/or other jurisdictions. All other marks and names mentioned herein may be trademarks of their respective companies.

Blue Medora3225 N Evergreen Dr. NE Suite 103Grand Rapids, MI 49525

www.bluemedora.com

http://bluemedora.com

VMWARE VREALIZE OPERATIONS MANAGEMENT PACK FOR Apache Hadoop · 3 Blue Medora VMware vRealize...

Documents

Transcript of VMWARE VREALIZE OPERATIONS MANAGEMENT PACK FOR Apache Hadoop · 3 Blue Medora VMware vRealize...