購入する または契約更新する
購入する または契約更新する
キャンセル
提案をオンにする
自動提案では、入力時に可能な一致が提案されるので検索結果を素早く絞り込むことができます。
次の結果を表示 
次の代わりに検索 
もしかして: 
cancel
新しい記事を作成する
1021
閲覧回数
2
いいね！
0
コメント

[HyperFlex] Hypercheck : Health & Pre-Upgrade チェック ツール (HX 4.5 以降)

yusnakan
Cisco Employee
Cisco Employee

‎2023-04-28 05:42 PM

 

 

 

はじめに

本ドキュメントは、Hypercheck Health & Pre-Upgrade ツールの使用方法について説明しています。
このツールでは、 HyperFlex の安定性と復旧性を確認できます。
HyperFlex のヘルス状態とアップグレード前チェックの結果を自動的にリストで表示してくれるので、HyperFlexのアップグレードやメンテナンスに必要な時間を削減可能です。

HyperFlex 4.0 以前のバージョンでのチェックツールにつきましては以下のリンクを確認してください。
[HyperFlex] Hypercheck : Health & Pre-Upgrade チェック ツール

  

サポートされる HyperFlex システム 

  • Hyperflex バージョン：4.5、5.0
  • Hyperflex 標準クラスタ
  • Hyperflex 拡張クラスタ
  • Hyperflex エッジクラスタ（2ノード、3ノード、4ノード）
  • VMWare ESXi 上の Hyperflex クラスタでのみサポート

 

使用するケース

  • Hyperflex のアップグレード前
  • メンテナンスウィンドウの前後の Hyperflex ヘルスチェック
  • 障害が発生したドライブ/ディスクを特定する
  • Cisco TAC と連携している場合
  • プロアクティブなヘルスチェックをいつでも利用可能

  

使用方法

HyperFlex バージョン 4.5 以降では HyperFlex の機能として Hypercheck が組み込まれております。
従来のバージョンで実施していた [Hyperflex-Hypercheck.zip] のファイルのダウンロードや HyperFlex へのコピーは不要となります。

1. HyperFlex のクラスタ管理 IP (CMIP) を使用して、ストレージコントローラ VM (SCVM) に SSH で接続します。

2. admin でログインをします。

3. ログイン後は hypercheck と入力し実行します。

admin:~$ hypercheck

 

4. プロンプトが表示されたら SCVM の admin, root 権限のパスワードを入力し、次に ESXi ホストの root パスワードを入力します。

admin:~$ hypercheck

                 HX Health Check 4.5.2a

Please enter below info of HX-Cluster:
Enter the HX-Cluster Root Password: 
Enter the HX-Cluster Admin Password: 
Enter the ESX Root Password:

 

5. Hypercheck のチェックを開始します。完了までの時間は、コンバージドノードの数に依存しますが、 3 分から 10 分程度になります。

 

6. Hypercheck で実行されるチェックは以下の通りです。

  • HyperFlex チェック：
    Cluster services check - storfs, stMgr, stNodeMgr サービスのステータスを確認
    Enospc state check - クラスタの容量が閾値以上使用されていないかを確認
    Zookeeper check - Zookeeper が動作しているかを確認
    Exhibitor check - Zookeeper を管理している Exhibitor サービスのステータスを確認
    System Disks Usage - /sda1 と /var/stv と /var/zookeeper が のディスク容量が 80% 以下であるかを確認
    HDD health check - blacklisted になっているディスクがないか確認
    DNS check - DNS の設定と IP 接続性があるかを確認
    vCenter reachability check - vCenter と適切なポートで通信できるかを確認
    Timestamp check - 全ての SCVM の時刻が同じであるかを確認
    NTP sync check - NTP サーバへの接続性と同期されているかを確認
    Check package & versions - SCVM のパッケージとバージョンを確認
    Check Iptables count - iptable の数が SCVM 間で同じであるかを確認
    Cache Disks check - キャッシュディスクの数を確認
    Extra pnodes check - 古いノード情報がないかを確認
    Memory usage check - メモリの使用可能な量が 2GB 以上あるかを確認
    Incidence of OOM in the log file - 過去に Out Of Memory が発生したことがあるかを確認
    Supported vSphere versions - サポートされている ESXi のバージョンを表示
    Check permissions for /tmp - /tmp のアクセス権限が正常であるかを確認
    Check Cluster Policy - クラスタのポリシーを表示
    SED Capable - クラスタで SED を有効可能かを確認
    USB0 check - SED クラスタで USB0 が起動しているかを確認
    SED Enabled - クラスタで SED が有効であるかを確認
    Disk Locked check - SED ディスクがロックされているかを確認
    Check Disk for SMART Failure - SMART エラーがあるかを確認
  • ESXi チェック：
    HX User Account check - HXUserが全てのESXiホストで作成されていて、適切な権限を持っているかを確認
    vMotion enabled check - vMotionネットワークが設定されているかどうかを確認
    Check for ESXI Failback timer - ESXi Failback timer が適切な値になっているかどうかを確認
    Check vmk1 ping to eth1 - ESXi vmk1 と SCVM eth1 の Storageネットワークの接続性を確認
    No extra controller vm folders check - 不要なSCVM用フォルダが作成されていないか確認
    VMware Tools location check - VMware Tools の場所を確認
    vfat Disk Usage check - vfat ディスクの容量を確認

 

7. 正常に終了すると、以下の出力があり、プロンプトに戻ります。

Report Path: /var/log/springpath
Main Report File: Hypercheck_Main_Report_yyyy-mm-dd_hh-mm-ss.txt
Report tar file: Hypercheck_Report_yyyy_mm_dd_hh_mm_ss.tar

Release Notes:
https://www.cisco.com/c/en/us/support/hyperconverged-systems/hyperflex-hx-data-platform-software/products-release-notes-list.html

Upgrade Guides:
https://www.cisco.com/c/en/us/support/hyperconverged-systems/hyperflex-hx-data-platform-software/products-installation-guides-list.html

Note:
1) Hypercheck doesnot perform FAILOVER TEST, so please ensure that the upstream is configured for network connectivity for JUMBO or NORMAL MTU size as needed.


admin:~$

 

8. 以下は、3ノードのコンバージノードの HyperFlex クラスタにおける、 Hypercheck の実行結果例です。

admin:~$ hypercheck

                  HX Health Check 4.5.2a

Please enter below info of HX-Cluster:
Enter the HX-Cluster Root Password: 
Enter the HX-Cluster Admin Password: 
Enter the ESX Root Password:

Cluster Name: JHX2
Cluster Type: DEFAULT_CLUSTER

SSH connection established to HX Node: x.x.x.171
SSH connection established to HX Node: x.x.x.172
SSH connection established to HX Node: x.x.x.173

HX Cluster Nodes:
+--------------+--------------+-----------+---------------------------------+--------------+
| ESXI-IP      | SCVM-IP      | Node Role | ESXI-Version                    | SCVM-Version |
+--------------+--------------+-----------+---------------------------------+--------------+
| x.x.x.169    | x.x.x.173    | STORAGE   | VMware ESXi 6.7.0 U3 (19195723) | 5.0.2a-41731 |
+--------------+--------------+-----------+---------------------------------+--------------+
| x.x.x.167    | x.x.x.171    | STORAGE   | VMware ESXi 6.7.0 U3 (19195723) | 5.0.2a-41731 |
+--------------+--------------+-----------+---------------------------------+--------------+
| x.x.x.168    | x.x.x.172    | STORAGE   | VMware ESXi 6.7.0 U3 (19195723) | 5.0.2a-41731 |
+--------------+--------------+-----------+---------------------------------+--------------+
| x.x.x.178    | None         | COMPUTE   | VMware ESXi 6.7.0 U3 (19195723) | None         |
+--------------+--------------+-----------+---------------------------------+--------------+

SSH connection established to ESX Host: x.x.x.169
SSH connection established to ESX Host: x.x.x.167
SSH connection established to ESX Host: x.x.x.168

HX Controller: x.x.x.171
Cluster services check      [########################] COMPLETED
ZooKeeper & Exhibitor check [########################] COMPLETED
HDD health check            [########################] COMPLETED
Pre-Upgrade Check           [########################] COMPLETED
Network check               [########################] COMPLETED

HX Controller: x.x.x.172
Cluster services check      [########################] COMPLETED
ZooKeeper & Exhibitor check [########################] COMPLETED
HDD health check            [########################] COMPLETED
Pre-Upgrade Check           [########################] COMPLETED
Network check               [########################] COMPLETED

HX Controller: x.x.x.173
Cluster services check      [########################] COMPLETED
ZooKeeper & Exhibitor check [########################] COMPLETED
HDD health check            [########################] COMPLETED
Pre-Upgrade Check           [########################] COMPLETED
Network check               [########################] COMPLETED


HX Controller: x.x.x.171
Test Summary:
+----------------------------------+----------+----------------------------------------------------------------+
| Name                             | Result   | Comments                                                       |
+----------------------------------+----------+----------------------------------------------------------------+
| Cluster services check           | PASS     | Checks storfs, stMgr, sstNodeMgr service running on each node. |
+----------------------------------+----------+----------------------------------------------------------------+
| Enospc state check               | PASS     | Checks if the cluster storage utilization is above threshold.  |
+----------------------------------+----------+----------------------------------------------------------------+
| Zookeeper check                  | PASS     | Checks if Zookeeper service is running.                        |
+----------------------------------+----------+----------------------------------------------------------------+
| Exhibitor check                  | PASS     | Checks if Exhibitor in running.                                |
+----------------------------------+----------+----------------------------------------------------------------+
| System Disks Usage               | PASS     | Checks if /sda1, var/stv and /var/zookeeper is less than 80%.  |
+----------------------------------+----------+----------------------------------------------------------------+
| HDD health check                 | PASS     | Checks if any drive is in blacklisted state.                   |
+----------------------------------+----------+----------------------------------------------------------------+
| DNS check                        | FAIL     | Please verify DNS resolution and connectivity.                 |
+----------------------------------+----------+----------------------------------------------------------------+
| vCenter reachability check       | PASS     | Checks if vCenter is network reachable using PING.             |
+----------------------------------+----------+----------------------------------------------------------------+
| Timestamp check                  | PASS     | Checks if the timestamp is same across all Nodes.              |
+----------------------------------+----------+----------------------------------------------------------------+
| NTP sync check                   | FAIL     | Checks if the NTP is synced with NTP server.                   |
+----------------------------------+----------+----------------------------------------------------------------+
| Check package & versions         | PASS     | Checks for count and version of HX packages on each node.      |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Iptables count             | PASS     | Checks if the IP Table count matches on all nodes.             |
+----------------------------------+----------+----------------------------------------------------------------+
| Cache Disks check                | PASS     | Checks the number of Cache Disks.                              |
+----------------------------------+----------+----------------------------------------------------------------+
| Extra pnodes check               | PASS     | Checks for any stale Node entry.                               |
+----------------------------------+----------+----------------------------------------------------------------+
| Memory usage check               | PASS     | Checks for available memory more than 2GB.                     |
+----------------------------------+----------+----------------------------------------------------------------+
| Incidence of OOM in the log file | PASS     | Checks for any previous incidence of Out Of Memory Condition.  |
+----------------------------------+----------+----------------------------------------------------------------+
| Supported vSphere versions       | 6.5.0-U3 | Prints the supported ESXi versions.                            |
|                                  | 6.7.0-U3 |                                                                |
|                                  | 7.0-U1   |                                                                |
|                                  | 7.0-U2   |                                                                |
|                                  | 7.0-U3   |                                                                |
+----------------------------------+----------+----------------------------------------------------------------+
| Check permissions for /tmp       | PASS     | Checks if the /tmp permissions are set correctly.              |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Cluster Policy             | Lenient  | Checks the Configured Cluster Policy                           |
+----------------------------------+----------+----------------------------------------------------------------+
| SED Capable                      | YES      | Checks if the cluster is SED Capable.                          |
+----------------------------------+----------+----------------------------------------------------------------+
| USB0 check                       | PASS     | Checks for USB0 in SED clusters.                               |
+----------------------------------+----------+----------------------------------------------------------------+
| SED Enabled                      | YES      | Checks if the cluster is SED Enabled.                          |
+----------------------------------+----------+----------------------------------------------------------------+
| Disk Locked check                | FAIL     | Checks if any SED disk is locked.                              |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Disk for SMART Failure     | PASS     | Checking Disk for SMART Failure                                |
+----------------------------------+----------+----------------------------------------------------------------+

HX Controller: x.x.x.172
Test Summary:
+----------------------------------+----------+----------------------------------------------------------------+
| Name                             | Result   | Comments                                                       |
+----------------------------------+----------+----------------------------------------------------------------+
| Cluster services check           | PASS     | Checks storfs, stMgr, sstNodeMgr service running on each node. |
+----------------------------------+----------+----------------------------------------------------------------+
| Enospc state check               | PASS     | Checks if the cluster storage utilization is above threshold.  |
+----------------------------------+----------+----------------------------------------------------------------+
| Zookeeper check                  | PASS     | Checks if Zookeeper service is running.                        |
+----------------------------------+----------+----------------------------------------------------------------+
| Exhibitor check                  | PASS     | Checks if Exhibitor in running.                                |
+----------------------------------+----------+----------------------------------------------------------------+
| System Disks Usage               | PASS     | Checks if /sda1, var/stv and /var/zookeeper is less than 80%.  |
+----------------------------------+----------+----------------------------------------------------------------+
| HDD health check                 | PASS     | Checks if any drive is in blacklisted state.                   |
+----------------------------------+----------+----------------------------------------------------------------+
| DNS check                        | FAIL     | Please verify DNS resolution and connectivity.                 |
+----------------------------------+----------+----------------------------------------------------------------+
| vCenter reachability check       | PASS     | Checks if vCenter is network reachable using PING.             |
+----------------------------------+----------+----------------------------------------------------------------+
| Timestamp check                  | PASS     | Checks if the timestamp is same across all Nodes.              |
+----------------------------------+----------+----------------------------------------------------------------+
| NTP sync check                   | FAIL     | Checks if the NTP is synced with NTP server.                   |
+----------------------------------+----------+----------------------------------------------------------------+
| Check package & versions         | PASS     | Checks for count and version of HX packages on each node.      |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Iptables count             | PASS     | Checks if the IP Table count matches on all nodes.             |
+----------------------------------+----------+----------------------------------------------------------------+
| Cache Disks check                | PASS     | Checks the number of Cache Disks.                              |
+----------------------------------+----------+----------------------------------------------------------------+
| Extra pnodes check               | PASS     | Checks for any stale Node entry.                               |
+----------------------------------+----------+----------------------------------------------------------------+
| Memory usage check               | PASS     | Checks for available memory more than 2GB.                     |
+----------------------------------+----------+----------------------------------------------------------------+
| Incidence of OOM in the log file | PASS     | Checks for any previous incidence of Out Of Memory Condition.  |
+----------------------------------+----------+----------------------------------------------------------------+
| Supported vSphere versions       | 6.5.0-U3 | Prints the supported ESXi versions.                            |
|                                  | 6.7.0-U3 |                                                                |
|                                  | 7.0-U1   |                                                                |
|                                  | 7.0-U2   |                                                                |
|                                  | 7.0-U3   |                                                                |
+----------------------------------+----------+----------------------------------------------------------------+
| Check permissions for /tmp       | PASS     | Checks if the /tmp permissions are set correctly.              |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Cluster Policy             | Lenient  | Checks the Configured Cluster Policy                           |
+----------------------------------+----------+----------------------------------------------------------------+
| SED Capable                      | YES      | Checks if the cluster is SED Capable.                          |
+----------------------------------+----------+----------------------------------------------------------------+
| USB0 check                       | PASS     | Checks for USB0 in SED clusters.                               |
+----------------------------------+----------+----------------------------------------------------------------+
| SED Enabled                      | YES      | Checks if the cluster is SED Enabled.                          |
+----------------------------------+----------+----------------------------------------------------------------+
| Disk Locked check                | FAIL     | Checks if any SED disk is locked.                              |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Disk for SMART Failure     | PASS     | Checking Disk for SMART Failure                                |
+----------------------------------+----------+----------------------------------------------------------------+

HX Controller: x.x.x.173
Test Summary:
+----------------------------------+----------+----------------------------------------------------------------+
| Name                             | Result   | Comments                                                       |
+----------------------------------+----------+----------------------------------------------------------------+
| Cluster services check           | PASS     | Checks storfs, stMgr, sstNodeMgr service running on each node. |
+----------------------------------+----------+----------------------------------------------------------------+
| Enospc state check               | PASS     | Checks if the cluster storage utilization is above threshold.  |
+----------------------------------+----------+----------------------------------------------------------------+
| Zookeeper check                  | PASS     | Checks if Zookeeper service is running.                        |
+----------------------------------+----------+----------------------------------------------------------------+
| Exhibitor check                  | PASS     | Checks if Exhibitor in running.                                |
+----------------------------------+----------+----------------------------------------------------------------+
| System Disks Usage               | PASS     | Checks if /sda1, var/stv and /var/zookeeper is less than 80%.  |
+----------------------------------+----------+----------------------------------------------------------------+
| HDD health check                 | PASS     | Checks if any drive is in blacklisted state.                   |
+----------------------------------+----------+----------------------------------------------------------------+
| DNS check                        | FAIL     | Please verify DNS resolution and connectivity.                 |
+----------------------------------+----------+----------------------------------------------------------------+
| vCenter reachability check       | PASS     | Checks if vCenter is network reachable using PING.             |
+----------------------------------+----------+----------------------------------------------------------------+
| Timestamp check                  | PASS     | Checks if the timestamp is same across all Nodes.              |
+----------------------------------+----------+----------------------------------------------------------------+
| NTP sync check                   | FAIL     | Checks if the NTP is synced with NTP server.                   |
+----------------------------------+----------+----------------------------------------------------------------+
| Check package & versions         | PASS     | Checks for count and version of HX packages on each node.      |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Iptables count             | PASS     | Checks if the IP Table count matches on all nodes.             |
+----------------------------------+----------+----------------------------------------------------------------+
| Cache Disks check                | PASS     | Checks the number of Cache Disks.                              |
+----------------------------------+----------+----------------------------------------------------------------+
| Extra pnodes check               | PASS     | Checks for any stale Node entry.                               |
+----------------------------------+----------+----------------------------------------------------------------+
| Memory usage check               | PASS     | Checks for available memory more than 2GB.                     |
+----------------------------------+----------+----------------------------------------------------------------+
| Incidence of OOM in the log file | PASS     | Checks for any previous incidence of Out Of Memory Condition.  |
+----------------------------------+----------+----------------------------------------------------------------+
| Supported vSphere versions       | 6.5.0-U3 | Prints the supported ESXi versions.                            |
|                                  | 6.7.0-U3 |                                                                |
|                                  | 7.0-U1   |                                                                |
|                                  | 7.0-U2   |                                                                |
|                                  | 7.0-U3   |                                                                |
+----------------------------------+----------+----------------------------------------------------------------+
| Check permissions for /tmp       | PASS     | Checks if the /tmp permissions are set correctly.              |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Cluster Policy             | Lenient  | Checks the Configured Cluster Policy                           |
+----------------------------------+----------+----------------------------------------------------------------+
| SED Capable                      | YES      | Checks if the cluster is SED Capable.                          |
+----------------------------------+----------+----------------------------------------------------------------+
| USB0 check                       | PASS     | Checks for USB0 in SED clusters.                               |
+----------------------------------+----------+----------------------------------------------------------------+
| SED Enabled                      | YES      | Checks if the cluster is SED Enabled.                          |
+----------------------------------+----------+----------------------------------------------------------------+
| Disk Locked check                | FAIL     | Checks if any SED disk is locked.                              |
+----------------------------------+----------+----------------------------------------------------------------+
| Check Disk for SMART Failure     | PASS     | Checking Disk for SMART Failure                                |
+----------------------------------+----------+----------------------------------------------------------------+

################################################################################
Network check:
################################################################################

ESX vmk0: x.x.x.167, x.x.x.168, x.x.x.169

ESX vmk1: x.x.x.167, x.x.x.168, x.x.x.169

SCVM eth0: x.x.x.171, x.x.x.172, x.x.x.173

SCVM eth1: x.x.x.171, x.x.x.172, x.x.x.173

ESX Host: x.x.x.167
+--------------------------------------+--------+-------------------------------------------------+
| Name                                 | Result | Comments                                        |
+--------------------------------------+--------+-------------------------------------------------+
| HX User Account check                | PASS   | Checks if HXUSER is present.                    |
+--------------------------------------+--------+-------------------------------------------------+
| vMotion enabled check                | PASS   | Checks if vMotion is enabled on the host.       |
+--------------------------------------+--------+-------------------------------------------------+
| Check for ESXI Failback timer        | PASS   | Checks for ESXi FAILBACK timer set to 30000ms.  |
+--------------------------------------+--------+-------------------------------------------------+
| Check vmk1 ping to eth1              | PASS   | Checks Network between ESXi vmk1 and SCVM eth1. |
+--------------------------------------+--------+-------------------------------------------------+
| No extra controller vm folders check | PASS   | Checks for duplicate Controller SCVM Folders.   |
+--------------------------------------+--------+-------------------------------------------------+
| VMware Tools location check          | PASS   | Checks for Non default VMware Tools location.   |
+--------------------------------------+--------+-------------------------------------------------+
| vfat Disk Usage check                | PASS   | Checks for vfat Disk Usage.                     |
+--------------------------------------+--------+-------------------------------------------------+

ESX Host: x.x.x.168
+--------------------------------------+--------+-------------------------------------------------+
| Name                                 | Result | Comments                                        |
+--------------------------------------+--------+-------------------------------------------------+
| HX User Account check                | PASS   | Checks if HXUSER is present.                    |
+--------------------------------------+--------+-------------------------------------------------+
| vMotion enabled check                | PASS   | Checks if vMotion is enabled on the host.       |
+--------------------------------------+--------+-------------------------------------------------+
| Check for ESXI Failback timer        | PASS   | Checks for ESXi FAILBACK timer set to 30000ms.  |
+--------------------------------------+--------+-------------------------------------------------+
| Check vmk1 ping to eth1              | PASS   | Checks Network between ESXi vmk1 and SCVM eth1. |
+--------------------------------------+--------+-------------------------------------------------+
| No extra controller vm folders check | PASS   | Checks for duplicate Controller SCVM Folders.   |
+--------------------------------------+--------+-------------------------------------------------+
| VMware Tools location check          | PASS   | Checks for Non default VMware Tools location.   |
+--------------------------------------+--------+-------------------------------------------------+
| vfat Disk Usage check                | PASS   | Checks for vfat Disk Usage.                     |
+--------------------------------------+--------+-------------------------------------------------+

ESX Host: x.x.x.169
+--------------------------------------+--------+-------------------------------------------------+
| Name                                 | Result | Comments                                        |
+--------------------------------------+--------+-------------------------------------------------+
| HX User Account check                | PASS   | Checks if HXUSER is present.                    |
+--------------------------------------+--------+-------------------------------------------------+
| vMotion enabled check                | PASS   | Checks if vMotion is enabled on the host.       |
+--------------------------------------+--------+-------------------------------------------------+
| Check for ESXI Failback timer        | PASS   | Checks for ESXi FAILBACK timer set to 30000ms.  |
+--------------------------------------+--------+-------------------------------------------------+
| Check vmk1 ping to eth1              | PASS   | Checks Network between ESXi vmk1 and SCVM eth1. |
+--------------------------------------+--------+-------------------------------------------------+
| No extra controller vm folders check | PASS   | Checks for duplicate Controller SCVM Folders.   |
+--------------------------------------+--------+-------------------------------------------------+
| VMware Tools location check          | PASS   | Checks for Non default VMware Tools location.   |
+--------------------------------------+--------+-------------------------------------------------+
| vfat Disk Usage check                | PASS   | Checks for vfat Disk Usage.                     |
+--------------------------------------+--------+-------------------------------------------------+

ESX Host: x.x.x.178
+--------------------------------------+--------+-------------------------------------------------+
| Name                                 | Result | Comments                                        |
+--------------------------------------+--------+-------------------------------------------------+
| HX User Account check                | PASS   | Checks if HXUSER is present.                    |
+--------------------------------------+--------+-------------------------------------------------+
| vMotion enabled check                | PASS   | Checks if vMotion is enabled on the host.       |
+--------------------------------------+--------+-------------------------------------------------+
| Check for ESXI Failback timer        | PASS   | Checks for ESXi FAILBACK timer set to 30000ms.  |
+--------------------------------------+--------+-------------------------------------------------+
| Check vmk1 ping to eth1              | PASS   | Checks Network between ESXi vmk1 and SCVM eth1. |
+--------------------------------------+--------+-------------------------------------------------+
| No extra controller vm folders check | PASS   | Checks for duplicate Controller SCVM Folders.   |
+--------------------------------------+--------+-------------------------------------------------+
| VMware Tools location check          | PASS   | Checks for Non default VMware Tools location.   |
+--------------------------------------+--------+-------------------------------------------------+
| vfat Disk Usage check                | PASS   | Checks for vfat Disk Usage.                     |
+--------------------------------------+--------+-------------------------------------------------+

Report Path: /var/log/springpath
Main Report File: Hypercheck_Main_Report_yyyy-mm-dd_hh-mm-ss.txt
Report tar file: Hypercheck_Report_yyyy_mm_dd_hh_mm_ss.tar

Release Notes:
https://www.cisco.com/c/en/us/support/hyperconverged-systems/hyperflex-hx-data-platform-software/products-release-notes-list.html

Upgrade Guides:
https://www.cisco.com/c/en/us/support/hyperconverged-systems/hyperflex-hx-data-platform-software/products-installation-guides-list.html

Note:
1) Hypercheck doesnot perform FAILOVER TEST, so please ensure that the upstream is configured for network connectivity for JUMBO or NORMAL MTU size as needed.

 

パスワード入力失敗

パスワードの入力に失敗すると以下のように出力されます。

・HyperFlex admin パスワード間違い

admin:~$ hypercheck

                 HX Health Check 4.5.2a

Please enter below info of HX-Cluster:
Enter the HX-Cluster Root Password: 
Enter the HX-Cluster Admin Password: 
Enter the ESX Root Password:

Invalid HX admin password
admin:~$

 

・HyperFlex root パスワード間違い

admin:~$ hypercheck

                 HX Health Check 4.5.2a

Please enter below info of HX-Cluster:
Enter the HX-Cluster Root Password: 
Enter the HX-Cluster Admin Password: 
Enter the ESX Root Password: 

Cluster Name: <クラスタ名>
Cluster Type: <クラスタタイプ>

Not able to establish SSH connection to HX Node: xxx.xxx.xxx.xxx
It may be wrong HX root password or SSH is not enabled
admin:~$

 

・ESXi root パスワード間違い

admin:~$ hypercheck

                HX Health Check 4.5.2a

Please enter below info of HX-Cluster:
Enter the HX-Cluster Root Password: 
Enter the HX-Cluster Admin Password: 
Enter the ESX Root Password: 

Cluster Name: <クラスタ名>
Cluster Type: <クラスタタイプ>

Not able to establish SSH connection to HX Node: xxx.xxx.xxx.xxx
Invalid ESX root password
It may be wrong HX root password or SSH is not enabled
admin:~$

 

上記の事象が発生した場合は、再度 hypercheck コマンドを実行し、正しいパスワードを入力してください。

 

Hypercheck 実行後のアクション

  • 全てのテストにパスしていれば、特に問題ありません。
  • もし失敗しているテストがある場合は、TAC にケースオープンする前に、本ドキュメントの最後にリストしている CLI コマンドを実行して、問題を特定します。
  • このツールは、既知の問題に該当しているかどうかを確認していません。従いまして、アップグレードやメンテナンス作業を実行する前に、 HyperFlex のリリースノート、および、アップグレードガイドを確認することを強く推奨します。

 

 

CLI コマンド

全ての SCVM 上で実行
※以下のコマンドは admin 権限での実行する場合のコマンドとなります。

# priv service_status.sh

# sysmtool --ns cluster --cmd enospcinfo

# echo srvr | nc 0 2181

# pidof exhibitor

# stcli disk list --ip <Corresponding ESXi Mgmt IP Address> | grep -B 2 -A 8 blacklisted

# stcli services dns show
この後、表示される DNS Server の IP Address に ping します。

# ping <vCenter IP Address>

# date
全ての SCVM の時刻を比較して、ほぼ同一であることを確認します。

# stcli services ntp show

# stcli cleaner info

# ntpq -p -4

# priv dpkg -l | grep -i springpath | grep -v storfs-support*

# sysmtool --ns disk --cmd list | grep -i blacklisted

# priv iptables -L -n | wc -l

# stcli cluster info

# df -h
/var/stv の使用率が 80% 以上になっていないかを確認します。

# zgrep -i "out of memory" /var/log/springpath/debug-storfs.*

# ping -I eth0 <eth0>
他の全ての SCVM に ping できるかどうかを確認します。

# ping -I eth1 <eth1>
他の全ての SCVM に ping できるかどうかを確認します。

# ls -ld /tmp
権限が読み取り、書き込み、実行権限が付与されていることを確認します。

# stcli cluster info | grep -i 'clusterAccessPolicy:' | head -1

# cat /etc/springpath/sed_capability.conf

# cat /etc/springpath/sed.conf

# cat /var/log/springpath/diskslotmap-v2.txt

# stcli cluster info | grep dataZkIp
この後、表示される Zookeeper の IP Address に ping します。

全てのESXiで実行

# esxcli system account list

# esxcli network firewall ruleset list | grep -i vMotion

# esxcli software vib list| egrep -i 'scvm|stHyper|stfs'

# chkconfig --list | grep -E 'ntpd|hostd|vpxa|stHypervisorSvc|scvmclient|hxctlvm'

# esxcfg-vmknic -l ; confirm that vMotion VMK2 is created

# vmkping -I vmk1 <eth1> of all SCVMs

# cd /vmfs/volumes/Springpath-XXXXXXXXXX
Storage Controller VM を持つフォルダが 1 つだけであることを確認します。

# df -h | grep vfat
ディレクトリに空き容量があることを確認します。

 

参考情報

Hypercheckの実行：Hyperflexヘルス&アップグレード前チェックツール

Getting Started

検索バーにキーワード、フレーズ、または質問を入力し、お探しのものを見つけましょう

シスコ コミュニティをいち早く使いこなしていただけるよう役立つリンクをまとめました。みなさんのジャーニーがより良いものとなるようお手伝いします

Customers Also Viewed These Support Documents