<192.168.88.134> ESTABLISH SSH CONNECTION FOR USER: None
<192.168.88.134> SSH: EXEC ssh -vvv -o ControlMaster=auto -o ControlPersist=30m -o ConnectionAttempts=100 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o ConnectTimeout=10 -o ControlPath=/root/.ansible/cp/9b257611e2 192.168.88.134 ‘/bin/sh -c ‘"’"‘sudo -H -S -n -u root /bin/sh -c ‘"’"’"’"’"’"’"’"‘echo BECOME-SUCCESS-bjczougtuxscbnawnjiqpylpqeqtwlnp ; ETCDCTL_API=3 ETCDCTL_CERT=/etc/ssl/etcd/ssl/admin-node1.pem ETCDCTL_KEY=/etc/ssl/etcd/ssl/admin-node1-key.pem ETCDCTL_CACERT=/etc/ssl/etcd/ssl/ca.pem ETCDCTL_ENDPOINTS=https://192.168.88.134:2379,https://192.168.88.136:2379,https://192.168.88.132:2379 /usr/bin/python’"’"’"’"’"’"’"’"’ && sleep 0’"’"’‘
Escalation succeeded
<192.168.88.134> (1, b’\n{“changed”: true, “end”: “2022-10-30 00:05:27.948153”, “stdout”: “”, “cmd”: “set -o pipefail && /usr/local/bin/etcdctl endpoint --cluster status && /usr/local/bin/etcdctl endpoint --cluster health 2>&1 | grep -v ‘Error: unhealthy cluster’ >/dev/null”, “failed”: true, “delta”: “0:00:05.031535”, “stderr”: “{\“level\”:\“warn\”,\“ts\”:\“2022-10-30T00:05:27.946+0800\”,\“caller\”:\“clientv3/retry_interceptor.go:62\”,\“msg\”:\“retrying of unary invoker failed\”,\“target\”:\“endpoint://client-b257d0cb-42bd-44a8-93e7-6159729e4808/192.168.88.134:2379\”,\“attempt\”:0,\“error\”:\“rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \\\“transport: authentication handshake failed: remote error: tls: bad certificate\\\”\”}\nError: failed to fetch endpoints from etcd cluster member list: context deadline exceeded”, “rc”: 1, “invocation”: {“module_args”: {“creates”: null, “executable”: “/bin/bash”, “_uses_shell”: true, “strip_empty_ends”: true, “_raw_params”: “set -o pipefail && /usr/local/bin/etcdctl endpoint --cluster status && /usr/local/bin/etcdctl endpoint --cluster health 2>&1 | grep -v ‘Error: unhealthy cluster’ >/dev/null”, “removes”: null, “argv”: null, “warn”: true, “chdir”: null, “stdin_add_newline”: true, “stdin”: null}}, “start”: “2022-10-30 00:05:22.916618”, “msg”: “non-zero return code”}\n’, b’OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017\r\ndebug1: Reading configuration data /etc/ssh/ssh_config\r\ndebug1: /etc/ssh/ssh_config line 58: Applying options for *\r\ndebug1: auto-mux: Trying existing master\r\ndebug2: fd 3 setting O_NONBLOCK\r\ndebug2: mux_client_hello_exchange: master version 4\r\ndebug3: mux_client_forwards: request forwardings: 0 local, 0 remote\r\ndebug3: mux_client_request_session: entering\r\ndebug3: mux_client_request_alive: entering\r\ndebug3: mux_client_request_alive: done pid = 61693\r\ndebug3: mux_client_request_session: session request sent\r\ndebug1: mux_client_request_session: master session id: 2\r\ndebug3: mux_client_read_packet: read header failed: Broken pipe\r\ndebug2: Received exit status from master 1\r\n’)
<192.168.88.134> Failed to connect to the host via ssh: OpenSSH_7.4p1, OpenSSL 1.0.2k-fips 26 Jan 2017
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 58: Applying options for *
debug1: auto-mux: Trying existing master
debug2: fd 3 setting O_NONBLOCK
debug2: mux_client_hello_exchange: master version 4
debug3: mux_client_forwards: request forwardings: 0 local, 0 remote
debug3: mux_client_request_session: entering
debug3: mux_client_request_alive: entering
debug3: mux_client_request_alive: done pid = 61693
debug3: mux_client_request_session: session request sent
debug1: mux_client_request_session: master session id: 2
debug3: mux_client_read_packet: read header failed: Broken pipe
debug2: Received exit status from master 1

TASK [Configure | Wait for etcd cluster to be healthy] ********************************************************************************************************************************************************************************************************************************task path: /root/kubespray-2.15.0/roles/etcd/tasks/configure.yml:80
fatal: [node1]: FAILED! => {
“attempts”: 4,
“changed”: false,
“cmd”: “set -o pipefail && /usr/local/bin/etcdctl endpoint --cluster status && /usr/local/bin/etcdctl endpoint --cluster health 2>&1 | grep -v ‘Error: unhealthy cluster’ >/dev/null”,
“delta”: “0:00:05.031535”,
“end”: “2022-10-30 00:05:27.948153”,
“invocation”: {
“module_args”: {
"_raw_params": “set -o pipefail && /usr/local/bin/etcdctl endpoint --cluster status && /usr/local/bin/etcdctl endpoint --cluster health 2>&1 | grep -v ‘Error: unhealthy cluster’ >/dev/null”,
"_uses_shell": true,
“argv”: null,
“chdir”: null,
“creates”: null,
“executable”: “/bin/bash”,
“removes”: null,
“stdin”: null,
“stdin_add_newline”: true,
“strip_empty_ends”: true,
“warn”: true
}
},
“msg”: “non-zero return code”,
“rc”: 1,
“start”: “2022-10-30 00:05:22.916618”,
“stderr”: “{“level”:“warn”,“ts”:“2022-10-30T00:05:27.946+0800”,“caller”:“clientv3/retry_interceptor.go:62”,“msg”:“retrying of unary invoker failed”,“target”:“endpoint://client-b257d0cb-42bd-44a8-93e7-6159729e4808/192.168.88.134:2379”,“attempt”:0,“error”:“rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \“transport: authentication handshake failed: remote error: tls: bad certificate\””}\nError: failed to fetch endpoints from etcd cluster member list: context deadline exceeded”, “stderr_lines”: [
"{“level”:“warn”,“ts”:“2022-10-30T00:05:27.946+0800”,“caller”:“clientv3/retry_interceptor.go:62”,“msg”:“retrying of unary invoker failed”,“target”:“endpoint://client-b257d0cb-42bd-44a8-93e7-6159729e4808/192.168.88.134:2379”,“attempt”:0,“error”:“rpc error: code = DeadlineExceeded desc = latest connection error: connection error: desc = \“transport: authentication handshake failed: remote error: tls: bad certificate\””}",
“Error: failed to fetch endpoints from etcd cluster member list: context deadline exceeded”
],
“stdout”: “”,
“stdout_lines”: []
}

NO MORE HOSTS LEFT ********************************************************************************************************************************************************************************************************************************************************************
PLAY RECAP ****************************************************************************************************************************************************************************************************************************************************************************localhost : ok=1 changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0
node1 : ok=427 changed=6 unreachable=0 failed=1 skipped=427 rescued=0 ignored=0
node2 : ok=400 changed=6 unreachable=0 failed=0 skipped=370 rescued=0 ignored=0
node3 : ok=324 changed=4 unreachable=0 failed=0 skipped=326 rescued=0 ignored=0

Sunday 30 October 2022 00:05:27 +0800 (0:00:46.043) 0:03:52.147 ********

Configure | Wait for etcd cluster to be healthy ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 46.04s
/root/kubespray-2.15.0/roles/etcd/tasks/configure.yml:80 -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
kubernetes/preinstall : Install packages requirements ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 19.77s
/root/kubespray-2.15.0/roles/kubernetes/preinstall/tasks/0070-system-packages.yml:58 -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Gen_certs | Write etcd master certs ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 12.35s
/root/kubespray-2.15.0/roles/etcd/tasks/gen_certs_script.yml:97 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
download_container | Download image if required -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 7.03s
/root/kubespray-2.15.0/roles/download/tasks/download_container.yml:52 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
download_container | Download image if required -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 5.41s
/root/kubespray-2.15.0/roles/download/tasks/download_container.yml:52 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Configure | Check if etcd cluster is healthy ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 5.27s
/root/kubespray-2.15.0/roles/etcd/tasks/configure.yml:2 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
download_container | Download image if required -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 4.64s
/root/kubespray-2.15.0/roles/download/tasks/download_container.yml:52 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Gen_certs | Gather etcd master certs ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 4.40s
/root/kubespray-2.15.0/roles/etcd/tasks/gen_certs_script.yml:73 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
kubernetes/preinstall : Get current calico cluster version --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 3.87s
/root/kubespray-2.15.0/roles/kubernetes/preinstall/tasks/0020-verify-settings.yml:172 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Gather necessary facts --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 3.50s
/root/kubespray-2.15.0/facts.yml:10 --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
download | Download files / images --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2.40s
/root/kubespray-2.15.0/roles/download/tasks/main.yml:26 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
container-engine/crictl : extract_file | Unpacking archive --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2.32s
/root/kubespray-2.15.0/roles/download/tasks/extract_file.yml:2 -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
container-engine/crictl : download_file | Download item ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2.02s
/root/kubespray-2.15.0/roles/download/tasks/download_file.yml:51 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
download_file | Download item -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 1.71s
/root/kubespray-2.15.0/roles/download/tasks/download_file.yml:51 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
download : extract_file | Unpacking archive ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 1.71s
/root/kubespray-2.15.0/roles/download/tasks/extract_file.yml:2 -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
kubernetes/preinstall : Create kubernetes directories -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 1.34s
/root/kubespray-2.15.0/roles/kubernetes/preinstall/tasks/0050-create_directories.yml:2 -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
container-engine/containerd : ensure containerd packages are installed --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 1.24s
/root/kubespray-2.15.0/roles/container-engine/containerd/tasks/main.yml:93 -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
download : extract_file | Unpacking archive ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 1.23s
/root/kubespray-2.15.0/roles/download/tasks/extract_file.yml:2 -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
install | Copy etcd and etcdctl binary from download dir ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 1.18s
/root/kubespray-2.15.0/roles/etcd/tasks/install_host.yml:2 ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
download | Download files / images -------------------------

ps: node1是192.168.88.134，node2是192.168.88.136，node3是192.168.88.132，node1主节点可以ssh免密登录到node2和node3