RCA 48: Unable to Create Virtual Machine on vCenter Server

vCenter:

 

Product: VMware vCenter Server Appliance Version: 6.5.0 Build: 13638625 Release: vCenter Server Appliance 6.5 Update 2g (vCenter Server Appliance 6.5 Update 2g)

Node Type: embedded

Configured Timezone: “Etc/UTC” (+00:00)

Hosts and VMs in Inventory: 6/21

Resource Configuration: CPU: 4 Memory: 16 GB

 

– licensed assets

License Type (6 assets): VMware ESX Server6.0esx.enterprisePlus.cpuPackagecpuPackage

11.11.1.101 | 11.11.1.102 |  11.11.1.103  |  11.11.1.104  |  11.11.1.105 | 11.11.1.106

License Type (1 assets): VMware VirtualCenter Server6.0vc.standard.instanceserver

 

– managed hosts by this vCenter

  HostId   IP           Name (or IP if unset)

  ——   —           ———————

  host-10 11.11.1.101 11.11.1.101

  host-22 11.11.1.102 11.11.1.102

  host-24 11.11.1.103 11.11.1.103

  host-26 11.11.1.104 11.11.1.104

  host-28 11.11.1.105 11.11.1.105

  host-30 11.11.1.106 11.11.1.106

 

 

VM Name: XYZCVcenter

 

VPXD Logs:

 

 

2022-05-10T07:23:14.811Z info vpxd[7F01125CB700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c] [VpxLRO] — BEGIN task-9503 — vm-33 — vim.VirtualMachine.relocate — 52a8cbb4-4263-0302-907e-48d69da23616(526da896-2df8-3ff1-cfc8-0bf79b0f69f4)

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01] [VpxLRO] — BEGIN lro-1546 — — VmprovWorkflow —

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.InvokePrechecks (5%)

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on AutoStartManager

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on CbkServiceMgrMigrateCallback

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on ContextValidator

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on CryptoManager

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on DAS

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on DVS

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on EventEmitter

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on InvtId

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on Iofilter

2022-05-10T07:23:14.813Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on MetadataHandler

2022-05-10T07:23:14.814Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on PbmCallBack

2022-05-10T07:23:14.814Z info vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: PbmFunctionTracer: Entering GetPbmProfileManager

2022-05-10T07:23:14.814Z info vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: PbmFunctionTracer: Entering GetPbmClientAdapter

2022-05-10T07:23:14.814Z info vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: ~PbmFunctionTracer: Leaving  GetPbmClientAdapter

2022-05-10T07:23:14.814Z info vpxd[7F01125CB700] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01] Creating SSL Contexts

2022-05-10T07:23:14.826Z info vpxd[7F01125CB700] [Originator@6876 sub=vpxCrypt opID=l2zto750-4t-h5:70000105-5c-01] Failed to read X509 cert; err: 151441516

2022-05-10T07:23:14.826Z info vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: ConfigGetMaxConnections: ProfileManager max connections are 32

2022-05-10T07:23:15.052Z info vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: ~PbmFunctionTracer: Leaving  GetPbmProfileManager

2022-05-10T07:23:15.052Z info vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: QueryAssociatedProfiles: Query Associated Profiles for 13 objects

2022-05-10T07:23:15.101Z info vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: PreProvisionProcess: Calling pbm PreProvisionProcess

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: PreProvisionProcess: Completed pbm PreProvisionProcess

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on PermissionsHandler

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on PmemValidator

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on VApp

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on ResManager

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on DRM

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on ResourceReservation

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on OCM

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 0 on StorageListeners

2022-05-10T07:23:15.127Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.SelectDestination (1%)

2022-05-10T07:23:15.129Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Datastore changing LocalVC Migrate of XYZCVcenter on vim.HostSystem:host-26(11.11.1.104) with ds ds:///vmfs/volumes/5d4b625e-3883346c-4eed-e26ee8500010/ to vim.HostSystem:host-30(11.11.1.106) with ds ds:///vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/ started

2022-05-10T07:23:15.129Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.CheckCompatibility (1%)

2022-05-10T07:23:15.137Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.ReserveDirectory (5%)

2022-05-10T07:23:15.152Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.ComputeSpecs (1%)

2022-05-10T07:23:15.157Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.InvokeCallbacks (5%)

2022-05-10T07:23:15.157Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on AutoStartManager

2022-05-10T07:23:15.157Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on CbkServiceMgrMigrateCallback

2022-05-10T07:23:15.157Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on ContextValidator

2022-05-10T07:23:15.157Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on CryptoManager

2022-05-10T07:23:15.157Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on DAS

2022-05-10T07:23:15.157Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on DVS

2022-05-10T07:23:15.157Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on EventEmitter

2022-05-10T07:23:15.158Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on InvtId

2022-05-10T07:23:15.158Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on Iofilter

2022-05-10T07:23:15.158Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on MetadataHandler

2022-05-10T07:23:15.158Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on PbmCallBack

2022-05-10T07:23:15.160Z warning vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: FillConfigSpec:  No linked clone disk profiles

2022-05-10T07:23:15.160Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on PermissionsHandler

2022-05-10T07:23:15.160Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on PmemValidator

2022-05-10T07:23:15.160Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on VApp

2022-05-10T07:23:15.160Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on ResManager

2022-05-10T07:23:15.160Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on DRM

2022-05-10T07:23:15.160Z warning vpxd[7F01125CB700] [Originator@6876 sub=drmLogger opID=l2zto750-4t-h5:70000105-5c-01] [VpxdDrmInterface::GetVmotionResSettings] Doing full invocation.

2022-05-10T07:23:15.166Z info vpxd[7F0112C58700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-01] [VpxLRO] — BEGIN lro-1551 —  — DrmExecute —

2022-05-10T07:23:15.171Z info vpxd[7F0112C58700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-01] [VpxLRO] — FINISH lro-1551

2022-05-10T07:23:15.171Z info vpxd[7F0112C58700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-02] [VpxLRO] — BEGIN lro-1552 —  — SpecSyncLRO.Synchronize —

2022-05-10T07:23:15.181Z info vpxd[7F0112C58700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-02] [VpxLRO] — FINISH lro-1552

2022-05-10T07:23:15.182Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on ResourceReservation

2022-05-10T07:23:15.182Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on OCM

2022-05-10T07:23:15.215Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 1 on StorageListeners

2022-05-10T07:23:15.215Z info vpxd[7F01125CB700] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01] Creating SSL Contexts

2022-05-10T07:23:15.481Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.CheckDestinationFiles (5%)

2022-05-10T07:23:15.642Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.CopyVmFiles (66%)

2022-05-10T07:28:01.498Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.CreateDummyVMotionDisks (1%)

2022-05-10T07:28:01.530Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Execute local action vpx.vmprov.CreateDestinationVm (1%)

2022-05-10T07:28:01.659Z error vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Get exception while executing action vpx.vmprov.CreateDestinationVm: N5Vmomi5Fault15InvalidArgument9ExceptionE(vmodl.fault.InvalidArgument)

2022-05-10T07:28:01.662Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Workflow context:

2022-05-10T07:28:01.676Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Undo action vpx.vmprov.CreateDestinationVm

2022-05-10T07:28:01.676Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Done undo action vpx.vmprov.CreateDestinationVm with output:

2022-05-10T07:28:01.679Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Undo action vpx.vmprov.CreateDummyVMotionDisks

2022-05-10T07:28:01.679Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Done undo action vpx.vmprov.CreateDummyVMotionDisks with output:

2022-05-10T07:28:01.681Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Undo action vpx.vmprov.TrackTasks

2022-05-10T07:28:01.682Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Done undo action vpx.vmprov.TrackTasks with output:

2022-05-10T07:28:01.685Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Undo action vpx.vmprov.CopyVmFiles

2022-05-10T07:28:01.685Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Done undo action vpx.vmprov.CopyVmFiles with output:

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Undo action vpx.vmprov.InvokeCallbacks

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on AutoStartManager

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on CbkServiceMgrMigrateCallback

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on ContextValidator

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on CryptoManager

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on DAS

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on DVS

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on EventEmitter

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on InvtId

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on Iofilter

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on MetadataHandler

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on PbmCallBack

2022-05-10T07:28:01.689Z warning vpxd[7F01125CB700] [Originator@6876 sub=pbm opID=l2zto750-4t-h5:70000105-5c-01] PBMCallback: ShouldSkipPostMigrateCallback: post migrate callback is skipped – VM migration failed

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on PermissionsHandler

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on PmemValidator

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on VApp

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on ResManager

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on DRM

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=drmLogger opID=l2zto750-4t-h5:70000105-5c-01] [PostInitiateAccounting] for [vim.VirtualMachine:vm-33,XYZCVcenter], success = false, changeHost = true, vmotionResult = (null), srcVmotionResult = (null), returning

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on ResourceReservation

2022-05-10T07:28:01.689Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on OCM

2022-05-10T07:28:02.323Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Invoking callback type 2 on StorageListeners

2022-05-10T07:28:02.323Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Done undo action vpx.vmprov.InvokeCallbacks with output:

2022-05-10T07:28:02.326Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Undo action vpx.vmprov.ReserveDirectory

2022-05-10T07:28:02.328Z info vpxd[7F01125CB700] [Originator@6876 sub=VmProv opID=l2zto750-4t-h5:70000105-5c-01] Done undo action vpx.vmprov.ReserveDirectory with output:

2022-05-10T07:28:02.328Z warning vpxd[7F01125CB700] [Originator@6876 sub=VpxProfiler opID=l2zto750-4t-h5:70000105-5c-01] VpxLro::LroMain [TotalTime] took 287514 ms

2022-05-10T07:28:02.328Z error vpxd[7F01125CB700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01] [VpxLRO] Unexpected Exception: N5Vmomi5Fault15InvalidArgument9ExceptionE(vmodl.fault.InvalidArgument)

2022-05-10T07:28:02.331Z info vpxd[7F01125CB700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01] [VpxLRO] — FINISH lro-1546

2022-05-10T07:28:02.331Z info vpxd[7F01125CB700] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01] [VpxLRO] — ERROR lro-1546 —  — VmprovWorkflow: vmodl.fault.InvalidArgument:

2022-05-10T07:28:02.332Z warning vpxd[7F01201A7700] [Originator@6876 sub=VpxProfiler opID=l2zto750-4t-h5:70000105-5c-01-TaskLoop-64b2ff8e] TaskLoop [TotalTime] took 286680 ms

2022-05-10T07:28:02.333Z info vpxd[7F01125CB700] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c] [VpxLRO] — FINISH task-9503

2022-05-10T07:28:02.333Z info vpxd[7F01125CB700] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c] [VpxLRO] — ERROR task-9503 — vm-33 — vim.VirtualMachine.relocate: vmodl.fault.InvalidArgument:

–> Result:

–> (vmodl.fault.InvalidArgument) {

–>    faultCause = (vmodl.MethodFault) null,

–>    faultMessage = <unset>,

–>    invalidProperty = <unset>

–>    msg = “A specified parameter was not correct: “ 

 

 

Destination ESXi Host:

 

 

VPXA Logs:

 

2022-05-10T07:23:15.128Z info vpxa[5AFD8B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-2d] [VpxLRO] — BEGIN lro-119953 — vpxa — vpxapi.VpxaService.reserveName — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:23:15.128Z verbose vpxa[5AFD8B70] [Originator@6876 sub=vpxaNameReserve opID=l2zto750-4t-h5:70000105-5c-01-2d] [ReserveFileWithGivenRootDir] Directory /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014 is available for use

2022-05-10T07:23:15.135Z verbose vpxa[5AFD8B70] [Originator@6876 sub=vpxaNameReserve opID=l2zto750-4t-h5:70000105-5c-01-2d] [ReserveFileWithGivenRootDir] Reserved directory only, name /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter, stable name /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter

2022-05-10T07:23:15.135Z verbose vpxa[5AFD8B70] [Originator@6876 sub=journal opID=l2zto750-4t-h5:70000105-5c-01-2d] Deleting Journal /var/log/vmware/journal/1652167395.18.

2022-05-10T07:23:15.135Z info vpxa[5AFD8B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-2d] [VpxLRO] — FINISH lro-119953

2022-05-10T07:23:15.163Z info vpxa[8433B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-02-d] [VpxLRO] — BEGIN lro-119954 — vpxa — vpxapi.VpxaService.setConfig — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:23:15.163Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] Setting the VMOverheadGrowthLimit

2022-05-10T07:23:15.164Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] Mem.VMOverheadGrowthLimit already set to 0, ignoring

2022-05-10T07:23:15.164Z verbose vpxa[8433B70] [Originator@6876 sub=vpxaInvtHost opID=l2zto750-4t-h5:70000105-5c-01-02-d] [VpxaInvtHost] Increment master gen. no to (34961): configStatus:refresh config issues

2022-05-10T07:23:15.164Z verbose vpxa[8433B70] [Originator@6876 sub=vpxaMoService opID=l2zto750-4t-h5:70000105-5c-01-02-d] [VpxaHalStatsHostagent::ProcessQuickStatsSpec] Received spec sync for QuickStats collection

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Alarm opID=l2zto750-4t-h5:70000105-5c-01-02-d] [ProcessAlarmSpec] Begin processing.

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Alarm opID=l2zto750-4t-h5:70000105-5c-01-02-d] [ProcessAlarmSpec] No alarm config spec. Continuing.

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=VpxaHalResourcePool opID=l2zto750-4t-h5:70000105-5c-01-02-d] Starting to process resource notifications – new spec sync from vpxa

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=VpxaHalResourcePool opID=l2zto750-4t-h5:70000105-5c-01-02-d] [VpxaHostdSpecSync] Operation is update …

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=VpxaHalResourcePool opID=l2zto750-4t-h5:70000105-5c-01-02-d] [VpxaHostdSpecSync] Copied root values …

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] [PR_629085 TreeNode constructor] added mappping resgroup-8 -> vim.ResourcePool:ha-root-pool

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] [PR_629085 TreeNode constructor] nodeMap = {‘resgroup-8’: ‘_id=resgroup-8:_name=Resources:_remoteMoRef=vim.ResourcePool:ha-root-pool’}

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] [PR_629085 TreeNode constructor] added mappping resgroup-v116 -> vim.ResourcePool:pool0

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] [PR_629085 TreeNode constructor] nodeMap = {‘resgroup-8’: ‘_id=resgroup-8:_name=Resources:_remoteMoRef=vim.ResourcePool:ha-root-pool’, ‘resgroup-v116’: ‘_id=resgroup-v116:_name=XYZC1:_remoteMoRef=vim.ResourcePool:pool0′}

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=ResPoolTree opID=l2zto750-4t-h5:70000105-5c-01-02-d] [IgnoreOverheadLimit] ignoreOverheadLimit (2) = true

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=ResPoolTree opID=l2zto750-4t-h5:70000105-5c-01-02-d] [IgnoreOverheadLimit] ignoreOverheadLimit (3) = false

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=ResPoolTree opID=l2zto750-4t-h5:70000105-5c-01-02-d] [IgnoreOverheadLimit] ignoreOverheadLimit (4) = false

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] [PR_629085 Update] _sourceMap = dstNodeMap, new value = [2] {‘resgroup-8’: ‘_id=resgroup-8:_name=Resources:_remoteMoRef=vim.ResourcePool:ha-root-pool’, ‘resgroup-v116’: ‘_id=resgroup-v116:_name=XYZC1:_remoteMoRef=vim.ResourcePool:pool0′}

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] [PR_629085 UnsetPartners] old _sourceMap = [2] {‘resgroup-8’: ‘_id=resgroup-8:_name=Resources:_remoteMoRef=vim.ResourcePool:ha-root-pool’, ‘resgroup-v116’: ‘_id=resgroup-v116:_name=XYZC1:_remoteMoRef=vim.ResourcePool:pool0′}

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-02-d] [PR_629085 UnsetPartners] new _sourceMap = [2] {‘resgroup-8’: ‘_id=resgroup-8:_name=Resources:_remoteMoRef=vim.ResourcePool:ha-root-pool’, ‘resgroup-v116’: ‘_id=resgroup-v116:_name=XYZC1:_remoteMoRef=vim.ResourcePool:pool0′}

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=VpxaHalResourcePool opID=l2zto750-4t-h5:70000105-5c-01-02-d] [VpxaHostdSpecSync] Generated list of updating operations  …

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=VpxaHalResourcePool opID=l2zto750-4t-h5:70000105-5c-01-02-d] [OverrideTreeOnHostd] try new operations

2022-05-10T07:23:15.169Z verbose vpxa[8433B70] [Originator@6876 sub=VpxaHalResourcePool opID=l2zto750-4t-h5:70000105-5c-01-02-d] [OverrideTreeOnHostd] currOverrideState = 0, application succeeded, exiting…

2022-05-10T07:23:15.169Z info vpxa[8433B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-02-d] [VpxLRO] — FINISH lro-119954

2022-05-10T07:23:15.190Z info vpxa[8244B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-2a] [VpxLRO] — BEGIN lro-119955 — operationCleanupManager — vim.host.OperationCleanupManager.createEntry — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:23:15.190Z verbose vpxa[8244B70] [Originator@6876 sub=proxyManagedObjectImpl opID=l2zto750-4t-h5:70000105-5c-01-2a] [ProxyManagedObjectImpl::DispatchAsync] Invoking vim.host.OperationCleanupManager::createEntry with 1 params

2022-05-10T07:23:15.204Z info vpxa[8244B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-2a] [VpxLRO] — FINISH lro-119955

2022-05-10T07:23:15.472Z info vpxa[8286B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-20] [VpxLRO] — BEGIN lro-119956 — vpxa — vpxapi.VpxaService.searchDatastore — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:23:15.472Z verbose vpxa[8286B70] [Originator@6876 sub=vpxaMoService opID=l2zto750-4t-h5:70000105-5c-01-20] SearchDatastore: ds:///vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/ false [N3Vim4Host16DatastoreBrowser10SearchSpecE:0x038b74a8]

2022-05-10T07:23:15.629Z info vpxa[8286B70] [Originator@6876 sub=vpxaVmprov opID=l2zto750-4t-h5:70000105-5c-01-20] [IsTopLevelObjectStorePath] path /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/ has fstype: 62770

2022-05-10T07:23:15.630Z info vpxa[8286B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-20] [VpxLRO] — FINISH lro-119956

2022-05-10T07:23:15.640Z info vpxa[5AEF1B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-fa] [VpxLRO] — BEGIN lro-119957 — vpxa — vpxapi.VpxaService.nfcMakeSystemTicket — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:23:15.641Z info vpxa[5AEF1B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-fa] [VpxLRO] — FINISH lro-119957

2022-05-10T07:28:01.491Z info vpxa[8223B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-9d] [VpxLRO] — BEGIN lro-119974 — vpxa — vpxapi.VpxaService.reserveName — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:28:01.516Z verbose vpxa[8223B70] [Originator@6876 sub=journal opID=l2zto750-4t-h5:70000105-5c-01-9d] Deleting Journal /var/log/vmware/journal/1652167681.19.

2022-05-10T07:28:01.516Z info vpxa[8223B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-9d] [VpxLRO] — FINISH lro-119974

2022-05-10T07:28:01.534Z verbose vpxa[82E9B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] RecordOp ASSIGN: info.reason, task-22. Applied change to temp map.

2022-05-10T07:28:01.534Z verbose vpxa[82E9B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] [CommitChangesAndNotify] Updating cached values

2022-05-10T07:28:01.534Z verbose vpxa[82E9B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] RecordOp ADD: recentTask[“task-22”], vpxaTaskManager. Sent notification immediately.

2022-05-10T07:28:01.535Z verbose vpxa[5B03BB70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] RecordOp ASSIGN: info.state, task-22. Applied change to temp map.

2022-05-10T07:28:01.535Z verbose vpxa[5B03BB70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] RecordOp ASSIGN: info.cancelable, task-22. Applied change to temp map.

2022-05-10T07:28:01.535Z verbose vpxa[5B03BB70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] [CommitChangesAndNotify] Updating cached values

2022-05-10T07:28:01.535Z info vpxa[5B03BB70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-3a] [VpxLRO] — BEGIN task-22 — vpxa — vpxapi.VpxaService.createVm — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:28:01.536Z warning vpxa[5B03BB70] [Originator@6876 sub=vpxaVmprovUtil opID=l2zto750-4t-h5:70000105-5c-01-3a] [VpxaVmprov] UndoNameReservation: Failed to open file /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx

2022-05-10T07:28:01.543Z verbose vpxa[7BD0B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-3a] [VpxLRO] LRO task-22 has been resumed

2022-05-10T07:28:01.543Z error vpxa[7BD0B70] [Originator@6876 sub=vpxaVmprov opID=l2zto750-4t-h5:70000105-5c-01-3a] [CreateVmFailed] Received unexpected exception from host agent while creating VM: 07bcfe94

2022-05-10T07:28:01.544Z error vpxa[7BD0B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-3a] [LroMainContinuation] Unexpected Exception: N5Vmomi5Fault15InvalidArgument9ExceptionE(vmodl.fault.InvalidArgument)

2022-05-10T07:28:01.545Z verbose vpxa[7BD0B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] RecordOp ASSIGN: info.state, task-22. Applied change to temp map.

2022-05-10T07:28:01.545Z verbose vpxa[7BD0B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] RecordOp ASSIGN: info.cancelable, task-22. Applied change to temp map.

2022-05-10T07:28:01.545Z verbose vpxa[7BD0B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] RecordOp ASSIGN: info.error, task-22. Applied change to temp map.

2022-05-10T07:28:01.545Z verbose vpxa[7BD0B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a] [CommitChangesAndNotify] Updating cached values

2022-05-10T07:28:01.545Z info vpxa[7BD0B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-3a] [VpxLRO] — FINISH task-22

2022-05-10T07:28:01.545Z info vpxa[7BD0B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-3a] [VpxLRO] — ERROR task-22 — vpxa — vpxapi.VpxaService.createVm: vmodl.fault.InvalidArgument:

–>          key = “cdrom.showIsoLockWarning”,

2022-05-10T07:28:01.678Z info vpxa[5AF54B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-4c] [VpxLRO] — BEGIN lro-119976 — vpxa — vpxapi.VpxaService.nfcMakeSystemTicket — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:28:01.679Z info vpxa[5AF54B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-4c] [VpxLRO] — FINISH lro-119976

2022-05-10T07:28:01.684Z verbose vpxa[8244B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] RecordOp ASSIGN: info.reason, task-23. Applied change to temp map.

2022-05-10T07:28:01.684Z verbose vpxa[8244B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] [CommitChangesAndNotify] Updating cached values

2022-05-10T07:28:01.684Z verbose vpxa[8244B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] RecordOp ADD: recentTask[“task-23”], vpxaTaskManager. Sent notification immediately.

2022-05-10T07:28:01.684Z verbose vpxa[7C96B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] RecordOp ASSIGN: info.state, task-23. Applied change to temp map.

2022-05-10T07:28:01.684Z verbose vpxa[7C96B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] RecordOp ASSIGN: info.cancelable, task-23. Applied change to temp map.

2022-05-10T07:28:01.684Z verbose vpxa[7C96B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] [CommitChangesAndNotify] Updating cached values

2022-05-10T07:28:01.684Z info vpxa[7C96B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-65] [VpxLRO] — BEGIN task-23 — nfcManager — nfc.NfcManager.copy — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:28:01.684Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcManagerImpl] Copy operation invoked

2022-05-10T07:28:01.685Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.685Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.686Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.686Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.686Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcWorker] Finding unique connections.

2022-05-10T07:28:01.686Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcWorker] Examining copy spec 11.11.1.106:ds:///vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter//vmware.log -> 11.11.1.104:ds:///vmfs/volumes/5d4b625e-3883346c-4eed-e26ee8500010/XYZCVcenter//vmware-0.log

2022-05-10T07:28:01.686Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcWorker] Creating new client.

2022-05-10T07:28:01.686Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.686Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.687Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.687Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.687Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcClient] Source host is local, dst host is remote

2022-05-10T07:28:01.687Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.687Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.819Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] Optimize socket buffer size.

2022-05-10T07:28:01.819Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] NfcNet_OptimizeSocketBuffer: Setting buffer size using RTT=11 ms BANDWIDTH=134000 bytes/ms BUFFER_SIZE=1553KB

2022-05-10T07:28:01.920Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcWorker] Done finding connections.

2022-05-10T07:28:01.920Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcWorker] Pre-processing copy spec 11.11.1.106:ds:///vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter//vmware.log -> 11.11.1.104:ds:///vmfs/volumes/5d4b625e-3883346c-4eed-e26ee8500010/XYZCVcenter//vmware-0.log

2022-05-10T07:28:01.920Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] Comparing sources

2022-05-10T07:28:01.921Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.921Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.921Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.921Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.921Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] Specs are the same. Both are local.

2022-05-10T07:28:01.921Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] Comparing destinations

2022-05-10T07:28:01.921Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.921Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.922Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.922Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.922Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] Specs are the same but non-local.

2022-05-10T07:28:01.922Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] CopySpecs are equal.

2022-05-10T07:28:01.922Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] Comparing sources

2022-05-10T07:28:01.922Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.922Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.922Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.922Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.922Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] Specs are the same. Both are local.

2022-05-10T07:28:01.922Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] Comparing destinations

2022-05-10T07:28:01.923Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.923Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.923Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] VmkNicImpl::IsDhclientProcess: No valid dhclient pid found

2022-05-10T07:28:01.923Z info vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65]

2022-05-10T07:28:01.923Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] Specs are the same but non-local.

2022-05-10T07:28:01.923Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcUtil] CopySpecs are equal.

2022-05-10T07:28:01.923Z warning vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] [NFC ERROR] NfcFile_Open: Open failed:

2022-05-10T07:28:01.923Z warning vpxa[7C96B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-65] [NFC ERROR] NfcFile_GetInfo: Failed to open file

2022-05-10T07:28:01.923Z error vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcClient] Unable to get file info for file ds:///vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter//vmware.log: No file exists for given path — File open failed: Could not find the file

2022-05-10T07:28:01.924Z error vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcWorker] Error encountered while pre-processing copy spec for file ds:///vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter//vmware.log:

2022-05-10T07:28:01.925Z warning vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcWorker] FailOnError is false. Proceeding to the next spec…

2022-05-10T07:28:01.925Z verbose vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcClient] Closing NFC connection to server

2022-05-10T07:28:01.926Z info vpxa[7C96B70] [Originator@6876 sub=NfcManager opID=l2zto750-4t-h5:70000105-5c-01-65] [NfcManagerImpl] Copy operation completed successfully

2022-05-10T07:28:01.926Z verbose vpxa[7C96B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] RecordOp ASSIGN: info.progress, task-23. Applied change to temp map.

2022-05-10T07:28:01.926Z verbose vpxa[7C96B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] [CommitChangesAndNotify] Updating cached values

2022-05-10T07:28:01.926Z verbose vpxa[7C96B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-65] [VpxTask] SetStatusDone was called with syncGenNo (50041728)

2022-05-10T07:28:01.926Z verbose vpxa[7C96B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] RecordOp ASSIGN: info, task-23. Applied change to temp map.

2022-05-10T07:28:01.926Z verbose vpxa[7C96B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-65] [CommitChangesAndNotify] Updating cached values

2022-05-10T07:28:01.926Z info vpxa[7C96B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-65] [VpxLRO] — FINISH task-23

2022-05-10T07:28:01.928Z info vpxa[8433B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-b9] [VpxLRO] — BEGIN lro-119978 — operationCleanupManager — vim.host.OperationCleanupManager.queryEntry — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:28:01.928Z verbose vpxa[8433B70] [Originator@6876 sub=proxyManagedObjectImpl opID=l2zto750-4t-h5:70000105-5c-01-b9] [ProxyManagedObjectImpl::DispatchAsync] Invoking vim.host.OperationCleanupManager::queryEntry with 1 params

2022-05-10T07:28:01.931Z info vpxa[8433B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-b9] [VpxLRO] — FINISH lro-119978

2022-05-10T07:28:01.933Z info vpxa[7BF1B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-62] [VpxLRO] — BEGIN lro-119979 — operationCleanupManager — vim.host.OperationCleanupManager.updateEntry — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:28:01.933Z verbose vpxa[7BF1B70] [Originator@6876 sub=proxyManagedObjectImpl opID=l2zto750-4t-h5:70000105-5c-01-62] [ProxyManagedObjectImpl::DispatchAsync] Invoking vim.host.OperationCleanupManager::updateEntry with 1 params

2022-05-10T07:28:02.294Z info vpxa[7BF1B70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-62] [VpxLRO] — FINISH lro-119979

2022-05-10T07:28:02.313Z info vpxa[7B6DB70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-d7] [VpxLRO] — BEGIN lro-119980 — vpxa — vpxapi.VpxaService.unregisterVm — 5284a843-f94e-434b-4f92-bc5582239929

2022-05-10T07:28:02.313Z verbose vpxa[7B6DB70] [Originator@6876 sub=vpxaVmprov opID=l2zto750-4t-h5:70000105-5c-01-d7] Unregister vm -1 and remove 1 files

2022-05-10T07:28:02.314Z warning vpxa[7B6DB70] [Originator@6876 sub=vpxaVmprov opID=l2zto750-4t-h5:70000105-5c-01-d7] [UnregisterVm] Ignoring non-empty dir: /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter

2022-05-10T07:28:02.314Z info vpxa[7B6DB70] [Originator@6876 sub=vpxLro opID=l2zto750-4t-h5:70000105-5c-01-d7] [VpxLRO] — FINISH lro-119980

 

 

Hostd Logs:

 

2022-05-10T07:23:15.164Z verbose hostd[B340B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-02-d-88bc user=vpxuser] RecordOp ASSIGN: info, haTask-ha-host-vim.option.OptionManager.queryView-111715918. Applied change to temp map.

2022-05-10T07:23:15.164Z verbose hostd[B340B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-02-d-88bc user=vpxuser] RecordOp ASSIGN: info, haTask-ha-host-vim.option.OptionManager.queryView-111715918. Applied change to temp map.

2022-05-10T07:23:15.165Z verbose hostd[BF40B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-02-d-88bd user=vpxuser] RecordOp ASSIGN: info, haTask–vim.PerformanceManager.queryPerfCounterInt-111715919. Applied change to temp map.

2022-05-10T07:23:15.191Z info hostd[BF40B70] [Originator@6876 sub=Vimsvc.TaskManager opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator] Task Created : haTask–vim.host.OperationCleanupManager.createEntry-111715920

/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter-6b89aee5.hlog

2022-05-10T07:23:15.201Z info hostd[BF40B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator]    UUID: c22039aa-9462-4804-afcf-c92f82343a1d

2022-05-10T07:23:15.201Z info hostd[BF40B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator]    MigID: 6059858064348623433

2022-05-10T07:23:15.201Z info hostd[BF40B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator]    HLState: none

2022-05-10T07:23:15.201Z info hostd[BF40B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator]    ToFrom: none

2022-05-10T07:23:15.201Z info hostd[BF40B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator]    MigType: invalid

2022-05-10T07:23:15.201Z info hostd[BF40B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator]    OpType: nfc

2022-05-10T07:23:15.201Z info hostd[BF40B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator]    WorldID: 0

2022-05-10T07:23:15.201Z info hostd[BF40B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator]    Item Dir F “/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter”

user=vpxuser:VSPHERE.LOCAL\Administrator]

2022-05-10T07:23:15.203Z info hostd[BF40B70] [Originator@6876 sub=Vimsvc.TaskManager opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator] Task Completed : haTask–vim.host.OperationCleanupManager.createEntry-111715920 Status success

2022-05-10T07:23:15.203Z verbose hostd[BF40B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-2a-88be user=vpxuser:VSPHERE.LOCAL\Administrator] RecordOp ASSIGN: info, haTask–vim.host.OperationCleanupManager.createEntry-111715920. Applied change to temp map.

2022-05-10T07:28:01.540Z info hostd[BD85B70] [Originator@6876 sub=Vimsvc.TaskManager opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] Task Created : haTask–vim.host.LowLevelProvisioningManager.createVm-111715986

2022-05-10T07:28:01.540Z verbose hostd[BD85B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] RecordOp ADD: recentTask[“haTask–vim.host.LowLevelProvisioningManager.createVm-111715986”], ha-taskmgr. Applied change to temp map.

2022-05-10T07:28:01.540Z verbose hostd[B381B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] RecordOp ASSIGN: info, haTask–vim.host.LowLevelProvisioningManager.createVm-111715986. Applied change to temp map.

2022-05-10T07:28:01.540Z info hostd[B381B70] [Originator@6876 sub=Vmsvc opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] CreateVm: Path is not on object datastore ([]/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx)

2022-05-10T07:28:01.541Z info hostd[B381B70] [Originator@6876 sub=Vmsvc.vm:/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] Virtual machine object cleanup

2022-05-10T07:28:01.541Z info hostd[B381B70] [Originator@6876 sub=Vmsvc opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] Vmsvc::CreateVm: Exception thrown vim.fault.AlreadyExists

2022-05-10T07:28:01.541Z info hostd[B381B70] [Originator@6876 sub=Vcsvc.LLPM opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] CreateVm: transient VM creation failed — vim.fault.AlreadyExists

2022-05-10T07:28:01.541Z info hostd[B381B70] [Originator@6876 sub=Default opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] AdapterServer caught exception: vmodl.fault.InvalidArgument

2022-05-10T07:28:01.541Z info hostd[B381B70] [Originator@6876 sub=Vimsvc.TaskManager opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] Task Completed : haTask–vim.host.LowLevelProvisioningManager.createVm-111715986 Status error

2022-05-10T07:28:01.541Z verbose hostd[B381B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] RecordOp ASSIGN: info, haTask–vim.host.LowLevelProvisioningManager.createVm-111715986. Applied change to temp map.

2022-05-10T07:28:01.929Z verbose hostd[BF40B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-b9-891c user=vpxuser:VSPHERE.LOCAL\Administrator] RecordOp ASSIGN: info, haTask–vim.host.OperationCleanupManager.queryEntry-111715987. Applied change to temp map.

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    UUID: c22039aa-9462-4804-afcf-c92f82343a1d

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    MigID: 6059858064348623433

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    HLState: none

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    ToFrom: none

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    MigType: invalid

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    OpType: nfc

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    WorldID: 0

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    Item Disk F “/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter_11-000001.vmdk”

2022-05-10T07:28:01.935Z info hostd[B340B70] [Originator@6876 sub=vm:   Item Vm F “/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] CopyFromEntry: Hostlog_Dump: Hostlog /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter-6b89aee5.hlog

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    UUID: c22039aa-9462-4804-afcf-c92f82343a1d

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    MigID: 6059858064348623433

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    HLState: failure

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    ToFrom: none

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    MigType: invalid

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    OpType: nfc

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]    WorldID: 0

2022-05-10T07:28:01.940Z info hostd[B340B70] [Originator@6876 sub=vm:   Item Vm F “/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]

2022-05-10T07:28:02.285Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.286Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.287Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.288Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.289Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.290Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.291Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.292Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.292Z info hostd[B340B70] [Originator@6876 sub=Libs opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OBJLIB-LIB:  Failed to get VCFS root path for ‘/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter’: No such file or directory (131076).

2022-05-10T07:28:02.293Z info hostd[B340B70] [Originator@6876 sub=Vcsvc.LLPM opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] VM [] /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx is currently being loaded

2022-05-10T07:28:02.293Z warning hostd[B340B70] [Originator@6876 sub=Vcsvc.OCM opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] OCMCleanupHostlogItem: Failed to delete VM /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx: vim.fault.InvalidState

2022-05-10T07:28:02.293Z warning hostd[B340B70] [Originator@6876 sub=vm:Hostlog_ExecuteCleanup: Callback failed to delete object /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator]   Hlog: /vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter-6b89aee5.hlog

2022-05-10T07:28:02.293Z info hostd[B340B70] [Originator@6876 sub=Vimsvc.TaskManager opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] Task Completed : haTask–vim.host.OperationCleanupManager.updateEntry-111715988 Status success

2022-05-10T07:28:02.293Z verbose hostd[B340B70] [Originator@6876 sub=PropertyProvider opID=l2zto750-4t-h5:70000105-5c-01-62-891d user=vpxuser:VSPHERE.LOCAL\Administrator] RecordOp ASSIGN: info, haTask–vim.host.OperationCleanupManager.updateEntry-111715988. Applied change to temp map.

 

 

 Conclusion:

 

  • Based on the review we can see that we are getting the below error:

 

2022-05-10T07:28:01.541Z info hostd[B381B70] [Originator@6876 sub=Vmsvc opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] Vmsvc::CreateVm: Exception thrown vim.fault.AlreadyExists

 

2022-05-10T07:28:01.541Z info hostd[B381B70] [Originator@6876 sub=Vcsvc.LLPM opID=l2zto750-4t-h5:70000105-5c-01-3a-8917 user=vpxuser:VSPHERE.LOCAL\Administrator] CreateVm: transient VM creation failed — vim.fault.AlreadyExists

 

 

  • While looking at the vminventory.xml I can see that there are duplicate entries for the virtual machine present. This is the reason why we are seeing the error already exist. 

 

 

<ConfigRoot>

  <ConfigEntry id=“0000”>

    <objID>1</objID>

    <secDomain/>

    <vmxCfgPath>/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx</vmxCfgPath>

  </ConfigEntry>

  <ConfigEntry id=“0001”>

    <objID>10</objID>

    <secDomain>7</secDomain>

    <vmxCfgPath>/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZC1SC-2/XYZC1SC-2.vmx</vmxCfgPath>

  </ConfigEntry>

  <ConfigEntry id=“0002”>

    <objID>12</objID>

    <secDomain>8</secDomain>

    <vmxCfgPath>/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZC1PL-6/XYZC1PL-6.vmx</vmxCfgPath>

  </ConfigEntry>

</ConfigRoot>

 

 

  • To remove the duplicate entry for the virtual machine:

 

  1. Connect to the host using SSH. For more information, see Using Tech Support Mode in ESXi 4.1, ESXi 5.x, and ESXi 6.x.
  2. Navigate to the /etc/vmware/hostd directory using this command:

    cd /etc/vmware/hostd
     
  3. Open the vmInventory.xml file using a Text Editor.
  4. Create a backup of the vmInventory.xml file.
  5. Identify the duplicate entries for the virtual machine in the vmInventory.xml file.
  1. Remove all entries within <ConfigRoot> and </ConfigRoot> tags.

In our case

  <ConfigEntry id=“0000”>

    <objID>1</objID>

    <secDomain/>

    <vmxCfgPath>/vmfs/volumes/5d4b65d2-28fd39fa-d8b6-e26ee8500014/XYZCVcenter/XYZCVcenter.vmx</vmxCfgPath>

  </ConfigEntry>

 

  1. Restart management agents on the host using this command:

 

/sbin/services.sh restart

 

  1. Perform the vMotion operation again and let me know the status.

 

 

Ashutosh Dixit

I am currently working as a Senior Technical Support Engineer with VMware Premier Services for Telco. Before this, I worked as a Technical Lead with Microsoft Enterprise Platform Support for Production and Premier Support. I am an expert in High-Availability, Deployments, and VMware Core technology along with Tanzu and Horizon.

Leave a Reply