Cloudstack 4.22 new install - System VM's created in Error State, many thousand a day

[mjstark]

Seems System VM's are being created, a few thousand every day in error state. My secondary storage looks good as it seems to be complaining about from what I gathered.

From Database;

### Secondary Storage

[mjstark]

Following up. Does anyone know why this might be happening? ....has anyone experienced this chaos

[DaanHoogland]

@mjstark , never heard of it before this.

• Do you have any SVMs not in error state (imagine not)?
  Can you share;
• if the templates for systemVMs are present on the secstor?
• any stacktraces in logs that might give a clue as to where it goes wrong?

I imagine the VMs are not present on any hyperviosors.

• What hypevisor type do you use?
• Is this a new installation or did it start happening in an existing one?

[mjstark]

Thanks for your reply

This is a new installation and using KVM as the HV

1. all SVM's are in error state and not running
2. No, when click on the secstor and browse, I don't see any files. Should i see files on the storage drive?

Here is what Im seeing in my logs; which seem to be related v-69465-VM ..and probably the same error for all the thousands of errors

[mjstark]

..more clear.

[shwstppr]

@mjstark check if you've free public IPs for your zone's physical network.

[mjstark]

Not sure what u mean?

[shwstppr]

@mjstark check if you see free IPs not reserved to any account/domain in Network > Public IP Address

[DaanHoogland]

Also @mjstark, when you say you browse to the secstor, do you mean in cloudstack or on the backing drive for it? The building and system vm template must be installed on it.