Uploaded image for project: 'IT: Release Engineering'
  1. IT: Release Engineering
  2. RELENG-2058

Handle stack delete gracefully in openstack cron jobs

Issue XMLXMLWordPrintable

      Update openstack cron job to handle stacks in delete_failed state and continue instead of failing abruptly. Presently, if the job does not complete this leaves behind the orphaned nodes on the env which requires to be manually cleaned up.

      https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/builder-openstack-cron/18686/console.log.gz

       

      -----> Delete orphaned stacks
      Deleting orphaned stack: releng-netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upstream-stateful-snat-conntrack-sodium-100
      Deleting stack releng-netvirt-csit-1node-0cmb-1ctl-2cmp-openstack-queens-upstream-stateful-snat-conntrack-sodium-100
      WARN: Failed to delete $STACK_NAME. Reason: Resource DELETE failed: resources.vm_0_group: Stack DELETE cancelled
      Retrying delete...
      WARN: Failed to delete $STACK_NAME. Reason: Resource DELETE failed: resources.vm_0_group: Stack DELETE cancelled
      Retrying delete...

              askb Anil Belur
              askb Anil Belur
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: