Uploaded image for project: 'IT: Release Engineering'
  1. IT: Release Engineering
  2. RELENG-1082

Temporary testing VM in Rackspace

    Issue XMLXMLWordPrintable

Details

    Description

      During the TSC call on 2018-07-19 the community requested a temporary testing VM in Rackspace so that they can try to reproduce an issue that they believe is caused by Vexxhost cloud.

      This ticket is to track the state of the VM and will be closed when testing is complete.

      Attachments

        JEditor

          Issue Links

            Activity

              zxiiro Thanh Ha added a comment -

              Maven binary is located here:

              /opt/apache-maven-3.5.4/bin/mvn

              Autorelease repo here:

              /opt/autorelease

              zxiiro Thanh Ha added a comment - Maven binary is located here: /opt/apache-maven-3.5.4/bin/mvn Autorelease repo here: /opt/autorelease
              jluhrsen Jamo Luhrsen added a comment -

              it appears this would be the full maven command to run as we do in upstream autorelease:

              mvn clean install --show-version --batch-mode -Djenkins -Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn -Dmaven.repo.local=/tmp/r -Dorg.ops4j.pax.url.mvn.localRepository=/tmp/r -P!karaf -Pignore-lispflowmapping-integrationtest -Dsft.heap.max=4g -Dskip.karaf.featureTest=true
              
              jluhrsen Jamo Luhrsen added a comment - it appears this would be the full maven command to run as we do in upstream autorelease: mvn clean install --show-version --batch-mode -Djenkins -Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn -Dmaven.repo.local=/tmp/r -Dorg.ops4j.pax.url.mvn.localRepository=/tmp/r -P!karaf -Pignore-lispflowmapping-integrationtest -Dsft.heap.max=4g -Dskip.karaf.featureTest= true
              zxiiro Thanh Ha added a comment - - edited

              Script to run in an infinite loop and pull logs when there is a failure. To use it cd to the bgpcep directory and run the script.

              #!/bin/bash
              logdir=/tmp/buildlogs
              mkdir -p "$logdir"
              while true; do
                  rm -rf /tmp/r/org/opendaylight
                  mvn clean install --show-version --batch-mode -Djenkins \
                      -Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn \
                      -Dmaven.repo.local=/tmp/r \
                      -Dorg.ops4j.pax.url.mvn.localRepository=/tmp/r \
                      -P!karaf \
                      -Pignore-lispflowmapping-integrationtest \
                      -Dsft.heap.max=4g \
                      -Dskip.karaf.featureTest=true | tee /tmp/log
              
                  if grep 'BUILD FAILURE' /tmp/log; then
                      logfile=$(mktemp --tmpdir="$logdir" --suffix=.log build-XXXXXXXX)
                      logfile_name=$(basename $logfile)
                      mv "/tmp/log" "$logfile"
                      surefire_dir=$(grep '\[ERROR\] Please refer to' "$logfile" | awk '{print $5}')
                      if [ ! -z "$surefire_dir" ]; then
                          zip -jr "$logdir/${logfile_name}.zip" "$surefire_dir"
                      fi
                  fi
              done
              
              zxiiro Thanh Ha added a comment - - edited Script to run in an infinite loop and pull logs when there is a failure. To use it cd to the bgpcep directory and run the script. #!/bin/bash logdir=/tmp/buildlogs mkdir -p "$logdir" while true; do rm -rf /tmp/r/org/opendaylight mvn clean install --show-version --batch-mode -Djenkins \ -Dorg.slf4j.simpleLogger.log.org.apache.maven.cli.transfer.Slf4jMavenTransferListener=warn \ -Dmaven.repo.local=/tmp/r \ -Dorg.ops4j.pax.url.mvn.localRepository=/tmp/r \ -P!karaf \ -Pignore-lispflowmapping-integrationtest \ -Dsft.heap.max=4g \ -Dskip.karaf.featureTest=true | tee /tmp/log if grep 'BUILD FAILURE' /tmp/log; then logfile=$(mktemp --tmpdir="$logdir" --suffix=.log build-XXXXXXXX) logfile_name=$(basename $logfile) mv "/tmp/log" "$logfile" surefire_dir=$(grep '\[ERROR\] Please refer to' "$logfile" | awk '{print $5}') if [ ! -z "$surefire_dir" ]; then zip -jr "$logdir/${logfile_name}.zip" "$surefire_dir" fi fi done
              zxiiro Thanh Ha added a comment - - edited

              Ah I just remembered `mvn` doesn't return a failure code when it fails

              Edit: script updated to parse the logs.

              zxiiro Thanh Ha added a comment - - edited Ah I just remembered `mvn` doesn't return a failure code when it fails Edit: script updated to parse the logs.
              zxiiro Thanh Ha added a comment -

              I ran the script for 2 days and only reproduced the netconf issues reported here [0]. I did not reproduce the bgpcep issues but as mentioned here [1] I believe it's due to CPU core count based on my testing and we likely no longer need Rackspace to test at this point.

              [0] https://lists.opendaylight.org/pipermail/netconf-dev/2018-July/001887.html
              [1] https://lists.opendaylight.org/pipermail/bgpcep-dev/2018-July/001372.html

              zxiiro Thanh Ha added a comment - I ran the script for 2 days and only reproduced the netconf issues reported here [0] . I did not reproduce the bgpcep issues but as mentioned here [1] I believe it's due to CPU core count based on my testing and we likely no longer need Rackspace to test at this point. [0] https://lists.opendaylight.org/pipermail/netconf-dev/2018-July/001887.html [1] https://lists.opendaylight.org/pipermail/bgpcep-dev/2018-July/001372.html

              People

                zxiiro Thanh Ha
                zxiiro Thanh Ha
                Andrew Grimberg, Jamo Luhrsen, Thanh Ha
                Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                  Created:
                  Updated:
                  Resolved: