1. Tsc
  2. Messages

Re: FD.io Jenkins Maintenance: 2020-10-19 1700 UTC to 2200 UTC

Vanessa Valderrama
 

Maintenance has been completed successfully. All service are available.

As part of maintenance we downgraded the Gerrit Trigger plugin in Jenkins to avoid a re-occurrence of the incident we had today. It appears there is a defect in the latest version of the plugin that causes Gerrit triggers to stop triggering builds in Jenkins causing the queue to grow out of control and affect the stability of the Jenkins system. The root cause is unknown at this time. The workaround is to restart Jenkins.

If you experience any issues, please open a ticket at support.linuxfoundation.org.

Thank you,
Anton & Vanessa


On 10/7/20 9:36 AM, Vanessa Valderrama wrote:

Due to the unexpected Jenkins outage, we are going to perform this maintenance now. This maintenance has been approved by the VPP and CSIT teams.

Thank you,
Vanessa

On 10/5/20 12:11 PM, Vanessa Valderrama wrote:

What:
  • Ingress
    • Increase the size of the instance
    • OS and security updates
  • Jenkins
    • OS and security updates
    • Upgrade to 2.249.1
    • Plugin updates
  • Nexus
    • OS updates
    • Upgrade to 2.14.19-01
  • Jira
    • OS updates
    • Upgrade to 8.12.2
  • Gerrit
    • OS updates
When:  2020-10-19 1700 UTC to 2200 UTC

Impact:

All systems will be unavailable during the maintenance window. Jenkins will be placed in shutdown mode at 1600 UTC. We will abort all jobs at 1700 UTC.
Join tsc@lists.fd.io to automatically receive all group messages.