Wikimedia Release Engineering Team/Deployment pipeline/2017-04-04

2017-04-04

Who's here:

Last Time

• Mostly goal confirmation
  • Releng
  • Services
  • Ops
• Confirmed that we're reusing existing production docker registry backed by swift
• Talked about Docker vs other container tech (e.g.., https://github.com/opencontainers/runtime-spec)
• Homegrown image specifications and leaky abstractions

Topics

Jenkinsfile + Dockerfile.ci PoC

• Docker Pipeline 1.10
• Pipeline as Code 2.4
• Pipeline installed and working
• Port differential-docker-test to Jenkinsfile
  • http://ci-staging-jenkins.wmflabs.org/ci/job/Jenkinsfile.docker/
  • Differential part not done, docker part was easy with Docker Pipeline plugin
• Docker Pipeline allows pushing to and pulling from private registry
  • https://jenkins.io/doc/pipeline/steps/docker-workflow/#code-withdockerregistry-code-sets-up-docker-registry-endpoint
• Need to make sure that whatever we build can be used by developers

• Proposal
  • Code runs through test and g+s pipeline
  • Postmerge stage build and push a docker container to private registry

Pipeline Requirements

• Consolidation of requirements (services, releng, etc) in google spreadsheet
• Make sure we all understand requirements, ensure that they're testable
• Canonical location for all requirements
• Gut check next time?

Staging Cluster

• Getting hardware specs

As Always

• Release Pipeline Workboard
• Meeting notes