Wikimedia Release Engineering Team/Deployment pipeline/2019-10-30

2019-10-30

Last Time

• 2019-07-18
• Archive

General

TODOs from last time

• In progress TODO: support documention like the one tyler did for the portal and pipeline/helmfile and deployment
  • thcipriani started a thing: https://wikitech.wikimedia.org/wiki/Deployment_pipeline
  • Could still use work: https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Migration

• TODO make a task to jenkins-ify updating deployment-charts
  • There is CI for this now
  • Not producing artifacts
  • Running two helm commands and pushing artifact: how? dunno yet

RelEng

• Seakeeper proposal
• Add CI checks for golang admission controllers

Serviceops

• Have an OKR with helping CPT moving changeprop, cp-jobqueue to the pipeline
  • running on Jessie machines
  • Marko and Peiter have done a lot of work -- images generated
    • needs verifcation and deployment to k8s

• Pipeline being able to power multiple services from the same repo
  • There are some docs, but need improvement, fleshing out, especially higher level documentation
    • https://doc.wikimedia.org/pipelinelib/
    • https://wikitech.wikimedia.org/wiki/Deployment_pipeline/Components#PipelineLib
    • TODO Lars & Dan pairing on pipelinelib docs!

CPT

• NSFWoid -- image classification model in a flask/python app
  • helps volunteers find vandalism
  • Pipeline python support
  • Update open_nsfw-- for Wikimedia production deployment

As Always

• Release Pipeline Workboard
• Meeting notes