Jump to content

Wikimedia Release Engineering Team/Checkin archive/20190624

From mediawiki.org


2019-06-24

[edit]

Vacations/Important dates

[edit]
https://office.wikimedia.org/wiki/HR_Corner/Holiday_List
How to do it
  • June 24 - Željko, vacation
  • June 25 - Željko, Statehood Day
  • July 2 - Greg's birthday, unsure if taking off, already have one meeting
  • July 4 (US Independence Day) - US Staff
  • July 5 - thcipriani vacation
  • July 5 - Lars off (swapping with weekend)
  • July 10 - Lars off (swapping with weekend)
  • July 22 - August 9 - Željko vacation
  • August 7–19 - James off (inc. Wikimania)
  • August 12 - September 8 - Dan leave
  • August 12 (Glorious Twelfth) - US Staff
  • August ??? - ??? - Antoine
  • August 14–18 - Wikimania
    • Attending: James, Lars, Jean-Rene
  • August 15 - Željko, Assumption of Mary
  • August 25 - September 4 - Brennen vacation
  • September 2 (Labor Day) - US Staff
  • October 14 (Indigenous Peoples' Day) - US Staff
  • November 11 (Veterans' Day) - US Staff
  • November 28–29 (Thanksgiving) - US Staff
  • December 6 - Lars, Finnish Independence Day
  • December 25–31 (Christmas) - US Staff
  • December 25–26 - Lars, Christmas
  • 2020 January 1 (New Year's Day) - US Staff, Lars

Rotating positions

[edit]

Train

[edit]
Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
  • June 10 - wmf.9 - No Train (SRE Summit)
  • June 17 - wmf.10 - Mukunda (but Juneteenth on the Wednesday? Yes. Do group0 and group1 an hour apart on Tuesday)
  • June 24 - wmf.11 - Jeena (with Mukunda)
  • July 1 - wmf.12 - No train (Fourth of July)
  • July 8 - wmf.13 - Jeena
  • July 15 - wmf.14 - Lars (with Antoine)
  • July 22 - wmf.15 - Lars
  • July 29 - wmf.16 - Brennen (with Tyler)
  • Aug 5 - wmf.17 - Brennen
  • Aug 12 - wmf.18 - No Train (Wikimania)
  • Aug 19 - wmf.19 - Zeljko 😱
  • Aug 26 - wmf.20 - Zeljko 😭

SoS

[edit]
  • Zeljko 4eva! :)


Team Business

[edit]

Timespent spreadsheet

[edit]
For the avoidance of doubt: fill out the sheet week number for the previous week


Book club

[edit]


Fall Offsite + TechConf19

[edit]
  • Decided: 1 long trip, offsite after TechConf
    • dates? 2019-11-1{6,7}--2019-11-21..ish


Annual Planning

[edit]


Changes to the meeting

[edit]
  • Turn into more of a real stand-up (see new section: What I did last week) so that we can answer most of the other questions (e.g. what is the team blocked on?) from those individual updates.
  • Might also move this meeting to not be on Monday, e.g. Thursday/Friday so the accuracy of "what I did this week" will be much higher.
  • Annual plan/etc. discussions will move into one-off meetings rather than crashing the stand-up.
  • Engineering Productivity won't meet as a whole each week. Sub-team meetings will continue (for RelEng and Performance) and be set up (for Q&T) :-) Annual planning managed by managers.
  • SoS managed somehow?


Monthly reflection on accomplishments - May '19 edition

[edit]
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
Add as you have them!


Incoming/Needs attention

[edit]
  • REL1_33 branching for extensions: https://phabricator.wikimedia.org/T220653
    • Reedy said he'll move forward with rc0 announcement soon.
    • Mukunda tried to run the script but it ran into trouble. Will re-try, manually.
    • Switching on HTTP Auth again still seems blocked. Barricade should help with this; review when Tyler gets back.
    • Update 2019-06-03: Fighting fires last; should be able to do this week.
    • Update 2019-06-10: Done with a quick hack by Reedy; do we need to fix the script for next time?
      • http auth patches merged in upstream, next week is the earliest it'll be released
    • Update 2019-06-17: Gerrit 2.15.14 is out, need to build and release, hopefully this week



Scrum of Scrums

[edit]

Incoming from last week

[edit]

Outgoing this week (wrong section heading level is on purpose for copy/pasting into Scrum of Scrums etherpad

[edit]

Release Engineering

[edit]

Callouts

[edit]


Train status and happenings

[edit]
https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Roles#Train_Conductor
  • New filtered fatal monitor dashboard including markers for scap deployments: https://logstash.wikimedia.org/app/kibana#/dashboard/77cc3e90-aa27-11e7-9109-51bd3197f7a9?_g=()
  • Need to fix scap clean :\
    • thcipriani has a crappy fix in mind until http tokens in gerrit are back
      • Any idea when HTTP tokens will come back? Weeks? Months? Never? :-(
      • ~Weeks
    • 2019-05-06: cleaned up stuff last week on deploy hosts, just not the gerrit branches
    • 2019-05-13: …
    • 2019-06-03: upstream issues/patches we want resolved before doing this
    • 2019-06-10: upstream cutting new version with security fixes (hopefully) end of week, ETA early next week
    • 2019-06-17: gerrit 2.15.14 is out, need to build and release, hopefully this week
    • 2019-06-24: gerrit upgrade 19:00 UTC today, announce going out after


Quarterly Goals for Q4

[edit]

https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q4

TEC1 (Maint): Outcome 1 / Output 1.1

[edit]
GOAL: Undeploy the CodeReview extension.
WHO: James, need help from CPT
  • James will ping CPT about this this week (April 8th)
    • … and again w/c 15 April.
    • … and again w/c 6 May (in SoS).
    • … and again w/c 27 May (in SoS).
    • [Recurring item]


TEC1 (Maint): Outcome 1 / Output 1.1

[edit]
GOAL: Setup 1-3 of the CI WG options (Zuul v3, Argo, GitLab)
WHO: Lars
  • Gitlab:
    • https://wmf-gitlab3.vm.liw.fi/ is up and accepts registrations with wikimedia.org (and liw.fi) email addresses
    • Please play with it and tell Lars anything that seems iffy


TEC3 (Pipeline): Outcome 1 / Output 1.2

[edit]
GOAL: Instrument Quibble for data collection
WHO: Mukunda, Antoine
  • Blocked


TEC3 (Pipeline): Outcome 1 / Output 1.2

[edit]
GOAL: Create a graph where time is spent and make a prioritized list for improvements.
WHO: Mukunda, Antoine
  • Blocked

TEC3 (Pipeline): Outcome 1 / Output 1.2

[edit]
GOAL: Prepare the Deployment Pipeline for changes to our CI tooling.
WHO: ???, ???
  • Blocked by not having new CI tooling yet


TEC3 (Pipeline): Outcome 3 / Output 3.1

[edit]
GOAL: Create a .pipeline/config.yaml standard to give users more control over how their tests are run in the pipeline and allow the easy saving of artifacts at pipeline completion. (RelEng)
WHO: Dan, Tyler, ???

Yes Done


TEC3 (Pipeline): Outcome 3 / Output 3.1

[edit]
GOALS:
Adopt more services into Deployment pipeline - task T212801
Wikidata Termbox SSR, Kask for Session Storage Service, cpjobqueue (stretch), ORES (stretch)
WHO: Dan, Tyler, Lars

There are tasks: https://phabricator.wikimedia.org/T220403

  • Wikidata Termbox SSR
    • Yes Done
  • Kask for Session Storage Service
    • Yes Done
  • cpjobqueue (stretch)
    • N Not done -> later

TEC12 (DevProd): Outcome 1 / Output 1.1

[edit]
GOAL: Provide an "Official" Docker base image for local development of MediaWiki based on the production tooling.
WHO: Jeena, Brennen
https://phabricator.wikimedia.org/T212449
  • Done for MediaWiki, for some values of "done" and "MediaWiki". Production-likeness needs considerable work.

TEC13 (Code Health): Outcome 1 / Output 3

[edit]
GOALs: Presentation/session(s) at the Wikimedia Hackathon on the current state of Code Health projects (technical debt and code stewardship)
WHO: JR

Yes Done

TEC13 (Code Health): Outcome 1 / Output 1.1

[edit]
GOAL:
Publish a re-imagination of the Review Queue process.
Develop and implement metrics around task and code-review responsiveness
WHO: Greg, JR (and Andre)
  • Review Queue
    • Blocked on Greg time
  • Task and code-review responsiveness metrics
    • No progress


= TEC13 (Code Health): Outcome 4 / Output 4.2

[edit]
GOALs:
Expand SonarQube reporting into CI infrastructure
Perform SonarQube analysis on all extensions
Engage user communities in direct feedback solicitation
WHO: JR, Zeljko, Code Health Metrics


Other non-goal work

[edit]

Release MW 1.33

[edit]
  • Handed off to Reedy along with security releases.


Selenium

[edit]

Gerrit

[edit]
  • 2.15.14 deploy


Phabricator

[edit]

Jenkins

[edit]

QA/Code Health

[edit]

SCAP

[edit]


Standup!

[edit]

Antoine

[edit]

Brennen

[edit]
  • What I did last week
    • trigger agent stuff merged
    • Discussion about local dev interface, starting messing with golang
    • Merged docker-installation removal
    • Read about dependency resolution
    • Tested some minor local-charts changes
    • Paired on pipeline validation with Tyler, began getting head around pipelinelib
  • What I plan to do this week
    • Turn pipeline stage steps into objects with run()/validate() methods
    • Discussion with tech writer?
    • Prepare something useful for Docker SIG on Thursday / advertise its continued existence
    • Read chapter 12
    • Take better notes
  • What I'm blocked on
  • Other?


Dan

[edit]
  • What I did last week
  • What I plan to do this week
  • What I'm blocked on
  • Other?


Greg

[edit]
  • What I did last week
    • Security council meeting kickoff
    • Met new Test Engineer for Language
    • CTO candidate Meet and Greet (more this week)
    • EngProd management thinking/planning
    • TechConf19 PC nominations
    • Phabricator workboard skeleton creation for the future
  • What I plan to do this week
    • CTO candidate meet and greets
    • DockerSIG
    • Internal Comms discussion
    • EngProd management planning
    • Phabricator workboard massaging/triaging with the new skeleton/framework
  • What I'm blocked on
  • Other?

James

[edit]
  • Other?


Jean-Rene

[edit]
  • What I did last week
    • got Code Review WG kickoff setup
    • continued reviews of Code Stewardship requests.
      • started drafting up statement re: Code Stewardship of Betacuster (after chat with Tyler)
    • CTO Cadidates M/G
  • What I plan to do this week
    • Quality and Test Engineering team planning/kickoff
    • more Code Stewardship work
    • Extending Code Health pipeline to 3 extensions (MobileFrontend, Minerva, and Popups)
    • CTO Cadidates M/G
  • What I'm blocked on
  • Other?


Jeena

[edit]
  • What I did last week
    • Read book
    • bug fix for local-charts
    • deployment-charts migration work/discussion
    • meet and greet thing
    • Some other stuff I can't remember
  • What I plan to do this week
    • Train train
    • choo choo
    • meet and greet
    • Learn about beta environment?
  • What I'm blocked on
    • Waiting for someone in SRE to take a look at my deployment-charts work
  • Other?


Lars

[edit]
  • What I did last week
    • Worked on v2 of CI arch doc, incorporating a lot of feedback
    • Arranged travel for Wikimania
    • Read annual plan parts relevant for RelEng and updated my goals for Q1
    • Reviewed new Acceptable Use Policy, made sure my personal devices have no access, excepto calendar and IRC
    • Participated in a meet & greet with CTO candidate Scott Noteboom
  • What I plan to do this week
    • Finish reading ch 13, attend book club
    • Finish v2 of CI arch doc
    • Plan (and document) CI arch implementation around GitLab
    • Attend meet & greets with the two other CTO candidates
  • What I'm blocked on
  • Other?
    • I like the what-I-did-last-week part


Mukunda

[edit]


Tyler

[edit]
  • What I did last week
    • Planned
      • Prep Gerrit 2.15.14 release, N Not done deploy Gerrit 2.15.14
      • N Not done Remove barricade v2 lucene dependency (with dcausse)
      • N Not done Finish Blubberoid policy file work
      • get up-to-date on the lib/extension dependency work -- meeting didn't happen, but I know the background, I think
    • Other work
      • Started work on .pipeline/config.yaml validation -- crammed things into my brain with brennen
  • What I plan to do this week
  • What I'm blocked on
    • scap 3.10.0-1
  • Other?


Zeljko

[edit]
  • What I did last week
  • What I plan to do this week
  • What I'm blocked on
  • Other?


Grooming

[edit]

Team Kanban Board Review and Triage

[edit]


Once / month-ish review of backlog(s)

[edit]


Kanban stats

[edit]
Burnup chart
Retrieved from "https://www.mediawiki.org/w/index.php?title=Wikimedia_Release_Engineering_Team/Checkin_archive/20190624&oldid=3615630"