2023-11-29

Last time

🏆 Wins

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments

Nov 23

PoC for zuul delegating to GitLab pipelines works better than expected, surfacing in the UI works better than expected
More catalyst changes: https://gitlab.wikimedia.org/repos/qte/catalyst
Diffusion repository exploration is done!
Leaked pod cleanup script—pods leak when restarts or updates of runners happen
Jaime's first Catalyst patch! Spins up k3s + MediaWiki + Vector
Less noisy docpub alerts
Cindy's patches to Catalyst
Zuul's gating functions alongside GitLab-ci.yml files (no gitlab clone, instead rsync from executor)
Jeena helm chart templating
Pod anti-afinity for buildkitd pods + increased buildkit volume size: https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/291 and https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/295
Script to modify persistant volume claims: https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/294
Deployed gitlab-pod-cleaner: https://gitlab.wikimedia.org/repos/releng/gitlab-cloud-runner/-/merge_requests/297
Zuul upstream commit is moving along: https://review.opendev.org/c/zuul/zuul/+/899425
Catalyst builds and exposes
Phabricator deploy yesterday
Zuul running in dev-tools! Blubberized upstream docker files! https://zuul-devtools.wmcloud.org/tenants
0 open patches in differential
puppet catalog compiler better integration with Gerrit: https://people.wikimedia.org/~hashar/gerrit-pcc.webm
Made this train thing: https://tools-static.wmflabs.org/train-stats/
Jenkins bug! ~ 2 days from start to merged by upstream https://github.com/jenkinsci/parameterized-trigger-plugin/pull/363
Uninstalled applications we don't use in phab—one more repo in WMDE
Went through 2012–2014 untouched repos in Gerrit
Archived mwdumper https://www.mediawiki.org/wiki/Manual:MWDumper
Ancient gerrit repo tickets filed for project cleanup!

Team Discussions

Nov 30 (tomorrow!): Deadline is closing on Dec 1–Jan 15th vacations in namely
Sandeep started, but is in Cultural orientation, but he'll be at the offsite!

Offsite: https://office.wikimedia.org/wiki/Developer_experience/Offsite/2023
Team-day discussions:
- MediaWiki GitLab CI pipelines
  - Refactoring image build into a GitLab CI pipeline—we build it at deploy time
  - Could be folded into "Future of MediaWiki deployment"
  - Talk about integration/config dockerfiles—outcome would be we know how they will work in CI
  - Know how we want zuul to interact with GitLab—now what do the GitLab CI jobs look like

- GitLab/Zuul integration
  - Sync up as a team on where we're at
  - Tease out problems people see in it

- Future of MediaWiki deployment
  - What's stopping us from handing off the train
  - +2 trigger scap backport
  - What's better than SSH access to the deployment server?
  - Can we remove expectation that you'll have to deploy others' code?
  - Faster rollback?

Notes
- Gerrit cleanup

OKR update

The six questions I answer week-by-week about our work. This is pretty much all CTPO/VP/Director-types see for what we're doing. If there are specific things to call out here, let's do.

Last week

Progress update on the hypothesis for the week Working on finding repos to archive and developing tools to archive them in bulk T342317 – Documentation improvements (Tech Docs Team) Completed draft of the deployment pipeline overview document, and shared with the team for review Continued reviewing the project plan with the team Any new metrics related to the hypothesis Repositories on Gerrit Decreased (1986 last week → 1983 this week) Projects on GitLab increased (as always) (1586 last week → 1595 this week) Any emerging blockers or risks No Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need? Are you on the hook to give another team something you aren’t able to give right now? No Have there been any new learnings from the hypothesis? No Are you working on anything else outside of this hypothesis? If so, what? Offsite session planning Developer satisfaction survey testing (with research) Train/Backports: No train or deployment training this week, due to holiday T282893 – Various CI jobs failing after "mkdir: cannot create directory ‘log’: Permission denied" Small but longstanding and annoying CI bug Fixed upstream: https://github.com/jenkinsci/parameterized-trigger-plugin/pull/363

This week

Progress update on the hypothesis for the week

Any new metrics related to the hypothesis

Any emerging blockers or risks

Any unresolved dependencies - do you depend on another team that hasn’t already given you what you need?

Are you on the hook to give another team something you aren’t able to give right now?

Have there been any new learnings from the hypothesis?

Are you working on anything else outside of this hypothesis? If so, what?

🌻 Open source/Upstream contributions

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Upstream

😶 Let's keep these empty

📅 Vacations/Important dates

https://office.wikimedia.org/wiki/HR_Corner/Holiday_List#2023

https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Time_off

Nov 2023

1 Nov: Antoine, Jaime (all-saints holiday)
10 Nov: US Staff with reqs
16 Nov: Jaime
17 Nov: Andre (public CZ holiday)
20 Nov and probably more days: Andre (too many vacation days left)
20–24: dancy taking thanksgiving week off
20-24: Dan out for US Thanksgiving as well
22 Nov: Brennen (Thanksgiving travel)
23, 24: US holiday staff with reqs
more random Mondays or Fridays: andre

Dec 2023

Dec11-15; Dec21-22: Andre
Dec 14-15: Dan (attending a wedding, sort of)
22 Dec: Brennen
25–Jan 1: End of year global holiday
11 Dec - 14 Jan: Jaime (Vacation + Home move)
Dec 18 - 22: Antoine

Future

15Jan - 15Mar: Andre
31 Jan - 2 Feb: Brennen

🔥🚂 Train

https://tools.wmflabs.org/versions/

https://train-blockers.toolforge.org/