Wikimedia Release Engineering Team/Checkin archive/20191204
Appearance
2019-12-04
[edit]Vacations/Important dates
[edit]- December 1–2: Jeena
- December 6: Lars (Finnish Independence Day)
- December 23: James, Brennen, Greg (need to put it in Namely)
- December 24–31 (Christmas): Staff with reqs (everyone? (yes))
- December 25–26: Lars (Christmas)
- 1 January (New Year's Day): Staff with reqs, Lars
- 2–3 January: James
- 20 January (Martin Luther King Jr. Day): Staff with reqs
- 17 February (Presidents' Day): Staff with reqs
- 9 March (DST+1 day): Staff with reqs
- 24 April (Not-Easter): Staff with reqs
- 25 May (Memorial Day): Staff with reqs
Rotating positions
[edit]Train
[edit]- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- 25 Nov - wmf.8 [Group0 on Tuesday] - Brennen + Mukunda (Thanksgiving)
- 2 Dec - wmf.8 part 2 [Wednesday Group1 + Thursday Group2] - Brennen + Dan
- 9 Dec - wmf.10 - Dan + James
- 16 Dec - wmf.11 - James + Jeena
- 23 Dec - wmf.12 - No Train or any other deploys (Winterval)
- 30 Dec - wmf.13 - No Train or any other deploys (Still Winterval)
- 6 Jan - wmf.14 - Jeena + Lars
- 13 Jan - wmf.15 - Lars + Antoine
SoS
[edit]- Aug 14 onward: Zeljko 🎸 🎷 \o/
Team Business
[edit]Incoming/Needs attention
[edit]- New skill matrix: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Skill_matrix
- New workboard for December: https://phabricator.wikimedia.org/project/view/4401/ -- make sure your tasks look right
- Enable API integration tests in CI for MediaWiki core https://phabricator.wikimedia.org/T236680
- Antoine taking this task.
- Add curl support to mwext-node10-rundoc-docker https://phabricator.wikimedia.org/T239246
- Antoine to decide
- Create and maintain somehow a list of repos mastered in GitHub (and in Differential) https://phabricator.wikimedia.org/T237470
- Support MarcoAurelio and make it semi-automated? Halp.
- mobileapps-periodic-test failing since 2019-12-04 01:00 UTC due to failing git fetches https://phabricator.wikimedia.org/T239815
- Broken by phab 1003->1001 migration? Other things also are broken, apparently. :-(
- There is _something_ broken about this repo but I can't make sense of what it is. Shallow clone fails but a normal clone works fine.
- "integration" (CI) WMCS project: jessie usage needs replacing with buster/stretch https://phabricator.wikimedia.org/T236576
- Antoine?
- Antoine to write a doc about everything that has to be done (eg: portals build, wdqs gui build, debian glue, zuul package)
- TODO assign to antoine and comment
- See also https://phabricator.wikimedia.org/project/view/4080/ (continuous integration infrastructure > phase-out-jessie )
- Antoine?
Offsite Actions
[edit]- 🏂 In progress [thcipriani] figure out what part of team meeting to move to phab
- 🏂 In progress [James + Antoine] draft runbooks listing
- Very initial page at https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Runbooks; more coming today.
- [dan + brennen] explore tools for pairing
- Ž: stumbled upon this recently https://pragprog.com/book/jkrp/remote-pairing
- ✅ Done [thcipriani] add James to train duty rotation
- [Dan + Jeena] add blubber to local dev
- -> Q3 goals?
- [Mukunda] phab to local dev
- -> Q3 goals?
- [thcipriani] lunch and learns
- 🏂 In progress [thcipriani] SPOF Training program
- Idea: assigned pairings for folks
- Things in production that we intend to maintain over the next year + current owners:
- Gerrit: Thcipriani -- two people needed
- Scap: Thcipriani -- two people needed -- Dan + Lars
- Phabricator: Mukunda + designated tribute (antoine: could use training for the basics) (brennen: well, I know PHP...)
- Jenkins/Zuul/CI infra: Antoine + James
- Production config architecture: James + designated tribute
- [Mukunda] Monthly rotating blog post
- [thcipriani/greg] Program/Project managers
- [JDF] highlighted this to Grace, so she expects outreach to understand the role.
Q3 (Jan–Mar 2020) Goal Planning is upon us!
[edit]- Dan + Lars: Scap
- For us from performance team -- scap work: https://phabricator.wikimedia.org/T99740
- "We are happy to provide help on this task in an advisory role if needed."
- For us from performance team -- scap work: https://phabricator.wikimedia.org/T99740
- Mukunda + James: Automate branchcut
- Lars + Mukunda?: Something something security patches -- tentative
- Antoine: Jessie migration for integration project
- Needs support for blubber. Overlap with Pipeline migrations goal below.
- Needs support for Scap
- Antoine + James: Quibble parsing extension.json for dependencies instead of hard-coded in CI.
- DECISION: Let's not do wikimedia/production.git until we have more clarity on timeline for way forward from SRE.
- Local dev
- [Finish putting TMH in local-charts if not done by then.]
- Land basic local dev into mw/core itself.
- James: Pipeline migrations, cont'd -- supporting teams as they switch [Minimal work from RelEng side; depends on SRE & teams.] Overlap with Jessie migration for integration.
- Pipeline documentation
- Dan + Lars
- [Pending discussion with SRE] New CI
Timespent spreadsheet
[edit]- For the avoidance of doubt: fill out the sheet week number for the previous week
- https://docs.google.com/spreadsheets/d/1YS_2eUQWUOnygshMfxgGPu93GKGCO5t00yjUREQ5B-I/edit#gid=1441822979
- reminder: your time spent doesn't need to total to 100%
Book club
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
- Happening 2019-12-10
- You should have an invite
- https://google.github.io/eng-practices/review/reviewer/
Monthly reflection on accomplishments - December '19 edition
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Add as you have them!
- PHP 7.4 testing was available in CI the first "business day" after 7.4.0 was released.
Scrum of Scrums for next week
[edit]Internal team notes, not for pasting into the SoS notes
[edit]Incoming from last week (aka this morning)
[edit]- Blocked by:
- None known.
- Blocking:
- Wikimedia Deutschland/Wikidata: Setting up Pipeline CI job for wikibase/vuejs-components repository: https://gerrit.wikimedia.org/r/c/integration/config/+/551829
- Updates:
- Train Health
- Last week: 1.35.0-wmf.8 - phab:T233856 - group0 only because of Thanksgiving
- This week: 1.35.0-wmf.8 - phab:T233856 - group1 + group2
- Next week: 1.35.0-wmf.10 - phab:T233858
- Train Health
Callouts
[edit]- Release Engineering - unusual train schedule:
- This week: 1.35.0-wmf.8 - group1 + group2
- Next week: 1.35.0-wmf.10
- December 23-January 3rd - No deploys (including train), Holiday break
Outgoing next week
[edit]- Blocked by:
- Blocking:
- Updates:
- Train Health
- Last week: 1.35.0-wmf.8 - phab:T233856 - group1 + group2
- This week: 1.35.0-wmf.10 - phab:T233858
- Next week: 1.35.0-wmf.11 - phab:T233859
- Train Health
Callouts
[edit]- Release Engineering - December 23-January 3rd - No deploys (including train), Holiday break
Train status and happenings
[edit]Standup!
[edit]- Make sure your tasks are correct on our kanban board!
Antoine
[edit]Last week
[edit]- Best thing
- Mukunda empowered Antoine as a Phabricator administrator. \o/
- Started Doxygen Debian packaging backport to fix search
- Jenkins job collapsible sections fixed. Learned more about Jenkins plugins / maven https://phabricator.wikimedia.org/T236222
- Worst thing
- CI debian-glue job does not support pristine-tar delta v3 due to running on Jessie grr
- What I planned vs did
- Did Quibble reviews
- Unplannned
This week
[edit]- What I plan to do
- Blockers
Other
[edit]
Brennen
[edit]Last week
[edit]- Best things
- This Week in Logspam seems to have prompted action \o/
- Got my backpack
- Worst thing
- Was still pretty fried after offsite
- What I planned vs did
- Done dev-images:
- Done Some learning effort for Tuesday's Rust study group meeting
- Unplannned
- Some feedback for JR on WMF-provided equipment
This week
[edit]- What I plan to do
- Finish deploying 1.35.0-wmf.8
- Update skill matrix
- Read for book club
- Fill out offsite survey
- Keysigning!
- Hack on T238224 Provide docker-compose based development enviornment in mediawiki core
- Blockers
Other
[edit]
Dan
[edit]Last week
[edit]- Best thing
- Not working
- Worst thing
- Staying in a household where no one else drinks coffee, thus no coffee being readily available
- 😱 Can we drop-ship you a portable coffee machine? Yes! Next time :) Or I can just buy myself an Aeropress
- Staying in a household where no one else drinks coffee, thus no coffee being readily available
- What I planned vs did
- N/A
- Unplannned
- N/A
This week
[edit]- What I plan to do
- Come up with questions for SRE re: third-party vs. WMF K8s platform
- Reaquaint myself with scap codebase and look at ways to support PHP-based l10n
- Talk to Brennen about pairing tooling research and experimentation
- PipelineLib user documentation
- PipelineLib git clone improvements (depth and parallel clone support)
- Tooling to simplify easier taskification of daily work
- Taskify the above
- Blockers
- Argo CI platform work blocked on SRE
Other
[edit]
Greg
[edit]Last week
[edit]- Best thing
- vacation
- left overs
- Worst thing
- rain
- What I planned vs did
- Unplannned
This week
[edit]- What I plan to do
- MTP/OKR metrics working group
- leveling/job codes
- review as much of techconf+offsite notes as possible
- all hands team day (mostly done for now, but more coming)
- Blockers
- time
- parents in town
Other
[edit]
James
[edit]Last week
[edit]- Best thing
- Finally got auto-built DBlists out of the door. \o/
- [Also, Friendsgiving was nice: https://www.instagram.com/p/B5cLsL-JdW8/ ]
- Worst thing
- Got almost nothing done due to pesky holidays.
- What I planned vs did
- Not much.
- Unplannned
- A few things broke.
This week
[edit]- What I plan to do
- JDI for CI diff reports of changes, and then? static config in production
- CI/CR metrics doc fiddles.
- Runbooks documentation collation/writing.
- Blockers
- None known.
Other
[edit]
Jeena
[edit]Last week
[edit]- Best thing
- Making Tea :D :D :D
- Worst thing
- Food Poisoning :(
- What I planned vs did
- Vacation
- Unplannned
This week
[edit]- What I plan to do
- Catch up on emails
- Catch up on things that got done while gone
- Do Keysigning
- register for all hands
- Blockers
Other
[edit]
Lars
[edit]Last week
[edit]- Best thing
- Getting over jet lag, more or less.
- Worst thing
- The Darkness.
- What I planned vs did
- DoneSet up git repo for PGP public keys on Gerrit, for keysigning.
- Not done Read TechConf and offsite notes, extract any useful bits.
- Not done Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
- Not done Do an Argo test deployment.
- Not done Start work on documenting pipelinelib so it can be re-implemented for new CI.
- Unplanned
- Participated in email discussion about not dropping embargoed security patches.
This week
[edit]- What I plan to do
- Write and send out howto for signing PGP keys. phab:T239829
- Read TechConf and offsite notes, extract any useful bits.
- Ponder SRE input on new CI from TechConf. Discuss with Tyler, Dan.
- Do an Argo test deployment.
- Start work on documenting pipelinelib so it can be re-implemented for new CI.
- Blockers
- Nope.
Other
[edit]- SAD is kicking me in the head. Please make the Darkness go away.
- Some shoulder and shoulder blade trouble. Not too bad.
Mukunda
[edit]Last week
[edit]- Best thing
- Phab migrated to phab1001
- Worst thing
- phab1001 has horrible disk i/o performance. The SATA controller is set to legacy ide mode in bios and it's going to require a reinstall to fix it.
- What I planned vs did
- Done phabricator migration
- Not done phabricator upgrade: still need to merge from upstream/stable && deploy.
- Unplannned
- Phabricator: debian reimage/reinstall tonight
This week
[edit]- What I plan to do
- Finish my phabricator redundancy OKRs
- Finish reinstalling phab1001
- Test some more failure scenarios.
- Look into open-sourcing phabricator-antivandalism as I finally have the OK from our security team.
- Finish my phabricator redundancy OKRs
- Blockers
- Needing to sleep occasionally.
Other
[edit]
Tyler
[edit]Last week
[edit]- Best thing
- Didn't horribly burn myself
- Worst thing
- Holidays/Blazey's family/being sick
- What I planned vs did
- Done Mandatory trainings
- Done 177 résumés Hiring reviews
- In progress Offsite TODO amalgamation
- Unplannned
This week
[edit]- What I plan to do
- Wrangle hiring loop
- Build SPoF program
- Q3 planning kickoff
- Do keysigning!
- Register for all-hands (everyone!)
- Blockers
Other
[edit]- Dog reajusting to 3 week schedule change
- I am still sick :(
Zeljko
[edit]Last week
[edit]- Best thing
- caugh up on sleep 😴
- Worst thing
- safeguard contract 📜
- What I planned vs did
- catch up on gerrit/phabricator/mail ✅
- Selenium documentation updates ❌
- Unplannned
- safeguard contract 📜
- Harassment & Discrimination Prevention 👊
This week
[edit]- What I plan to do
- work on testing related questions for interviews with developers ❓
- expense report (Coupa)
- prepare to close my company: paperwork, meet with accountant... 👔
- read article for book club (can not attend book club) 📖
- prepare talk about software testing anti patterns for local tech meetup 🎤
- use more emoji 🤠
- Blockers
Other
[edit]- my phone started behaving strangely recently, had to do factory reset over the weekend, it took a few hours to get back to being functional but looks like problems are solved