Wikimedia Release Engineering Team/Checkin archive/20190325
Appearance
2019-03-25
[edit]Vacations/Important dates
[edit]- March 29–April 1: James out (New Hampshire)
- March 31: DST switchover in .eu, elsewhere ish.
- April 9-12: Greg at tech-mgt F2F in Portland
- April 17-19 (Wednesday - Friday) - Željko vacation
- April 18-19 (Thursday, Friday) - Lars vacation in Chicago
- April 22 (WMF Holiday) - US Staff
- April 22-27: Team offsite in Chicago
- April 29: Moved WMF Holiday for US staff at offsite
- May 1st - Lars, Antoine and Željko, Labor Day / May Day
- May 8th - Antoine, 1945 victory
- May 15 (Wednesday) - Željko vacation
- May 16-20 - Wikimedia Hackathon 2019 (Prague, Czechia)
- Attending: Greg, JR, Zeljko, James, and Jeena
- May 30th-31th - Antoine, Feast of the Ascension
- June 10th - Antoine, Pentecost -- see https://en.wikipedia.org/wiki/Eastertide for Antoine/France Easter holidays
- May 27 (Memorial Day) - US Staff
- June 6-7 - Brennen, Apogaea
- June 19 (Juneteenth) - US Staff
- July 22 - August 9 - Željko vacation
- August 25 - September 4 - Brennen vacation
Rotating positions
[edit]Train
[edit]- Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/maniphest/query/s3KW8bpsXhYF/#R
- Jan 07 - wmf.12 - Dan
- Jan 14 - wmf.13 - Dan
- Jan 21 - wmf.14 - Mukunda
- Jan 28 - wmf.15 - No Train (All Hands)
- Feb 04 - wmf.16 - Mukunda
- Feb 11 - wmf.17 - Tyler
- Feb 18 - wmf.18 - Tyler
- Feb 25 - wmf.19 - Antoine
- Mar 04 - wmf.20 - Antoine
- Mar 11 - wmf.21 - Zeljko 🐌
- Mar 18 - wmf.22 - Zeljko 💣
- Mar 25 - wmf.23 - Dan
- Apr 01 - wmf.24 - Dan
- Apr 08 - wmf.25 - Mukunda
- Apr 15 - 1.34.0-wmf.1 - Mukunda
- Apr 22 - wmf.2 - NO TRAIN, team offsite
- Apr 29 - wmf.3 - Tyler
- May 06 - wmf.4 - Tyler
- May 13 - wmf.5 - Antoine
- May 20 - wmf.6 - Antoine
- May 27 - wmf.7 - Zeljko
- June 03 - wmf.8 - Zeljko
SoS
[edit]- Zeljko 4eva! :)
Team Business
[edit]Book club
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club
- Notes: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Book_club/Continuous_Delivery
- Next:
- April 4th at the "same" time (9am Pacific/16:00 UTC)
- Chapters 7-9, inclusive
Spring Offsite
[edit]- Location: Chicago, IL (Central timezone, UTC-5 while we're there)
- Dates: Arrive Monday 4/22, Depart Saturday 4/27.
- Activity day
- Fill out the spreadsheet: https://docs.google.com/spreadsheets/d/1zqO8Mk1wUU2ZtyAM9xU68CQTpJFEOPALfDKCj7aMNo4/edit
- Does anyone have an interest in looking for a more guided tour thing? Like a river boat tour or architecture tour or segway or
- Program:
- start listing your topics! https://etherpad.wikimedia.org/p/releng-offsite-201904-topics
- I'm meeting with Deb on Wednesday to discuss program/logistics/etc
Monthly reflection on accomplishments - March '19 edition
[edit]- https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/Monthly_notable_accomplishments
- Add as you have them!
- CI tooling future WG started, blogged
- GerritBot comments on patches going through the pipeline (with fancy badges and the like)
- Train deploy notes are now automatically generated on branch push
- Scap 3.9.2-1 released in production
- Phabricator upgrade: https://phabricator.wikimedia.org/phame/post/view/147/projects_forms_and_subtypes_oh_my/
- Published the ISOSTWG results and recommendation on officewiki and announced: https://office.wikimedia.org/wiki/Internal_Support_for_Open_Source_Tools_Working_Group
- swat tags now show up in the deployment schedule (via lua magic)
- Blog post: https://phabricator.wikimedia.org/phame/post/view/152/help_my_ci_job_fails_with_exit_status_-11/
- CI future WG report: https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/CI_Futures_WG/Report
Q4 Goals planning
[edit]- etherpad: https://etherpad.wikimedia.org/p/releng-1819Q4-goals
- Due: Monday March 18th, aka this Friday
Posted online at their respective locations:
- https://www.mediawiki.org/wiki/Wikimedia_Technology/Annual_Plans/FY2019/TEC12:_Developer_Productivity/Goals#Q4_Goals
- https://www.mediawiki.org/wiki/Wikimedia_Technology/Annual_Plans/FY2019/TEC3:_Deployment_Pipeline/Goals#Q4_Goals
- https://www.mediawiki.org/wiki/Wikimedia_Technology/Annual_Plans/FY2019/TEC13:_Code_Health/Goals#Q4_Goals
- https://www.mediawiki.org/wiki/Wikimedia_Technology/Annual_Plans/FY2019/TEC1:_Reliability,_Performance,_and_Maintenance/Goals#Q4_Goals
Annual Planning is coming up
[edit]- 2019-03-13: I emailed mark re future testing/"evaluation" environments
- See notes here: https://docs.google.com/document/d/1QU_6Svn4iduK0TPLSOghYP4g1lK-byCv-0ZKoHfIAVY/edit#heading=h.6gq2j7lm5pz8
- 2019-03-18: updates....
- Something new this year
- ...
Incoming/Needs attention
[edit]- Jenkins upgrade
- Antoine is doing it now :)
branch cutting
[edit]- our current branch cut method is broken due to HTTP Token on gerrit being disabled for security reasons.
- TODO: create a task about this, add to train as a blocker
- Tyler and Mukunda and $OTHERS to chat after this meeting
- 2019-03-25: any other follow up needed?
- Zeljko has managed to cut branch for last week's train
Scrum of Scrums
[edit]- Greg to copy to etherpad after meeting: https://etherpad.wikimedia.org/p/Scrum-of-Scrums
Incoming from last week
[edit]- Blocking:
- https://gerrit.wikimedia.org/r/#/c/integration/config/+/496843/ (from stas)
- "Undeploy UserMerge Extension from WMF production" - https://phabricator.wikimedia.org/T216089 but blocked by T218160 which needs input from MWCPT
- James volunteers to remove it :)
Outgoing this week (wrong section heading is on purpose for copy/pasting into Scrum of Scrums etherpad
[edit]Release Engineering
[edit]- Blocked by:
- Blocking:
- Updates:
- Wikimedia Release Engineering Team/CI Futures WG/Report https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team/CI_Futures_WG/Report https://phabricator.wikimedia.org/phame/post/view/153/ci_working_group_report_with_recommendations_of_new_tools_to_try/
- Train Health:
- Last week: 1.33.0-wmf.22 - https://phabricator.wikimedia.org/T206676
- This week: 1.33.0-wmf.23 - https://phabricator.wikimedia.org/T206677
- T218940 Exception "At least one of: RCID, revision ID, and log ID MUST be specified" from ManualLogEntry::publish [moved from wmf.22]
- Next week: 1.33.0-wmf.24 - https://phabricator.wikimedia.org/T206678
- Code Health:
- T219156 Generate baseline analysis of all extensions
Callouts
[edit]- Release Engineering
Train status and happenings
[edit]
Quarterly Goals for Q3
[edit]https://www.mediawiki.org/wiki/Wikimedia_Technology/Goals/2018-19_Q3
TEC1 (Maint): Outcome 1 / Output 1.1
[edit]- GOAL: Automate the generation of change log notes
- WHO: Mukunda, (Tyler on backup)
- In progress should now run on branch cut https://integration.wikimedia.org/ci/job/train-deploy-notes/
TEC1 (Maint): Outcome 1 / Output 1.1
[edit]- GOAL: Investigate notification methods for developers with changes that are riding any given train
- WHO: Mukunda, Tyler
TEC3 (Pipeline): Outcome 1 / Output 1.2
[edit]- GOAL: Instrument Quibble for data collection
- WHO: Mukunda, Antoine
- I haven't gotten any responses about where to put the data. Hopefully graphite & promethius will work. Otherwise I guess logstash?
TEC3 (Pipeline): Outcome 1 / Output 1.2
[edit]- GOAL: Create a graph where time is spent and make a prioritized list for improvements.
- WHO: Mukunda, Antoine
TEC3 (Pipeline): Outcome 2 / Output 2.1
[edit]- GOAL: Select and integrate a code health metric solution into our tooling.
- WHO: JR, ...
- Done SonarQube is currently integrated into our CI on the experimental pipeline.
TEC3 (Pipeline): Outcome 3 / Output 3.1
[edit]- GOALS:
- Adopt more services into Deployment pipeline - task T212801
- cxserver, ORES (partially), citoid, changeprop, cpjobqueue (stretch)
- Deploy eventgate
- Adopt more services into Deployment pipeline - task T212801
- WHO: Dan, Tyler, Lars
- In progress cxserver
- Images built via deployment pipeline
- Namespaces created for k8s eqiad/codfw
- helm charts created
- Done citoid
- Images built via deployment pipeline
- Deployed
- Traffic switched
- changeprop
- Done eventgate
- In progress ORES
- cf: Dan's comments
TEC12 (DevProd): Outcome 1 / Output 1.1
[edit]- GOAL: Conduct interviews with development stakeholders and compile a report that informs future work creation of a rubric.
- WHO: Jeena, Mukunda
- Done Results are posted: https://www.mediawiki.org/wiki/Developer_Satisfaction
TEC13 (Code Health): Outcome 1 / Output 1.1
[edit]- GOALs:
- Develop and communicate guidelines and best practices for successful Code Stewardship.
- (Continued from Q2) Update/refresh review queue (review process for initial code deployment)
- WHO: JR
- worked on last week. Wrapping up this week.
TEC13 (Code Health): Outcome 2 / Output 2.2
[edit]- GOAL: 5 of the 15 prioritized repositories have at least 1 end-to-end test - task T206621
- WHO: Zeljko
TEC13 (Code Health): Outcome 2 / Output 2.3
[edit]- GOALs:
- Evolve/develop tools and processes to support the PE refactoring effort to improve code health.
- Develop common test strategy that enable teams to engage in more effective and efficient testing practices. (maybe should be output 2.4?)
- WHO: JR, Core Platform Team
Done action list in place
- worked on test strategy last week. Wrapping up this week.
TEC13 (Code Health): Outcome 3 / Output 3.2
[edit]- GOALs:
- Speak at All Hands on the status of Technical Debt
- Engage and coach development teams on their approach to managing technical debt.
- WHO: JR, Core Platform Team
TEC13 (Code Health): Outcome 4 / Output 4.1
[edit]- GOALs: Code Health Dashboard with 50% of repositories covered.
- WHO: JR, Core Platform Team
Other non-goal work
[edit]Selenium
[edit]Gerrit
[edit]- thcipriani: I want to make ACL changes
- thcipriani: I want to turn back on http tokens
Phabricator
[edit]Jenkins
[edit]QA/Code Health
[edit]SCAP
[edit]Standup!
[edit]Antoine
[edit]- What I plan to do this week
- Quibble patches + release + deploy
- Zuul patches if at all possible
- Gerrit rights
- Catchup on CI working group
- What I'm blocked on
- Definitely need a pair of eyes for Quibble arguments handling https://phabricator.wikimedia.org/T218357
- Other?
Brennen
[edit]- What I plan to do this week
- Final CI WG meeting Monday, associated tasks.
- Return focus to local-charts dev
- Follow up on Gerrit learning
- Follow up on new developer docs question before Docker SIG meeting Thursday
- What I'm blocked on
- Other?
Dan
[edit]- What I plan to do this week
- TRAAAAAAIN 🚂
- Full tilt (in the margins) on .pipeline/config.yaml https://phabricator.wikimedia.org/T210267
- Had thoughts on two different execution plan formats over the weekend. Could use opinion(s)
- What I'm blocked on
- Other?
Greg
[edit]- What I plan to do this week
- Gerrit meeting
- Quality and Test Engineering sub-team discussion with T&C most likely
- Offsite program planning
- Team process proposal (uhoh! ;) )
- Annual planning, make a meeting (and process on how to do it) in early April for async releng team planning
- Move branch cut for REL_1.33 forward, deal with phab train blocker tasks @waiting on mukunda re https://phabricator.wikimedia.org/P8258
- Read some CD book :)
- What I'm blocked on
- stupid head cold
- Other?
James
[edit]- What I plan to do this week
- Structured Data on Commons team support (nominally the last week I'm doing this?)
- Was fiddling with JS code coverage of MW core; will poke this some more.
- What I'm blocked on
- –
- Other?
- Yay for UBNs.
Jean-Rene
[edit]- What I plan to do this week
- Wrap up Q3 goals for Code Stewardship best practices and Test Strategy
- What I'm blocked on
- Other?
Jeena
[edit]- What I plan to do this week
- Merge local-charts mediawiki installation into master pending approval. I have tested various configurations of services hosted in minikube and outside and all seems well.
- Add documentation / install script for Mac OS local-charts setup
- Read book
- What I'm blocked on
- Other?
- Not here Monday
Lars
[edit]- What I plan to do this week
- Read CD book
- Read Go book
- Read Blubber code
- Finish CI future WG, publish report, deal with reactions
- What I'm blocked on
- pain in the neck
- Other?
Mukunda
[edit]- What I plan to do this week
- Finish https://phabricator.wikimedia.org/T195061 (done)
- Make phabricator search work with elasticsearch 6
- This is currently somewhat broken due to a hasty revert a few weeks ago.
- https://phabricator.wikimedia.org/T181393
- Fix conduit access for the release_date field.
- Needed so task series' can be created/updated.
- https://phabricator.wikimedia.org/T219192
- What I'm blocked on
- Other?
Tyler
[edit]- What I plan to do this week
- Gerrit ACL updates
- Gerrit 2.15.12
- Gerrit ReadOnly plugin
- What I'm blocked on
- Other?
Zeljko
[edit]- What I plan to do this week
- T219156 Generate baseline analysis of all extensions
- What I'm blocked on
- Other?
Grooming
[edit]Team Kanban Board Review and Triage
[edit]- closed and touched in the 7 days
- No update for 4 weeks
- No update for 3 weeks
- No update for 2 weeks
- No update for 1 week
- All Open
- Review To Triage column of #releng
Once / month-ish review of backlog(s)
[edit]- releng Review To Triage column of #releng
- releng-kanban Review unassigned in kanban
- releng-kanban Review 'backlog' colum of -kanban
- releng-next - Review for things we need to put on our kanban backlog
- releng-backlog - oh my, the huge backlog of things...