Wikimedia Release Engineering Team/Checkin archive/20170123
Appearance
2017-01-23
[edit]Vacations/Important dates
[edit]- Jan 26-27: Chad, maybe
- February 20: President's Day
- March 13: Monthly day off
- April 14: Monthly day off
Team Business
[edit]Time spent spreadsheet
[edit]
Rotating positions and absences
[edit]Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers
Jan 23 and Jan 30
[edit]
Feb 6 and Feb 13
[edit]Actions from last meeting
[edit]- Greg: reply to martin
Scrum of Scrums
[edit]- https://phabricator.wikimedia.org/project/board/64/
- Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R
This week
[edit]- Blocking
- Blocked
- Updates
- scap 3.5 planned for this week
Last week
[edit]- Blocking
- Blocked
- Updates
- Train/deploys back to normal
Other Team Business
[edit]Volunteer deployers ?
[edit]- Add more Volunteers? Is there any specific policy. Directed one at Greg.
- https://wikitech.wikimedia.org/wiki/SWAT_deploys#New_SWAT_Team_member_check-list
- Need trust, technical endorsement (eg approve kabal of deployers). Directed to Greg for questions.
- https://wikitech.wikimedia.org/wiki/SWAT_deploys#New_SWAT_Team_member_check-list
- Greg hasn't responded yet :/
- TODO: Greg to email Martin
Mid-year check-in
[edit]- Next week...
Quarterly Review
[edit]- Friday at 8am... ugh. Greg'll go. No one else needs to.
- https://docs.google.com/presentation/d/1V6H_ebe0WTQey4AsivgF7j7BrsEnX6ystKgSa7wO_eA/edit#slide=id.g1b66bc6307_0_90
Annual Planning
[edit]- https://etherpad.wikimedia.org/p/releng-annual-intention-fy1718
- From Marko: https://docs.google.com/a/wikimedia.org/document/d/1aa6uO9uqEhe5lNetmluIgBDh3JVAQ4GTbw-jOc-qu9M/edit?usp=sharing
Q3 goal/project check-in
[edit]Continuous Integration Infrastructure modernization
[edit]- Gather requirements for new CI system - task T153270
- Tyler will schedule stalk people
- Status?
- Want a preliminary meeting with dan/hashar to get on same page before bringing in others (had a brief one with dan)
- Tuesday 9am-9:30am pst?
- ^ works for marko and giuseppe (other folks targetted for meeting); cuts it close for hashar
- purpose: preliminary requirements, scope, initial POC targets
- short: 30mins
- There is a workboard now: https://phabricator.wikimedia.org/project/view/2453/
- Just getting started
Migrate MediaWiki deploys to scap3 (part 2 — This time, it's personal; A.K.A Scappy Strikes Back)
[edit]Build fanout support in scap3
[edit]3.5.0 -- this week! On beta
Changelog
[edit]MediaWiki
[edit]- sync-dir and sync-file are now the same command
- sync-dir is deprecated
- l10n-purge is no longer a command
- Flatten the deployment directory into a single git repository (prep for git sync)
- /srv/mediawiki-staging is many git repos
- /srv/medaiwiki is one git repo
- Canaries now use explicit service for logstash_checker.py (checks fatals too)
- old proxies and canaries (not in mw-installation) ignored
- Fix for git-cache-info (sha1 regex)
Services/Scap3
[edit]- (no message) -> (no justification)
- Improved rollback behavior
- all groups rolled back
- per group and global failure limit
- skip rollback where host failed due to ssh
General/Fun
[edit]- optional fancy progress bar
- improved cowsay compatibility for scap say
Phabricator
[edit]- Re-evaluate and improve search functionality in Phabricator - task T146843
- Making good progress on ElasticSearch query optimization. I have a working prototype and I hope to deploy that this week for testing.
Non-Quarterly goal work
[edit]Browser tests
[edit]- T155640 selenium-Core Jenkins job failing
- fixed
- T155794 Browser test Jenkins videos are corrupt
- low prio
- T139740 Port Selenium tests from Ruby to Node.js
- looked into credential storage libraries
Beta Cluster
[edit]People status updates
[edit]Antoine
[edit]Last week
[edit]- rspec puppet polish up
- run qunit/phpunit for MediaWiki release tarballs (WIP) https://integration.wikimedia.org/ci/job/mediawiki-releases/
- + related mw ext fix
- clean up of Gerrit changes
This week
[edit]- contint2001
- doc for rspec puppet
- finish MediaWiki (tarball) releases test job https://integration.wikimedia.org/ci/job/mediawiki-releases/
- get a bump of Nodepool pool
Chad
[edit]Last week
[edit]Train, multiversion cleanups, scap, gerrit
This week
[edit]Dan
[edit]Last week
[edit]This week
[edit]JR
[edit]Last week
[edit]QA Interview prep (question, people), Incident Review, Wramp-up cont...
This week
[edit]Identify first pass interviewees and schedule interviews, build knowledge re CI now and future, build knowledge of current QA/Test processes.
Mukunda
[edit]Last week
[edit]- Phabricator Phabricator Phabricator
- Optimized Phabricator's ElasticSearch query builder.
This week
[edit]- Deployment train, 1.29.0-wmf.9 / T154683
- Deploy ~2 months worth of phabricator updates.
Tyler
[edit]Last week
[edit]- Scap 3.5.0
- Setup some kind of requirements gather meeting for CI thangs.
This week
[edit]- scap 3.5.0
- Future of CI prep stuffs
- Git fat deployment?
- would like to poke at some puppet updates: scap/ci-staging
Željko
[edit]Last week
[edit]- jet lag
- T155640 selenium-Core Jenkins job failing
- T155794 Browser test Jenkins videos are corrupt
This week
[edit]- T139740 Port Selenium tests from Ruby to Node.js
- T152963 Increase in failures caused by Saucelabs
- T152432 Make it possible to execute tests as a specific (new) MediaWiki user on beta cluster