Wikimedia Release Engineering Team/Checkin archive/20170315
Appearance
2017-03-15
[edit]Vacations/Important dates
[edit]- March 23-28: Chad in Miami
- March 30, 31: Tyler in Wichita
- March 30-Apr 3: Greg in Berlin (Wikimedia Conference)
- April 10-17 (ish): Dan out
- April 14: Monthly day off
- May 15-18: Team Offsite in Vienna
- May 19-21: EU Hackathon
Team Business
[edit]Time spent spreadsheet
[edit]Rotating positions and absences
[edit]Maniphest query for deployment blocker tasks: https://phabricator.wikimedia.org/u/blockers
Mar 6 and Mar 13
[edit]Mar 20 and Mar 27
[edit]- Train: Tyler (plus Chad for goup2 on March 30th)
- SoS: Chad
- Out:
- March 23-28: Chad in Miami
- March 30, 31: Tyler in Wichita
- Thu March 30 - Mon Apr 3: Greg in Berlin (Wikimedia Conference)
Apr 3 and Apr 10
[edit]Actions from last meeting
[edit]- TODO: Sign up for the Product and Technology consultation if you have any slight amount of interest: https://office.wikimedia.org/wiki/Product_and_Tech_consultation
- Mukunda and Antoine sync up
Scrum of Scrums
[edit]- https://phabricator.wikimedia.org/project/board/64/
- Blocked on us: https://phabricator.wikimedia.org/maniphest/query/h7YTCBTJsepS/#R
This week
[edit]- Blocking
- Blocked
- Updates
This week
[edit]- Blocking
- Blocked
- T139740 Port Selenium tests from Ruby to Node.js, the patch is almost ready, please review https://gerrit.wikimedia.org/r/#/c/328191/
- Updates
Other Team Business
[edit]Keyholder blogpost
[edit]- https://etherpad.wikimedia.org/p/keyholder-blog
- https://docs.google.com/document/d/1kNjUbdI92J1SwENnvBcDdvE4IbqsIb8HzIAj1lwQW4s/edit
- Feedback from Faidon, Ori, bd808: all is well
- Sent ^ google doc to blogteam
Logspam
[edit]
Annual Planning
[edit]Technology-wide planning
[edit]- E_TOOMANYGDOCS
Q3 goal/project check-in
[edit]Continuous Integration Infrastructure modernization
[edit]- Gather requirements for new CI system - task T153270
- Need to dust off specifications that we worked on early, use to evaluate deployment pipeline
- Evaluation of Pearson Deployment Pipeline continues
- k8s infra being build on ci-staging
- kubectl cluster-info => "Kubernetes master is running at http://localhost:8080" !!!
- plugin (god help us all) is installed and ready
- k8s infra being build on ci-staging
- Random aside: can MediaWiki Config live in a containerized world?
- No. Maybe.
- Update from Antoine on yesterday's (Tuesday's) CI backlog
- tl;dr: tons of jobs flooding the system, not directly due to the migration of jobs that happened on Monday (which was a 10% increase)
Migrate MediaWiki deploys to scap3 (part 2 — This time, it's personal; A.K.A Scappy Strikes Back)
[edit]Build fanout support in scap3
[edit]- https://phabricator.wikimedia.org/T121276
- Have a clear course of action to get actionables done by end of quarter (sync git data to proxies post-canary check and just prior to using proxies; also need some minor puppet tweaks for some symlinks and a new vhost)
- Lots of stuff getting done in scap3-MW-MVP (https://phabricator.wikimedia.org/project/view/1823/ )
- Gotta fix up the mergeMessageFileList crap (extension-list)
- rewriting updateWikiversions as scap plugin
- Improved lock handling
Phabricator
[edit]Non-Quarterly goal work
[edit]Browser tests
[edit]- T139740 Port Selenium tests from Ruby to Node.js
- Almost there. No major changes to the commit in the last few weeks. I really think somebody should just push the big red +2 button. We can fix the minor things later.
- T159945 Selenium/WebdriverIO tests in JavaScript/Node.js
- Submitted skill share session for Vienna hackathon.
- T158074 Update Ruby tests to Selenium 3
- Done as far as we are concerned. 3 repositories left to teams to update.
- T152963 Increase in failures caused by Saucelabs
- Looks like T160086 (Upgrade Cucumber from version 1 to version 3) is the simplest way to rerun tests
- T1331 Remove lines from Gemfile that are used by RVM
- Done. An intern did all the work, Antoine and me were reviewing.
Beta Cluster
[edit]People status updates
[edit]Antoine
[edit]Last week
[edit]- Qunit thing from SoS
- Done Chromium upgrade solved it. https://phabricator.wikimedia.org/T153038
- Reviews of Javascript/Selenium for MediaWiki
- Done
- Prepare to upgrade Jenkins on contint2001 (copy data, upgrade, see what happens)
- As time allow (since 02/27)
- migrate PHP 5.3 jobs to PHP 5.5 (due end of march)
- Think about getting more Jenkins instances (beta, one for browser tests, maybe tools-labs)
- Investigated puppetization of Jenkins .xml file. The encryption of secret with a randomly generated salt blocks me. Not sure how to provision that in puppet.
This week
[edit]- {done} read doc about bootstrapvz
- PHP5.3 jobs migrated. Precise instance will be shutdown/deleted on Monday March 20th
- migration to Nodepool mostly complete. Leftover jobs have to be either deleted, move to other jenkins or integrated in existing jobs
- Upgrade Jenkins on contint2001
Chad
[edit]Last week
[edit]- Scap 3
- Quick gerrit downtime (LDAP change)
This week
[edit]- scap scap scap (more scap)
- Did I mention scap?
Dan
[edit]Last week
[edit]- Help break out CI/CD build PoC tasks (set up registry, image config/builder, etc.)
- Play with Pearson Jenkins plugin
- Grab a task and start hacking
This week
[edit]- Continuing to set up and test k8s
JR
[edit]- quality interviews
- CI knowledge building
- bug/defect data wrangling
Last week
[edit]- quality interviews
- met with Andre, Bernd, Giles
- test reporting dashboard
- requirements/highlevel design
- CI knowledge building
This week
[edit]Mukunda
[edit]Last week
[edit]- Deployment Train
- leftover from last week
- dust off the phab milestone scap plugin
- look at making it update the deployment schedule (in addition to the deployment blocker tasks)
- this probably won't happen this week
- dust off the phab milestone scap plugin
- Search engine overhaul
- Another week, another round of code review
This week
[edit]Tyler
[edit]Last week
[edit]- Polish up blog post
- scap3 fanout stuff w/chad
- CI digging deep
This week
[edit]- Scap3 fanout stuff
- Hooking together pieces of Pearson Pipeline w/Dan
- Dusting off critera doc for Pearson Pipeline eval
Željko
[edit]Last week
[edit]- T158074 Update Ruby tests to Selenium 3
- T152963 Increase in failures caused by Saucelabs
- T139740 Port Selenium tests from Ruby to Node.js
- T159931 Provisioning visualeditor role fails with `Unable to locate package zookeeper-server`
- T159945 Selenium/WebdriverIO tests in JavaScript/Node.js
- T160086 Upgrade Cucumber from version 1 to version 3
- T1331 Remove lines from Gemfile that are used by RVM
This week
[edit]- T139740 Port Selenium tests from Ruby to Node.js
- T150435 Selenium tests for VisualEditor in Node.js
- T152963 Increase in failures caused by Saucelabs => * T160086 Upgrade Cucumber from version 1 to version 3