Wikimedia Quality and Test Engineering Team/Office Hours/2022

2022-11-07

Attendees: Dom, Elena

Topics:

Good test data for testing diffs?

2022-10-31

Attendees: Zeljko, Dom, Stef, Elena, George, Vaughn

Testing Computer Software by Kaner et al meeting

2022-10-24

Attendees: Elena, Vaughn - (Vaughn time-zone testing ( an insightful dissertation - https://phabricator.wikimedia.org/T316688#8336443 ) - (Elena) wikifunctions testing for (Abstract Wikipedia) - https://wikifunctions.beta.wmflabs.org/wiki/Special:CreateZObject?view=zobject-editor

2022-10-17

Attendees: Elena, Dom, George, Zeljko, Vaughn

2022-10-10

Attendees: Jackeline, Zeljko, Dom, Peter, Vaughn

https://phabricator.wikimedia.org/T318599 Developers/Maintainers graph automation

2022-10-03

Attendees: Dom, George, Zeljko, Peter, Vaughn

2022-09-26

Attendees: Zeljko, Dom, Elena Topics: - Book Club (Monthly on the last Monday) - We are reading Testing Computer Software (Cem Kaner, Jack Falk, Hung Q. Nguyen) - https://phabricator.wikimedia.org/T311842

2022-09-19

Attendees: George, Zeljko, Vaughn

2022-09-12

Attendees: Elena, George, Zeljko, Vaughn

2022-09-05

Attendees: Dom, Zeljko, Vaughn Topics:

   * New watercooler?
   * Thursday at around 1400UTC
   * Selenium on test2wiki
   * Need to get a test user setup (Dom will try to sort that out)
   * Discuss with k8s team about running when they deploy
   * Support for George while Dom is away
   * It would be useful to get his local docker environment working (he is on Windows)
   * Book Club
   * Discussed new times to hold the meeting

2022-08-29

Attendees: Elena, George, Vaughn, Željko Topics: - Book Club (Monthly on the last Monday) - We are reading Testing Computer Software (Cem Kaner, Jack Falk, Hung Q. Nguyen) - https://phabricator.wikimedia.org/T311842

2022-08-22

Attendees: Dom, Elena, Zeljko, George Topics:

Getting Selenium and API tests running on test2wiki (for the test2wiki k8s migration project)
VisualEditor watchlist accessibility - use-case for accessibility playbook (the accessibility playbook link is here, in case people did not see it: https://docs.google.com/document/d/1QUw-ClLIDxzY3ShDHMGuewn7NR4Z3a4pP2XlUhitr0g/edit)
- I wrote it up, see: https://docs.google.com/document/d/1QUw-ClLIDxzY3ShDHMGuewn7NR4Z3a4pP2XlUhitr0g/edit#heading=h.e9cd5glhzv6p

2022-08-15

Attendees: Elena, Dom - (ET) QA Abstract Wikipedia Testing Playbook https://docs.google.com/document/d/1mtOoJ0pyYxnDAUiLzkEGfoMguLAmFXa3Z0VW2UK0DS4/edit#heading=h.ldf8bwrxezwh - Prototype for testing thumbor: https://gitlab.wikimedia.org/dwalden/thumbor-testing/-/blob/main/comparison_prototype.sh

2022-08-08

Attendees: Dom, Elena, Vaughn

2022-08-01

Attendees: Dom, Elena

2022-07-25

Attendees: Dom

2022-07-18

Attendees: Elena, Dom, Vaughn

ET: mediawiki update on docker
- Do the "git pull", etc. to update the repositories
- docker-compose up -d && docker-compose exec mediawiki composer update && docker-compose exec mediawiki php maintenance/update.php --quick

2022-06-27

Attendees: Dom, Elena, Zeljko, Vaughn, Derrick

Presentation on OWASP ZAP (if people still want this)
https://survey.stackoverflow.co/2022

2022-06-13

Attendees: Dom, Željko

How do I run logstash locally?

2022-06-06

Attendees: Elena, Dom, Zeljko, Vaughn, Peter, Derrick

BackstopJS Report
- https://pixel.wmcloud.org/desktop/index.html
- https://github.com/nicholasray/pixel
- [betalabs] Non-responsive sticky header appears on Special and Talk pages https://phabricator.wikimedia.org/T309370
- [GOAL] Leverage Automated Visual Regression Testing https://phabricator.wikimedia.org/T302246
How to setup a wiki farm with CentralAuth locally

2022-05-23

Attendees: Dom, Elena, Zeljko, Vaughn, Peter

Draft: Crowd-sourced list of proposed engineering priorities in Wikimedia Foundation engineering https://docs.google.com/document/d/1XY291UC-PJbUWHUEG_lVKM3-lIaT_x2U1bwE4Mr8-s0/edit#
https://versions.toolforge.org/
Beta Cluster’s Future https://docs.google.com/document/d/10JwPxx-6AUgLZ46LTCZvLOl4faPAtxrnEI5ZxnsVQ14/edit?usp=sharing
ET: QA handoff? - thx, Vaughn!
Please complete your respective team's readiness review for k8s migration https://www.mediawiki.org/wiki/User:DWalden_(WMF)/Test2wiki_k8s_migration#Team_testing_readiness (you should have a slack message from me, if not, you can ignore this)
Professional development https://office.wikimedia.org/wiki/Staff_handbook/Benefits#Growth

2022-05-16

https://phabricator.wikimedia.org/T302246 - QTE involvment?

2022-05-09

Attendees: Zeljko, Dom, Elena, Vaughn, Peter Topics:

Intro to Mediawiki Testing for Ghana Technical Community
- only automation testing?
- do we have some ready to do QA tasks to give Ghana Technical Community to work on?
- Selenium Tests for VisualEditor https://phabricator.wikimedia.org/T296187
- https://www.mediawiki.org/wiki/Technical_contributor_onboarding
Introductions (new people)
Meetings (advice to new people)

2022-05-02

Attendees: Jackeline, Elena, Vaughn, Ezekiel, Željko Topics:

Accessibility

2022-04-11

Attendees: Dom, Elena, Zeljko, Vaughn, Derrick, Esther, Jackeline

Topics:

QTE pairing https://phabricator.wikimedia.org/T300290
Explore It! https://phabricator.wikimedia.org/T301379

local development environment

shared testing environment
- https://www.mediawiki.org/wiki/Beta_Cluster
- https://patchdemo.wmflabs.org/
  - https://github.com/MatmaRex/patchdemo

2022-04-04

Attendees: Elena, Dom, Željko

Topics:

Data³ https://www.mediawiki.org/wiki/Data%C2%B3
a good overview of Selenium tests by extension: https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php72-docker/143365/console with the performance checks.
I experimented with a "low-tech test dashboard" (from Lessons Learned) for IPInfo testwiki deployment testing https://www.mediawiki.org/wiki/User:DWalden_(WMF)/IPInfo/Testwiki_Deployment_Testing_Matrix
Book club https://phabricator.wikimedia.org/T247665
- Selecting the next book https://app.slack.com/client/T024KLHS4/C01935QKL3S/thread/C01935QKL3S-1648564519.851039
- Should we open it for the entire wmf?
Office hours
- Should we open it for the entire wmf?
Any feedback on QTE pairing? https://phabricator.wikimedia.org/T300290

2022-03-28

Attendees: Željko, Dom, Ezekiel, Derrick, Jackeline

Topics:

Vagrant: this has been "replaced" by MediaWiki Docker so if there is a problem with following the Get Started guide (https://www.mediawiki.org/wiki/MediaWiki-Vagrant), skip it.

- Ezekiel has come across a few pages on Media Wiki with links to other pages and was wondering why they do not open up in a new browser tab by default.

Explore It https://phabricator.wikimedia.org/T301379
QTE reading club https://phabricator.wikimedia.org/T247665
QTE pairing https://phabricator.wikimedia.org/T300290
Investigate why Selenium tests are being skipped and get delete page tests running on Beta https://phabricator.wikimedia.org/T303737
Switch to spec reporter https://phabricator.wikimedia.org/T280331

2022-03-21

Attendees: Elena, Dom, Esther, Zeljko, Emeka

Topics: ET: SonarClouds provides coverage for unit testing? - https://doc.wikimedia.org/cover/ - https://sonarcloud.io/organizations/wmftest/projects ET: Test documentation? https://www.mediawiki.org/wiki/User:Etonkovidova/GrowthExperiments

2022-03-14

Attendees: Elena, Dom, Zeljko

Topics:
Elena:

- https://github.com/wikimedia/operations-mediawiki-config/blob/master/wmf-config/InitialiseSettings.php - the automation tests were (are) run on test2wiki? 'qa_automation' => [ // For browser tests, T60375 and T63799

2022-03-07

Attendees: Dom, Elena

Topics: Dom:

Should we increase Selenium testing coverage?
- e.g. testing deleting pages, looking at revision history
- catch bugs like https://phabricator.wikimedia.org/T303033, https://phabricator.wikimedia.org/T302887
- Or, would it be better via API tests?
Do we have tools for reliability testing?
- E.g. to simulate multiple users performing the same action at the same time (to catch race-conditions, etc.)
- I wrote my own using python multiprocessing module (https://docs.python.org/3/library/multiprocessing.html ), but not sure if such a thing already exists - https://gitlab.wikimedia.org/dwalden/misc/-/blob/main/delete_page_concurrent.py
Beta has been unreliable the last few days - https://phabricator.wikimedia.org/T302699

2022-02-28

Attendees: Dom, Elena, Željko

Elena: https://phabricator.wikimedia.org/T302489 - the discussion/evaluation of Cypress testing framework for Lang team

2022-02-21

Attendies: Elena, Željko, Dom

Dom
- adding this meeting (office hours) to the staff calendar: https://office.wikimedia.org/wiki/ITS/Calendars

Željko
- T301379 Explore It! -- Reduce Risk and Increase Confidence with Exploratory Testing
- T300290 QTE pairing
- T301697 Investigate synthetic testing
- T280652 Delete tests disabled for more than 1 year

Elena
- Best Practices Playbook

2022-02-14

Attendies: Elena, Dom, Ima, Željko

ET: can we take a look at https://phabricator.wikimedia.org/T301463 ?
ET: I was really impressed with Chapter 5: Automating Testing (Lessons learned). Especially Lesson 113: "Capture replay fails" - I did not know that the ability to compare the screenshots taken at the certain checkpoints (without programmin) existed 20 years ago.

QTE pairing https://phabricator.wikimedia.org/T300290

2022-02-07

Attendees: Elena, Dom, Zeljko

QTE pairing https://phabricator.wikimedia.org/T300290
QTE reading club https://phabricator.wikimedia.org/T247665

2022-01-31

Attendees: Dom, Zeljko, Osama

Book club today! Lessons Learned in Software Testing https://phabricator.wikimedia.org/T293880

2022-01-24

Attendees: Elena, Dom, Zeljko, Osama

https://en.wikipedia.org/wiki/Responsibility_assignment_matrix

Dom:

Please add your lessons learned to https://www.mediawiki.org/wiki/Wikimedia_Quality_and_Test_Engineering_Team/Lessons_learned_testing_MediaWiki_and_associated_software
- Any mistakes you have made and learned from, or anything you just think is good advice

2022-01-17

Attendees: Dom, Zeljko, Osama

Dom:

Please add your lessons learned to https://www.mediawiki.org/wiki/Wikimedia_Quality_and_Test_Engineering_Team/Lessons_learned_testing_MediaWiki_and_associated_software
- Any mistakes you have made and learned from, or anything you just think is good advice

Osama

2022-01-10

Attendees: Dom, Esther, Zeljko, Osama, Soham

Selenium Tests failing for CLI on Mac https://phabricator.wikimedia.org/T298882
Outreachy feedback for Osama Tahir https://phabricator.wikimedia.org/T297488
Refactor MediaWiki Core WebdriverIO tests from sync to async mode https://phabricator.wikimedia.org/T293071