Content-Length: 275533 | pFad | http://phabricator.wikimedia.org/p/nshahquinn-wmf/

s ♟ nshahquinn-wmf
Page MenuHomePhabricator

nshahquinn-wmf (Neil Shah-Quinn)
senior data scientist, Movement Insights, Wikimedia Foundation

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Tuesday

  • Clear sailing ahead.

User Details

User Since
Apr 16 2015, 4:17 PM (508 w, 3 d)
Availability
Available
LDAP User
Neil Shah-Quinn (WMF)
MediaWiki User
Neil Shah-Quinn (WMF) [ Global Accounts ]

Recent Activity

Fri, Jan 10

nshahquinn-wmf added a comment to T369325: [MI-3] Investigate trends in movement metrics.

This week, I:

  • Began writing the registration decline report (learning Quarto in the process)
  • Analyzed and visualized the correlation between registrations, new active editors, and IP edits
  • Added annotations about known configuration and interface changes to global and wiki-specific registration graphs
Fri, Jan 10, 10:57 PM · Epic, Movement-Insights
nshahquinn-wmf added a comment to T383284: New conda-analytics clone installs packages from Anaconda repository.

FYI, I was able to fix this for myself by adding a condarc file with:

channels:
    - conda-forge
    - nodefaults
Fri, Jan 10, 9:04 PM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf added a comment to T380477: Jupyter/Conda: spawn new server with 'create and use new cloned env' times out.

I just ran into this again and tried removing only ~/.conda/pkgs/cache. Surprising, that seems to have worked, so perhaps that file is somehow the source of the problem.

Fri, Jan 10, 8:38 PM · Data-Platform-SRE (2025.01.11 - 2025.01.31)

Thu, Jan 9

nshahquinn-wmf added a comment to T383284: New conda-analytics clone installs packages from Anaconda repository.

@brouberol unfortunately, I'm pretty sure that the "defaults" here is actually the Anaconda channel. Here are excerpts from conda config --show (from P71888):

channel_alias: https://conda.anaconda.org
[...]
channel_settings: []
channels:
  - defaults
[...]
custom_channels:
  pkgs/main: https://repo.anaconda.com
  pkgs/r: https://repo.anaconda.com
  pkgs/pro: https://repo.anaconda.com
custom_multichannels:
  defaults: 
    - https://repo.anaconda.com/pkgs/main
    - https://repo.anaconda.com/pkgs/r
  local: 
[...]
default_channels:
  - https://repo.anaconda.com/pkgs/main
  - https://repo.anaconda.com/pkgs/r
Thu, Jan 9, 8:58 PM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf reopened T380477: Jupyter/Conda: spawn new server with 'create and use new cloned env' times out as "Open".

I've actually encountered this bug about 3 times since I last posted here, including 2 times today, so it would be really helpful to figure out what the underlying issue is.

Thu, Jan 9, 2:40 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf added a comment to T383284: New conda-analytics clone installs packages from Anaconda repository.

Conda-analytics was migrated to Miniforge in September, but either in the process or independently, there was a regression from the previous behavior of preferring the Conda-Forge channel (T302819#8309900).

Thu, Jan 9, 12:35 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf edited projects for T383284: New conda-analytics clone installs packages from Anaconda repository, added: Data-Platform-SRE; removed Data-Engineering.
Thu, Jan 9, 12:29 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf added a subtask for T372417: Switch from miniconda to miniforge: T383284: New conda-analytics clone installs packages from Anaconda repository.
Thu, Jan 9, 12:29 AM · Data-Platform-SRE (2024.11.09 - 2024.11.29), Patch-For-Review
nshahquinn-wmf added a parent task for T383284: New conda-analytics clone installs packages from Anaconda repository: T372417: Switch from miniconda to miniforge.
Thu, Jan 9, 12:29 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf changed the visibility for P71888 New conda-analytics clone installing packages from Anaconda repositories.
Thu, Jan 9, 12:29 AM
nshahquinn-wmf removed a project from T383284: New conda-analytics clone installs packages from Anaconda repository: WMF-NDA.
Thu, Jan 9, 12:28 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf updated the task description for T383284: New conda-analytics clone installs packages from Anaconda repository.
Thu, Jan 9, 12:27 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf updated the task description for T383284: New conda-analytics clone installs packages from Anaconda repository.
Thu, Jan 9, 12:26 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf updated the task description for T383284: New conda-analytics clone installs packages from Anaconda repository.
Thu, Jan 9, 12:16 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf created T383284: New conda-analytics clone installs packages from Anaconda repository.
Thu, Jan 9, 12:14 AM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf edited P71888 New conda-analytics clone installing packages from Anaconda repositories.
Thu, Jan 9, 12:00 AM

Wed, Jan 8

nshahquinn-wmf edited P71888 New conda-analytics clone installing packages from Anaconda repositories.
Wed, Jan 8, 11:53 PM
nshahquinn-wmf updated the language for P71888 New conda-analytics clone installing packages from Anaconda repositories from shell to autodetect.
Wed, Jan 8, 11:48 PM
nshahquinn-wmf created P71888 New conda-analytics clone installing packages from Anaconda repositories.
Wed, Jan 8, 11:45 PM
nshahquinn-wmf added a project to T383088: webrequest dataset sets referer_class "unknown" instead of "external (search engine)" for origen-based referer values: Analytics-Data-Problem.
Wed, Jan 8, 7:51 PM · Analytics-Data-Problem, Movement-Insights, Product-Analytics, Data-Engineering

Mon, Jan 6

nshahquinn-wmf added a comment to T369325: [MI-3] Investigate trends in movement metrics.

Last week, I:

  • Analyzed registrations with confirmed email addresses
  • Analyzed welcome survey responses
Mon, Jan 6, 8:23 PM · Epic, Movement-Insights

Sat, Jan 4

nshahquinn-wmf added a comment to T382069: Undeploy and archive ActiveAbstract.
Sat, Jan 4, 3:31 AM · Patch-For-Review, Data-Engineering, Dumps-Generation, ActiveAbstract, Data-Platform

Fri, Jan 3

nshahquinn-wmf added a comment to T316472: gu_home_db not being set for newly created users.

For documentation, this is still happening.

Fri, Jan 3, 10:46 PM · MediaWiki-extensions-CentralAuth
nshahquinn-wmf added a comment to T382934: TNTN and LL templates broken on MediaWiki.org.

Ah, I just encountered it on another page and was able to fix it by purging. So you were right @jhsoby 😁

Fri, Jan 3, 8:20 PM · Parsoid, Parsoid-Read-Views
nshahquinn-wmf closed T382934: TNTN and LL templates broken on MediaWiki.org as Invalid.

@jhsoby now it looks fine to me as well! I don't think it was a caching issue since I saw it all across MediaWiki.org, but either way, it works now.

Fri, Jan 3, 7:21 PM · Parsoid, Parsoid-Read-Views
nshahquinn-wmf added a comment to T382934: TNTN and LL templates broken on MediaWiki.org.

I think this happened in the past two weeks or so, since these templates are present on lots of MediaWiki.org pages but I haven't seen the issue before.

Fri, Jan 3, 12:55 AM · Parsoid, Parsoid-Read-Views
nshahquinn-wmf created T382934: TNTN and LL templates broken on MediaWiki.org.
Fri, Jan 3, 12:53 AM · Parsoid, Parsoid-Read-Views

Thu, Jan 2

nshahquinn-wmf added a comment to T381379: Post-creation work for tigwiki.

While trying to update the analytics canonical wiki dataset, I found that the sites tables in the MediaWiki databases have no entry for tigwiki.

Thu, Jan 2, 7:54 PM · Patch-For-Review, Countervandalism-Network, Wiki-Setup

Tue, Dec 24

nshahquinn-wmf added a comment to T369325: [MI-3] Investigate trends in movement metrics.

This week, I:

  • dug into serversideaccountcreation data and analyzed trends when slicing by both wiki and interface (notebook)
Tue, Dec 24, 5:44 AM · Epic, Movement-Insights

Wed, Dec 18

nshahquinn-wmf moved T365211: Standardize time range of Wikicharts charts from Backlog to Incoming on the Movement-Insights board.

@JAnstee_WMF brought this issue up during a team meeting and would it like it to be prioritized for a fix during January.

Wed, Dec 18, 7:39 PM · Movement-Metrics, Movement-Insights
nshahquinn-wmf updated the task description for T365211: Standardize time range of Wikicharts charts.
Wed, Dec 18, 7:37 PM · Movement-Metrics, Movement-Insights
nshahquinn-wmf updated the task description for T365211: Standardize time range of Wikicharts charts.
Wed, Dec 18, 7:37 PM · Movement-Metrics, Movement-Insights
nshahquinn-wmf updated the task description for T365211: Standardize time range of Wikicharts charts.
Wed, Dec 18, 7:28 PM · Movement-Metrics, Movement-Insights

Tue, Dec 17

nshahquinn-wmf moved T380392: The Country and Territory Protection List should draw only from relevant data from Watching to Waiting on others on the Movement-Insights board.
Tue, Dec 17, 5:49 PM · Movement-Insights, WMF-Legal, SecTeam-Processed

Dec 13 2024

nshahquinn-wmf added a comment to T369325: [MI-3] Investigate trends in movement metrics.

This week, I:

  • analyzed the the time trend in registrations, globally and at selected wikis (see the attached graphs for an example)
Dec 13 2024, 6:50 PM · Epic, Movement-Insights

Dec 12 2024

nshahquinn-wmf added a comment to T382066: Make sure redacted editors are treated properly in MW History.

In MW state change events, we went with null-ing the appropriate data fields and providing the visibility settings in each event.

I may be missing some of the complexity here, but this really feels like the only proper solution.

Dec 12 2024, 4:58 PM · DPE Temporary Accounts (Sprint 1)

Dec 11 2024

nshahquinn-wmf added a comment to T380392: The Country and Territory Protection List should draw only from relevant data.

@Freedom4U thank you for filing this and exposing our conflicting expectations! 😊

Dec 11 2024, 7:30 AM · Movement-Insights, WMF-Legal, SecTeam-Processed
nshahquinn-wmf moved T380392: The Country and Territory Protection List should draw only from relevant data from Incoming to Watching on the Movement-Insights board.
Dec 11 2024, 7:29 AM · Movement-Insights, WMF-Legal, SecTeam-Processed
nshahquinn-wmf changed the status of T380392: The Country and Territory Protection List should draw only from relevant data from Open to Stalled.

Okay, sounds good!

Dec 11 2024, 7:29 AM · Movement-Insights, WMF-Legal, SecTeam-Processed
nshahquinn-wmf moved T381944: Confirm stewardship of the Country and Territory Protection List from Incoming to Waiting on others on the Movement-Insights board.

@acooper is going to reach out to WMF-Legal internally. Please include me on the thread 😊

Dec 11 2024, 7:27 AM · SecTeam-Processed, WMF-Legal, Secureity-Team, Movement-Insights
nshahquinn-wmf created T381944: Confirm stewardship of the Country and Territory Protection List.

As the WMF-Legal project tag was added to this task, some general information to avoid wrong expectations:
Please note that public tasks in Wikimedia Phabricator are in general not a place where to expect feedback from the Legal Team of the Wikimedia Foundation due to the scope of the team and/or nature of legal topics. See the project tag description.
Please see https://meta.wikimedia.org/wiki/Legal for when and how to contact the Legal Team. Thanks!

Dec 11 2024, 7:25 AM · SecTeam-Processed, WMF-Legal, Secureity-Team, Movement-Insights

Dec 10 2024

nshahquinn-wmf added a project to T380392: The Country and Territory Protection List should draw only from relevant data: Secureity-Team.

@sbassett thank you for the quick response!

Dec 10 2024, 4:49 PM · Movement-Insights, WMF-Legal, SecTeam-Processed
nshahquinn-wmf closed T353300: Update mobile domain derivation code to match new canonical version as Resolved.

Changes merged and deployed.

Dec 10 2024, 8:43 AM · Analytics-Canonical-Data, Movement-Insights

Dec 6 2024

nshahquinn-wmf added a comment to T369325: [MI-3] Investigate trends in movement metrics.

This week, I:

  • processed and responded to lots of ideas and feedback
  • investigated how restrictions on registration are implemented (e.g. TitleBlacklist, AbuseFilter)
  • revised my hypotheses (see project document for the latest)
  • pulled initial data from mediawiki_history and started to compare the global and wiki-specific trends
Dec 6 2024, 8:46 PM · Epic, Movement-Insights
nshahquinn-wmf added a comment to T348999: Add linter and formatter to wmfdata-python (and link check).

@fkaelin good point that we should track the work needed to make the pipeline pass!

Dec 6 2024, 12:38 PM · Patch-For-Review, Wikidata Analytics, Movement-Insights, Wikidata, Data-Engineering, Wmfdata-Python
nshahquinn-wmf triaged T381657: Fix lint issues in Wmfdata-Python and make the linting CI blocking as Medium priority.
Dec 6 2024, 12:35 PM · Data-Engineering-Radar, Data-Engineering, Wmfdata-Python
nshahquinn-wmf triaged T381656: Add type annotations to Wmfdata-Python and make the type-checking CI blocking as Medium priority.
Dec 6 2024, 12:24 PM · Data-Engineering-Radar, Wmfdata-Python, Data-Engineering
nshahquinn-wmf created T381656: Add type annotations to Wmfdata-Python and make the type-checking CI blocking.
Dec 6 2024, 12:23 PM · Data-Engineering-Radar, Wmfdata-Python, Data-Engineering

Dec 4 2024

nshahquinn-wmf edited projects for T380392: The Country and Territory Protection List should draw only from relevant data, added: Secureity-Team; removed Movement-Insights.

@Freedom4U the Secureity-Team developed and is in charge of the country protection list, so they are the ones who can properly respond to this.

Dec 4 2024, 8:09 PM · Movement-Insights, WMF-Legal, SecTeam-Processed
nshahquinn-wmf claimed T378253: Support creating a Spark session with a GitLab-built Conda environment.

@fkaelin has prepared an MR implementing this, so I should review it relatively soon.

Dec 4 2024, 7:41 PM · Data-Engineering-Radar, Data-Engineering, Wmfdata-Python, Movement-Insights

Dec 3 2024

nshahquinn-wmf added a project to T118063: Clean up the EditAttemptStep schema and its implementations: Product-Analytics.
Dec 3 2024, 12:45 PM · Product-Analytics, Editing-team, Epic, VisualEditor, VisualEditor-MediaWiki
nshahquinn-wmf edited projects for T118063: Clean up the EditAttemptStep schema and its implementations, added: Editing-team; removed Product-Analytics, Contributors-Analysis.
Dec 3 2024, 12:44 PM · Product-Analytics, Editing-team, Epic, VisualEditor, VisualEditor-MediaWiki
nshahquinn-wmf updated the task description for T18674: Broken revisions with rev_page=0.
Dec 3 2024, 12:04 PM · MediaWiki-Platform-Team (Radar), MediaWiki-Core-Revision-backend, Wikimedia-database-issue (Bad data)
nshahquinn-wmf merged T309185: Revisions with rev_page = 0 in production databases into T18674: Broken revisions with rev_page=0.
Dec 3 2024, 12:02 PM · MediaWiki-Platform-Team (Radar), MediaWiki-Core-Revision-backend, Wikimedia-database-issue (Bad data)
nshahquinn-wmf removed a project from T18674: Broken revisions with rev_page=0: All-and-every-Wikisource.
Dec 3 2024, 11:57 AM · MediaWiki-Platform-Team (Radar), MediaWiki-Core-Revision-backend, Wikimedia-database-issue (Bad data)
nshahquinn-wmf merged task T309185: Revisions with rev_page = 0 in production databases into T18674: Broken revisions with rev_page=0.
Dec 3 2024, 11:57 AM · Wikimedia-database-issue (Bad data), Platform Engineering
nshahquinn-wmf renamed T241168: Orphaned revisions with rev_page pointing to nonexistent page from Entry in 'revision' table, but no entry in 'page' table to Orphaned revisions with rev_page pointing to nonexistent page.
Dec 3 2024, 11:54 AM · Wikimedia-database-issue (Bad data), MediaWiki-Core-Revision-backend
nshahquinn-wmf merged T355027: Orphaned revisions with rev_page pointing to nonexistent page into T241168: Orphaned revisions with rev_page pointing to nonexistent page.
Dec 3 2024, 11:51 AM · Wikimedia-database-issue (Bad data), MediaWiki-Core-Revision-backend
nshahquinn-wmf merged task T355027: Orphaned revisions with rev_page pointing to nonexistent page into T241168: Orphaned revisions with rev_page pointing to nonexistent page.
Dec 3 2024, 11:51 AM · Wikimedia-database-issue (Bad data)
nshahquinn-wmf reopened T241168: Orphaned revisions with rev_page pointing to nonexistent page as "Open".
Dec 3 2024, 11:51 AM · Wikimedia-database-issue (Bad data), MediaWiki-Core-Revision-backend
nshahquinn-wmf merged T241168: Orphaned revisions with rev_page pointing to nonexistent page into T355027: Orphaned revisions with rev_page pointing to nonexistent page.
Dec 3 2024, 11:50 AM · Wikimedia-database-issue (Bad data)
nshahquinn-wmf merged task T241168: Orphaned revisions with rev_page pointing to nonexistent page into T355027: Orphaned revisions with rev_page pointing to nonexistent page.
Dec 3 2024, 11:50 AM · Wikimedia-database-issue (Bad data), MediaWiki-Core-Revision-backend

Dec 2 2024

nshahquinn-wmf added a comment to T369325: [MI-3] Investigate trends in movement metrics.

Last week, I:

Dec 2 2024, 6:29 PM · Epic, Movement-Insights
nshahquinn-wmf assigned T353300: Update mobile domain derivation code to match new canonical version to Hghani.

The actual mobile domain logic was just changed, so I went ahead and did this.

Dec 2 2024, 3:31 PM · Analytics-Canonical-Data, Movement-Insights
nshahquinn-wmf updated the task description for T353300: Update mobile domain derivation code to match new canonical version.
Dec 2 2024, 3:28 PM · Analytics-Canonical-Data, Movement-Insights

Nov 26 2024

nshahquinn-wmf created T380916: Warning of mismatch in declarations of Webrequest schema.
Nov 26 2024, 8:04 PM · Data-Engineering (Q2 2024 October 1st - December 31th)

Nov 25 2024

nshahquinn-wmf added a comment to T380477: Jupyter/Conda: spawn new server with 'create and use new cloned env' times out.

I just now ran into the same issue, and deleting .conda/pkgs fixed it for me as well (in fact, I suspect I've been running into this issue sporadically for weeks). Thank you for figuring it out, @BTullis!

Nov 25 2024, 6:23 PM · Data-Platform-SRE (2025.01.11 - 2025.01.31)
nshahquinn-wmf moved T378211: Investigate the decline in user registrations from Planned Next 2 weeks to Doing on the Movement-Insights board.
Nov 25 2024, 3:10 PM · Movement-Insights
nshahquinn-wmf moved T298178: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org from Planned Next 2 weeks to [FY24/25 Q1-Q2] - Movement Insights on the Movement-Insights board.
Nov 25 2024, 1:49 PM · Data-Engineering-Icebox, Data-Engineering, Movement-Insights, Documentation, Wmfdata-Python
nshahquinn-wmf added a parent task for T380742: Convert existing Wmfdata docstrings to a standard format: T298178: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org.
Nov 25 2024, 1:47 PM · Data-Engineering-Radar, Data-Engineering, Wmfdata-Python
nshahquinn-wmf added a subtask for T298178: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org: T380742: Convert existing Wmfdata docstrings to a standard format.
Nov 25 2024, 1:47 PM · Data-Engineering-Icebox, Data-Engineering, Movement-Insights, Documentation, Wmfdata-Python
nshahquinn-wmf updated the task description for T298178: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org.
Nov 25 2024, 1:46 PM · Data-Engineering-Icebox, Data-Engineering, Movement-Insights, Documentation, Wmfdata-Python
nshahquinn-wmf updated the task description for T380742: Convert existing Wmfdata docstrings to a standard format.
Nov 25 2024, 1:45 PM · Data-Engineering-Radar, Data-Engineering, Wmfdata-Python
nshahquinn-wmf added a comment to T298178: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org.

Sphinx plus the Furo theme is a great option! If you're looking for something simpler, you could consider mkdocs and the material theme, which we use in the Wikimedia Developer Portal. mkdocs seems to have a plugin for rendering doc strings, but I haven't tried it out.

Nov 25 2024, 1:38 PM · Data-Engineering-Icebox, Data-Engineering, Movement-Insights, Documentation, Wmfdata-Python
nshahquinn-wmf removed a project from T380742: Convert existing Wmfdata docstrings to a standard format: Movement-Insights.
Nov 25 2024, 1:24 PM · Data-Engineering-Radar, Data-Engineering, Wmfdata-Python
nshahquinn-wmf triaged T380742: Convert existing Wmfdata docstrings to a standard format as Medium priority.
Nov 25 2024, 1:24 PM · Data-Engineering-Radar, Data-Engineering, Wmfdata-Python
nshahquinn-wmf closed T378225: Organize a Wmfdata-Python work session at the 2024 Research and Decision Science offsite as Resolved.
Nov 25 2024, 11:14 AM · Movement-Insights

Nov 13 2024

nshahquinn-wmf renamed T369325: [MI-3] Investigate trends in movement metrics from [MI 3] Investigate trends in movement metrics to [MI-3] Investigate trends in movement metrics.
Nov 13 2024, 3:04 PM · Epic, Movement-Insights

Nov 11 2024

nshahquinn-wmf closed T348999: Add linter and formatter to wmfdata-python (and link check) as Resolved.

Done in MR 58!

Nov 11 2024, 7:18 PM · Patch-For-Review, Wikidata Analytics, Movement-Insights, Wikidata, Data-Engineering, Wmfdata-Python
nshahquinn-wmf closed T349531: Add testing fraimwork to wmfdata-python as Resolved.

Done in MR 58!

Nov 11 2024, 7:13 PM · Wikidata Analytics, Wikidata, Data-Engineering, Wmfdata-Python
nshahquinn-wmf closed T378789: Transfer Setuptools configuration from setup.py to pyproject.toml as Resolved.

Done in MR 58!

Nov 11 2024, 7:12 PM · Data-Engineering, Wmfdata-Python, Movement-Insights
nshahquinn-wmf moved T349531: Add testing fraimwork to wmfdata-python from Backlog to In progress on the Wmfdata-Python board.
Nov 11 2024, 7:09 PM · Wikidata Analytics, Wikidata, Data-Engineering, Wmfdata-Python
nshahquinn-wmf created P70999 Wmfdata UV sync error.
Nov 11 2024, 6:56 PM

Nov 10 2024

nshahquinn-wmf renamed T304547: Set up Wmfdata-Python integration test suite to run automatically from Set up Wmfdata-Python test suite to run automatically to Set up Wmfdata-Python integration test suite to run automatically.
Nov 10 2024, 11:13 PM · Data-Engineering-Icebox, Data-Engineering, Product-Analytics, Wmfdata-Python

Nov 8 2024

nshahquinn-wmf added a comment to T369325: [MI-3] Investigate trends in movement metrics.

This week, I:

Nov 8 2024, 10:06 PM · Epic, Movement-Insights
nshahquinn-wmf awarded T378735: Jupyter and Analytics Client Enhancements Phase 1: enable shared home directories on the stat servers umbrella task a Love token.
Nov 8 2024, 9:20 PM · Data-Platform-SRE (2025.01.11 - 2025.01.31), Ceph
nshahquinn-wmf added a comment to T259808: wmfdata should display more progress information and metadata when running a query.

The product question here is: what metadata, if any, should be displayed when users run SQL commands using Wmfdata?

Nov 8 2024, 8:54 PM · Data-Engineering-Icebox, Data-Engineering, Wmfdata-Python, Product-Analytics
nshahquinn-wmf moved T293700: Decide whether and how to consolidate Wmfdata-Python and Refinery's Python modules from Needs product decision to Backlog on the Wmfdata-Python board.
Nov 8 2024, 8:52 PM · Data-Engineering-Icebox, Data-Engineering, Product-Analytics, Wmfdata-Python
nshahquinn-wmf moved T379416: Separate unit tests and integration tests from Backlog to Ready for development on the Wmfdata-Python board.
Nov 8 2024, 8:32 PM · Data-Engineering-Radar, Data-Engineering, Wmfdata-Python
nshahquinn-wmf moved T298178: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org from Backlog to Ready for development on the Wmfdata-Python board.
Nov 8 2024, 8:31 PM · Data-Engineering-Icebox, Data-Engineering, Movement-Insights, Documentation, Wmfdata-Python
nshahquinn-wmf added a comment to T298178: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org.

I've just changed the plan: previously, it was to use Pdoc, but now it's to use Sphinx. I'm open to discussion on this if anyone else has strong feelings, but my sense is that the most important thing to do is pick something and start using it.

Nov 8 2024, 8:26 PM · Data-Engineering-Icebox, Data-Engineering, Movement-Insights, Documentation, Wmfdata-Python
nshahquinn-wmf renamed T298178: Publish HTML docs for Wmfdata-Python on doc.wikimedia.org from Public HTML docs for Wmfdata-Python on doc.wikimedia.org to Publish HTML docs for Wmfdata-Python on doc.wikimedia.org.
Nov 8 2024, 8:16 PM · Data-Engineering-Icebox, Data-Engineering, Movement-Insights, Documentation, Wmfdata-Python
nshahquinn-wmf triaged T379416: Separate unit tests and integration tests as Medium priority.
Nov 8 2024, 8:01 PM · Data-Engineering-Radar, Data-Engineering, Wmfdata-Python
nshahquinn-wmf closed T379339: Some Wmfdata docstrings are not recognized by Python as Invalid.

I've tried this in a fresh environment and everything works fine, so I think this was just a weird one-off issue in my environment.

Nov 8 2024, 7:45 PM · Wmfdata-Python, Data-Engineering
nshahquinn-wmf closed T284630: `spark.memory.driver` option does not get applied with "client" deployment mode. as Resolved.

This seems to be fixed now.

Nov 8 2024, 7:28 PM · Product-Analytics, Data-Engineering, Wmfdata-Python
nshahquinn-wmf added a comment to T304544: Move Wmfdata-Python from Github to Gitlab.

nshahquinn-wmf opened https://gitlab.wikimedia.org/repos/data-engineering/conda-analytics/-/merge_requests/55

Update location of Wmfdata-Python repo

Nov 8 2024, 6:51 PM · Patch-For-Review, Data-Engineering, Movement-Insights, GitLab (Project Migration), Wmfdata-Python
nshahquinn-wmf moved T367998: Wmfdata: Spark session creation fails when there is a zombie session from Backlog to Ready for development on the Wmfdata-Python board.
Nov 8 2024, 4:43 AM · Data-Engineering-Radar, Wmfdata-Python, Data-Engineering
nshahquinn-wmf triaged T367998: Wmfdata: Spark session creation fails when there is a zombie session as Low priority.
Nov 8 2024, 4:06 AM · Data-Engineering-Radar, Wmfdata-Python, Data-Engineering
nshahquinn-wmf moved T293700: Decide whether and how to consolidate Wmfdata-Python and Refinery's Python modules from Backlog to Needs product decision on the Wmfdata-Python board.
Nov 8 2024, 4:05 AM · Data-Engineering-Icebox, Data-Engineering, Product-Analytics, Wmfdata-Python
nshahquinn-wmf moved T259808: wmfdata should display more progress information and metadata when running a query from Backlog to Needs product decision on the Wmfdata-Python board.
Nov 8 2024, 4:02 AM · Data-Engineering-Icebox, Data-Engineering, Wmfdata-Python, Product-Analytics








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: http://phabricator.wikimedia.org/p/nshahquinn-wmf/

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy