Skip to content

Marks Mac_mokey microbenchmarks to be unflaky #162000

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

fluttergithubbot
Copy link
Contributor

The test has been passing for 50 consecutive runs.
This test can be marked as unflaky.

@flutter-dashboard flutter-dashboard bot added c: flake Tests that sometimes, but not always, incorrectly pass c: tech-debt Technical debt, code quality, testing, etc. labels Jan 22, 2025
@github-actions github-actions bot removed the c: tech-debt Technical debt, code quality, testing, etc. label Jan 22, 2025
@harri35
Copy link
Contributor

harri35 commented Feb 26, 2025

@jtmcdole I guess based on #153828 comments and the recent logs from staging https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_mokey%20microbenchmarks?limit=200, this can be merged?

@jtmcdole
Copy link
Member

@jtmcdole I guess based on #153828 comments and the recent logs from staging https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_mokey%20microbenchmarks?limit=200, this can be merged?

It could be merged, but it could go flakey again in the future due to the random seed.

  1. I could revive my efforts to make these on-demand when launched. I was able to get Android working, but I was stuck with iOS
  2. We could remove the random seed.
  3. Roll the dice.

@harri35
Copy link
Contributor

harri35 commented Mar 5, 2025

@jtmcdole Sorry, my mistake, I was looking at a wrong issue.

Based on Git history of:

flutter/.ci.yaml

Lines 4655 to 4660 in e4c726a

# mac mokey benchmark
- name: Mac_mokey microbenchmarks
recipe: devicelab/devicelab_drone
presubmit: false
bringup: true # Flaky: codefu
timeout: 60

this is the last relevant discussion: #161550 The problem is indeed not fixed. I propose we close this PR without merging.

Note: I was unable to find either a followup issue for #161550 or the bug issue to get benchmarks restartable. Can you point me to it/them? Would be good to link it from here and/or from the YAML, then these PRs bringup=false can be easily dealt with in the future until the issue is fixed :)

Thanks!

@jtmcdole
Copy link
Member

jtmcdole commented Mar 5, 2025

#156506 should be the issue tracking this. I've just been focused on infra and monorepo.

@harri35
Copy link
Contributor

harri35 commented Mar 6, 2025

Cool, I'll close this PR; no point in reenabling it at this stage.
I created a PR to add the issue id for easier discovery in the future: #164694
Thanks!

@harri35 harri35 closed this Mar 6, 2025
github-merge-queue bot pushed a commit that referenced this pull request Mar 12, 2025
…i config for easier discovery (#164694)

Update the comment in .ci.yaml with the issue link for easier discovery.
Related issue: #156506
Related discussion: #162000

## Pre-launch Checklist

- [x] I read the [Contributor Guide] and followed the process outlined
there for submitting PRs.
- [x] I read the [Tree Hygiene] wiki page, which explains my
responsibilities.
- [x] I read and followed the [Flutter Style Guide], including [Features
we expect every widget to implement].
- [x] I signed the [CLA].
- [x] I listed at least one issue that this PR fixes in the description
above.
- [x] I updated/added relevant documentation (doc comments with `///`).
- [x] I added new tests to check the change I am making, or this PR is
[test-exempt].
- [x] I followed the [breaking change policy] and added [Data Driven
Fixes] where supported.
- [x] All existing and new tests are passing.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
c: flake Tests that sometimes, but not always, incorrectly pass
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy