Skip to content

feat(circleci): Cherry Pick #7820 #7986 #8341

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Mar 19, 2025

Conversation

magichair
Copy link
Contributor

Summary

What does this PR do?

Re-introduces two PRs that fix various issues with the circleci plugin #7820 and #7986

Nickcw6 added 2 commits March 18, 2025 09:37
* feat(api_collector_stateful): handle case were response has records from both before & after createdAfter of last collection

* feat(circleci-plugin): incremental collection for pipelines

* feat(api_collector_stateful): expose Input collector arg for StatefulFinalizableEntity to collect data based on previous collection

* feat(circleci-plugin): incremental data collection for workflows

* feat(circleci-plugin): incremental data collection for jobs

* refactor(circleci-plugin): use common query param function

* refactor(circleci-plugin): use BuildQueryParamsWithPageToken func when collecting unfinished job details
* fix(circleci-plugin): only collect pipelines from after data time range

* fix(circleci-plugin): ignore 404 not found when collecting jobs or workflows
@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Mar 18, 2025
@dosubot dosubot bot added cherrypick This PR is cherry-picked from another branch component/plugins This issue or PR relates to plugins labels Mar 18, 2025
@klesh
Copy link
Contributor

klesh commented Mar 19, 2025

Thanks!
Will release a new beta this week.

@klesh klesh merged commit 80ec49b into apache:main Mar 19, 2025
9 of 10 checks passed
Comment on lines +62 to +64
if isIncremental {
clauses = append(clauses, dal.Where("created_date > ?", createdAfter))
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@klesh this brought in a regression it looks like. Something is missing with regards to migrations - I'm still investigating, but my local deploy of this didn't do well in the first incremental attempted job.

Copy link
Contributor

@Nickcw6 Nickcw6 Mar 19, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jibsen-vh I think it's because the changes from this PR were not cherrypicked: #7757

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cherrypick This PR is cherry-picked from another branch component/plugins This issue or PR relates to plugins size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy