Content-Length: 258560 | pFad | https://github.com/getsentry/sentry-python/issues/4412

7D In-progress check-ins not being sent intermittently with Celery integration · Issue #4412 · getsentry/sentry-python · GitHub
Skip to content

In-progress check-ins not being sent intermittently with Celery integration #4412

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
gaprl opened this issue May 21, 2025 · 4 comments
Open
Labels

Comments

@gaprl
Copy link
Member

gaprl commented May 21, 2025

How do you use Sentry?

Sentry Saas (sentry.io)

Version

2.29.1

Steps to Reproduce

We've recently shipped an improvement to the Crons' monitor details page, and noticed that many in-progress check-ins are never being sent across all of our monitors. To reproduce, just set up our automatic detection integration with Celery and go to the monitor details page.

Expected Result

All check-ins are sending the in-progress check-ins, and not only the completion check-in.

Actual Result

In-progress check-ins are being missed:

Image

Here's some of the impacted monitors:

@antonpirker
Copy link
Member

Hey @gaprl !

Do I get this right: we get ok check-ins for check-ins that we never sent a in_progress check-in?

Can we check on the server if the in_progress check-ins have been received but have been discarded for some reason (like because they are in a wrong format?)

@evanpurkhiser
Copy link
Member

I think the best way to track this down would probably to start by having some mode where the sentry SDK logs when it sends in_progress and when it sends oks, do we have anything like that yet?

Copy link
Member

if you set debug=True you will see that there has been an envelope of type monitor sent (which is a check-in) but you can not see if it is ok/ in_progress
But I guess this would be a nice debug output to have.

@antonpirker
Copy link
Member

Hey @gaprl I now checked the client outcomes in the admin interface and it seems that every once in a while the server is dropping check-ins (here on May 16th there where 16 check-ins dropped):

Image

Can we somehow find out why those where dropped and what check-ins those where?

Another thing that jumped into my eye is that the monitors-detect-broken-monitor-envs are all very short lived tasks (sometimes only 100ms long). We had a problem before where check ins where processed in the wrong order. Could this also be happening here due to the in_progress and the ok checking landing in different queues and thus the ok is processed before the in_progress?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: https://github.com/getsentry/sentry-python/issues/4412

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy