You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We've recently shipped an improvement to the Crons' monitor details page, and noticed that many in-progress check-ins are never being sent across all of our monitors. To reproduce, just set up our automatic detection integration with Celery and go to the monitor details page.
Expected Result
All check-ins are sending the in-progress check-ins, and not only the completion check-in.
Do I get this right: we get ok check-ins for check-ins that we never sent a in_progress check-in?
Can we check on the server if the in_progress check-ins have been received but have been discarded for some reason (like because they are in a wrong format?)
I think the best way to track this down would probably to start by having some mode where the sentry SDK logs when it sends in_progress and when it sends oks, do we have anything like that yet?
if you set debug=True you will see that there has been an envelope of type monitor sent (which is a check-in) but you can not see if it is ok/ in_progress… But I guess this would be a nice debug output to have.
Hey @gaprl I now checked the client outcomes in the admin interface and it seems that every once in a while the server is dropping check-ins (here on May 16th there where 16 check-ins dropped):
Can we somehow find out why those where dropped and what check-ins those where?
Another thing that jumped into my eye is that the monitors-detect-broken-monitor-envs are all very short lived tasks (sometimes only 100ms long). We had a problem before where check ins where processed in the wrong order. Could this also be happening here due to the in_progress and the ok checking landing in different queues and thus the ok is processed before the in_progress?
How do you use Sentry?
Sentry Saas (sentry.io)
Version
2.29.1
Steps to Reproduce
We've recently shipped an improvement to the Crons' monitor details page, and noticed that many in-progress check-ins are never being sent across all of our monitors. To reproduce, just set up our automatic detection integration with Celery and go to the monitor details page.
Expected Result
All check-ins are sending the in-progress check-ins, and not only the completion check-in.
Actual Result
In-progress check-ins are being missed:
Here's some of the impacted monitors:
The text was updated successfully, but these errors were encountered: