Content-Length: 310563 | pFad | http://github.com/inngest/inngest/pull/1604/commits/b5116421a8ed99eeec19de06bf470d2b7f5107f4

E5 Account-level queues by BrunoScheufler · Pull Request #1604 · inngest/inngest · GitHub
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Account-level queues #1604

Merged
Changes from 1 commit
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
2bee581
re-introduce account queues in Redis
BrunoScheufler Jul 26, 2024
b5042f6
align
BrunoScheufler Jul 26, 2024
7a7de49
Update enqueue_to_partition.lua
BrunoScheufler Jul 26, 2024
b0af3b5
wip
BrunoScheufler Jul 26, 2024
7230c84
Update dequeue.lua
BrunoScheufler Jul 26, 2024
38cbbb5
Update enqueue_to_partition.lua
BrunoScheufler Jul 26, 2024
c57fd14
Update queue_test.go
BrunoScheufler Jul 26, 2024
302b992
Update enqueue_to_partition.lua
BrunoScheufler Jul 26, 2024
a51c1eb
Update enqueue_to_partition.lua
BrunoScheufler Jul 26, 2024
4907aeb
wip
BrunoScheufler Jul 29, 2024
9b94c5e
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Jul 30, 2024
5bdf252
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Jul 30, 2024
ee437d4
Update queue_test.go
BrunoScheufler Jul 30, 2024
08b8057
fix partition requeue
BrunoScheufler Jul 30, 2024
71b0c85
fix tests
BrunoScheufler Jul 30, 2024
c16e74c
fix account queue tests
BrunoScheufler Jul 30, 2024
94a61ff
refactor enqueue to reuse update_account_queues
BrunoScheufler Jul 30, 2024
54f37f0
Update queue.go
BrunoScheufler Jul 30, 2024
f5c6a4d
Update enqueue_to_partition.lua
BrunoScheufler Jul 30, 2024
b982d65
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Jul 31, 2024
51d8ebb
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 7, 2024
18c7ae9
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 9, 2024
6e8eced
test system partitions for account queues
BrunoScheufler Aug 9, 2024
cb84ebf
Use account concurrency when system partition is associated with account
BrunoScheufler Aug 9, 2024
ffc0e3e
Undo: Use system partition specific concurrency
BrunoScheufler Aug 9, 2024
04402ed
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 12, 2024
d0582b6
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 12, 2024
e011113
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 12, 2024
54f6005
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 12, 2024
8a7a22e
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 12, 2024
d5f78dc
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 12, 2024
c00f2f4
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 12, 2024
eb8b5df
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 13, 2024
262d273
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 13, 2024
77bc317
Fix race conditions
BrunoScheufler Aug 13, 2024
f519a75
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 14, 2024
3da9afd
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
cdzombak Aug 14, 2024
2873706
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 15, 2024
3f992a1
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 15, 2024
d99bf02
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 16, 2024
3577131
Force-migrate old partitions on enqueue
BrunoScheufler Aug 16, 2024
44fe28a
Add notes to potentially-nil accountId usages
BrunoScheufler Aug 16, 2024
6af1ae0
Force account ID presence for non-system-partitions in EnqueueItem
BrunoScheufler Aug 16, 2024
42c648b
Return missing partitions in partitionPeek
BrunoScheufler Aug 19, 2024
bb91530
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 21, 2024
6562b23
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 22, 2024
b511642
handle empty return set in partitionPeek
BrunoScheufler Aug 22, 2024
e0f53ae
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 22, 2024
dde5988
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 23, 2024
a8efe5b
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 23, 2024
00cd890
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 23, 2024
4aa5977
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 23, 2024
e8e8ad7
Merge branch 'queue/add-concurrency-and-throttling-key-queues' into b…
BrunoScheufler Aug 23, 2024
9a279ae
Update queue_errors.go
BrunoScheufler Aug 23, 2024
fcbd673
Guaranteed Capacity (#1618)
BrunoScheufler Sep 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
handle empty return set in partitionPeek
In case peeked partition is empty partitionPeek.lua just returns {} which we need to handle
  • Loading branch information
BrunoScheufler committed Aug 22, 2024
commit b5116421a8ed99eeec19de06bf470d2b7f5107f4
23 changes: 12 additions & 11 deletions pkg/execution/state/redis_state/queue.go
Original file line number Diff line number Diff line change
@@ -1978,18 +1978,19 @@ func (q *queue) partitionPeek(ctx context.Context, partitionKey string, sequenti
return nil, fmt.Errorf("unknown return type from partitionPeek: %T", peekRet)
}

if len(returnedSet) != 2 {
return nil, fmt.Errorf("expected two items in set returned by partitionPeek: %v", returnedSet)
}

encoded, ok := returnedSet[0].([]any)
if !ok {
return nil, fmt.Errorf("unexpected first item in set returned from partitionPeek: %T", peekRet)
}
var encoded, missingPartitions []any
if len(returnedSet) == 2 {
encoded, ok = returnedSet[0].([]any)
if !ok {
return nil, fmt.Errorf("unexpected first item in set returned from partitionPeek: %T", peekRet)
}

missingPartitions, ok := returnedSet[1].([]any)
if !ok {
return nil, fmt.Errorf("unexpected first item in set returned from partitionPeek: %T", peekRet)
missingPartitions, ok = returnedSet[1].([]any)
if !ok {
return nil, fmt.Errorf("unexpected first item in set returned from partitionPeek: %T", peekRet)
}
} else if len(returnedSet) != 0 {
return nil, fmt.Errorf("expected zero or two items in set returned by partitionPeek: %v", returnedSet)
}

weights := []float64{}
Loading
Oops, something went wrong.








ApplySandwichStrip

pFad - (p)hone/(F)rame/(a)nonymizer/(d)eclutterfier!      Saves Data!


--- a PPN by Garber Painting Akron. With Image Size Reduction included!

Fetched URL: http://github.com/inngest/inngest/pull/1604/commits/b5116421a8ed99eeec19de06bf470d2b7f5107f4

Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy