Skip to content

new: salt.sqlalchemy base implementation (+ returner & cache) #68068

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 11 commits into
base: master
Choose a base branch
from
+4,064 −870
Open

new: salt.sqlalchemy base implementation (+ returner & cache) #68068

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
00949d2
salt.cache: allow cache.store() to set expires per key
mattp- Apr 15, 2025
ac9c967
fix minion data cache organization
mattp- Aug 1, 2019
8cfbaa8
PillarCache: reimplement using salt.cache
mattp- Apr 4, 2024
d70bb3d
salt.key: optimize check_minion_cache
mattp- Apr 3, 2025
b555716
Provide token storage using the salt.cache interface
mattp- May 20, 2025
7f95dda
new: salt.sqlalchemy base implementation
mattp- Jun 13, 2025
ebe98d6
salt.runners.cache: add migrate function
mattp- Jun 13, 2025
306b50b
refactor functional database fixture
mattp- Jun 13, 2025
ffc542f
new: salt.cache.sqlalchemy
mattp- Jun 11, 2025
5b60a4a
new: salt.returners.sqlalchemy
mattp- Jun 11, 2025
93afb67
add sqlalchemy to ci/common.in
mattp- Jun 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .pylintrc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,7 @@ persistent=no

# Minimum Python version to use for version dependent checks. Will default to
# the version used to run pylint.
py-version=3.9
py-version=3.10

# Discover python modules and packages in the file system subtree.
recursive=no
Expand Down
3 changes: 3 additions & 0 deletions changelog/68030.changed.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
PillarCache: reimplement using salt.cache
fix minion data cache organization/move pillar and grains to dedicated cache banks
salt.cache: allow cache.store() to set expires per key
1 change: 1 addition & 0 deletions changelog/68030.fixed.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
salt.key: check_minion_cache performance optimization
1 change: 1 addition & 0 deletions changelog/68039.changed.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Provide token storage using the salt.cache interface
3 changes: 3 additions & 0 deletions changelog/68068.added.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
new: sqlalchemy base implementation for shared database access
new: sqlalchemy returner implementation
new: sqlalchemy cache implementation
1 change: 1 addition & 0 deletions doc/ref/cache/all/index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,3 +18,4 @@ For understanding and usage of the cache modules see the :ref:`cache` topic.
localfs_key
mysql_cache
redis_cache
sqlalchemy
5 changes: 5 additions & 0 deletions doc/ref/cache/all/salt.cache.sqlalchemy.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
salt.cache.sqlalchemy
======================

.. automodule:: salt.cache.sqlalchemy
:members:
1 change: 1 addition & 0 deletions doc/ref/returners/all/index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,4 +18,5 @@ returner modules
postgres
postgres_local_cache
rawfile_json
sqlalchemy
syslog_return
5 changes: 5 additions & 0 deletions doc/ref/returners/all/salt.returners.sqlalchemy.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
salt.returners.sqlalchemy
==========================

.. automodule:: salt.returners.sqlalchemy
:members:
1 change: 1 addition & 0 deletions doc/ref/runners/all/index.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,7 @@ runner modules
salt
saltutil
sdb
sqlalchemy
ssh
state
survey
Expand Down
5 changes: 5 additions & 0 deletions doc/ref/runners/all/salt.runners.sqlalchemy.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
salt.runners.sqlalchemy
=======================

.. automodule:: salt.runners.sqlalchemy
:members:
1 change: 1 addition & 0 deletions requirements/static/ci/common.in
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,3 +48,4 @@ genshi>=0.7.3
cheetah3>=3.2.2
mako
wempy
sqlalchemy
5 changes: 5 additions & 0 deletions requirements/static/ci/py3.10/darwin.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -149,6 +149,8 @@ gitpython==3.1.43
# via -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
hglib==2.6.2
# via -r requirements/static/ci/darwin.in
idna==3.7
Expand Down Expand Up @@ -482,6 +484,8 @@ six==1.16.0
# websocket-client
smmap==5.0.1
# via gitdb
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -524,6 +528,7 @@ typing-extensions==4.8.0
# via
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.10/darwin.txt
Expand Down
5 changes: 5 additions & 0 deletions requirements/static/ci/py3.10/freebsd.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -148,6 +148,8 @@ gitpython==3.1.43
# via -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
hglib==2.6.2
# via -r requirements/static/ci/freebsd.in
idna==3.7
Expand Down Expand Up @@ -487,6 +489,8 @@ six==1.16.0
# websocket-client
smmap==5.0.1
# via gitdb
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -529,6 +533,7 @@ typing-extensions==4.8.0
# via
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.10/freebsd.txt
Expand Down
5 changes: 5 additions & 0 deletions requirements/static/ci/py3.10/linux.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -164,6 +164,8 @@ gitpython==3.1.43
# via -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
h11==0.14.0
# via httpcore
hglib==2.6.2
Expand Down Expand Up @@ -549,6 +551,8 @@ sniffio==1.3.0
# anyio
# httpcore
# httpx
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -593,6 +597,7 @@ typing-extensions==4.8.0
# via
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.10/linux.txt
Expand Down
8 changes: 7 additions & 1 deletion requirements/static/ci/py3.10/windows.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -148,6 +148,8 @@ gitpython==3.1.43 ; sys_platform == "win32"
# -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
idna==3.7
# via
# -c requirements/static/ci/../pkg/py3.10/windows.txt
Expand Down Expand Up @@ -447,6 +449,8 @@ smmap==5.0.1
# via
# -c requirements/static/ci/../pkg/py3.10/windows.txt
# gitdb
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -474,7 +478,9 @@ trustme==1.1.0
types-pyyaml==6.0.1
# via responses
typing-extensions==4.8.0
# via pytest-system-statistics
# via
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.10/windows.txt
Expand Down
5 changes: 5 additions & 0 deletions requirements/static/ci/py3.11/darwin.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,8 @@ gitpython==3.1.43
# via -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
hglib==2.6.2
# via -r requirements/static/ci/darwin.in
idna==3.7
Expand Down Expand Up @@ -476,6 +478,8 @@ six==1.16.0
# websocket-client
smmap==5.0.1
# via gitdb
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -516,6 +520,7 @@ typing-extensions==4.8.0
# via
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.11/darwin.txt
Expand Down
5 changes: 5 additions & 0 deletions requirements/static/ci/py3.11/freebsd.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -141,6 +141,8 @@ gitpython==3.1.43
# via -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
hglib==2.6.2
# via -r requirements/static/ci/freebsd.in
idna==3.7
Expand Down Expand Up @@ -481,6 +483,8 @@ six==1.16.0
# websocket-client
smmap==5.0.1
# via gitdb
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -521,6 +525,7 @@ typing-extensions==4.8.0
# via
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.11/freebsd.txt
Expand Down
5 changes: 5 additions & 0 deletions requirements/static/ci/py3.11/linux.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -155,6 +155,8 @@ gitpython==3.1.43
# via -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
h11==0.14.0
# via httpcore
hglib==2.6.2
Expand Down Expand Up @@ -541,6 +543,8 @@ sniffio==1.3.0
# anyio
# httpcore
# httpx
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -583,6 +587,7 @@ typing-extensions==4.8.0
# via
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.11/linux.txt
Expand Down
8 changes: 7 additions & 1 deletion requirements/static/ci/py3.11/windows.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -141,6 +141,8 @@ gitpython==3.1.43 ; sys_platform == "win32"
# -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
idna==3.7
# via
# -c requirements/static/ci/../pkg/py3.11/windows.txt
Expand Down Expand Up @@ -440,6 +442,8 @@ smmap==5.0.1
# via
# -c requirements/static/ci/../pkg/py3.11/windows.txt
# gitdb
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand All @@ -465,7 +469,9 @@ trustme==1.1.0
types-pyyaml==6.0.12.12
# via responses
typing-extensions==4.8.0
# via pytest-system-statistics
# via
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.11/windows.txt
Expand Down
9 changes: 9 additions & 0 deletions requirements/static/ci/py3.12/cloud.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -201,6 +201,10 @@ google-auth==2.27.0
# via
# -c requirements/static/ci/py3.12/linux.txt
# kubernetes
greenlet==3.2.3
# via
# -c requirements/static/ci/py3.12/linux.txt
# sqlalchemy
idna==3.7
# via
# -c requirements/static/ci/../pkg/py3.12/linux.txt
Expand Down Expand Up @@ -684,6 +688,10 @@ smmap==5.0.1
# via
# -c requirements/static/ci/py3.12/linux.txt
# gitdb
sqlalchemy==2.0.41
# via
# -c requirements/static/ci/py3.12/linux.txt
# -r requirements/static/ci/common.in
sqlparse==0.5.0
# via
# -c requirements/static/ci/py3.12/linux.txt
Expand Down Expand Up @@ -744,6 +752,7 @@ typing-extensions==4.8.0
# -c requirements/static/ci/py3.12/linux.txt
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.12/linux.txt
Expand Down
5 changes: 5 additions & 0 deletions requirements/static/ci/py3.12/darwin.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -142,6 +142,8 @@ gitpython==3.1.43
# via -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
hglib==2.6.2
# via -r requirements/static/ci/darwin.in
idna==3.7
Expand Down Expand Up @@ -476,6 +478,8 @@ six==1.16.0
# websocket-client
smmap==5.0.1
# via gitdb
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -516,6 +520,7 @@ typing-extensions==4.8.0
# via
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.12/darwin.txt
Expand Down
5 changes: 5 additions & 0 deletions requirements/static/ci/py3.12/freebsd.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -141,6 +141,8 @@ gitpython==3.1.43
# via -r requirements/static/ci/common.in
google-auth==2.27.0
# via kubernetes
greenlet==3.2.3
# via sqlalchemy
hglib==2.6.2
# via -r requirements/static/ci/freebsd.in
idna==3.7
Expand Down Expand Up @@ -481,6 +483,8 @@ six==1.16.0
# websocket-client
smmap==5.0.1
# via gitdb
sqlalchemy==2.0.41
# via -r requirements/static/ci/common.in
sqlparse==0.5.0
# via -r requirements/static/ci/common.in
strict-rfc3339==0.7
Expand Down Expand Up @@ -521,6 +525,7 @@ typing-extensions==4.8.0
# via
# napalm
# pytest-system-statistics
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.12/freebsd.txt
Expand Down
9 changes: 9 additions & 0 deletions requirements/static/ci/py3.12/lint.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -213,6 +213,10 @@ google-auth==2.27.0
# via
# -c requirements/static/ci/py3.12/linux.txt
# kubernetes
greenlet==3.2.3
# via
# -c requirements/static/ci/py3.12/linux.txt
# sqlalchemy
h11==0.14.0
# via
# -c requirements/static/ci/py3.12/linux.txt
Expand Down Expand Up @@ -689,6 +693,10 @@ sniffio==1.3.0
# anyio
# httpcore
# httpx
sqlalchemy==2.0.41
# via
# -c requirements/static/ci/py3.12/linux.txt
# -r requirements/static/ci/common.in
sqlparse==0.5.0
# via
# -c requirements/static/ci/py3.12/linux.txt
Expand Down Expand Up @@ -751,6 +759,7 @@ typing-extensions==4.8.0
# via
# -c requirements/static/ci/py3.12/linux.txt
# napalm
# sqlalchemy
urllib3==1.26.20
# via
# -c requirements/static/ci/../pkg/py3.12/linux.txt
Expand Down
Loading
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy