* feat(rbac): drop dataset_permissions + access_requests + users.role + is_public; v19 migration
BREAKING. Sjednocení datové RBAC vrstvy do per-group resource_grants modelu.
Před PR byla legacy data RBAC vrstva (dataset_permissions + is_public bypass)
de-facto neaktivní — is_public neměl API/UI/CLI surface, default true znamenal
že can_access_table vždycky bypassl. Dnes každý non-admin přístup vyžaduje
explicitní resource_grants(group, "table", id) řádek.
Schema v18 → v19 (src/db.py:_v18_to_v19_finalize):
- DROP TABLE dataset_permissions, access_requests
- DROP COLUMN users.role (NULL artifact since v13)
- DROP COLUMN table_registry.is_public
- Drops přes table-rebuild idiom (rename → create new → INSERT … SELECT
→ drop old) kvůli DuckDB ALTER DROP COLUMN limitacím na tabulkách
s historic FK constraints. INSERT picks intersection sloupců, takže
test fixtures s minimal pre-v19 schemou migrate cleanly.
Runtime:
- src/rbac.py:can_access_table → deleguje na app.auth.access.can_access
- DatasetPermissionRepository, AccessRequestRepository smazány
- AGNES_ENABLE_TABLE_GRANTS env-gate v app/resource_types.py odstraněn
(TABLE je unconditionally enabled)
API drop:
- app/api/permissions.py, app/api/access_requests.py celé soubory
- /admin/permissions web route + admin_permissions.html
- "Request Access" modal v catalog.html + locked-row UI
- ~10 if user.get("role") != "admin" checků nahrazeno (admin shortcut
je uvnitř can_access_table)
- /api/settings: drop permissions field z GET; PUT /api/settings/dataset
gate přepnut na can_access(user_id, "table", dataset, conn)
Auth:
- app/auth/jwt.py:create_access_token: drop role parametr (claim zmizí
z nově vydávaných JWT; staré tokeny zůstávají valid, claim ignored)
- app/api/users.py: drop role z CreateUserRequest / UpdateUserRequest
(admin promotion = explicit add to Admin group via memberships API)
- src/repositories/users.py: drop role z create() / update()
CLI:
- da admin set-role smazán → hard-fail s replacement command
- da admin add-user --role flag pryč
- da auth import-token --role flag pryč
- da auth whoami: drop "Role:" výpis
- cli/config.py:save_token: role parametr now optional, no longer written
(back-compat se starými token.json soubory zachována — pole se ignoruje)
Tests:
- DELETE: test_permissions.py, test_permissions_api.py, test_access_requests_api.py
- REWRITE: test_access_control.py (resource_grants flow), test_rbac.py
(can_access_table over resource_grants), test_journey_rbac.py
(drop access-request flow), test_resource_types.py (drop env-gate
tests, drop is_public from helpers), test_v2_*.py (drop role-based
user dicts in favor of id-based + Admin group membership),
test_settings_api.py (no permissions field, can_access gate)
- TRIVIAL: ~30 souborů — drop role="admin" arg z UserRepository.create
a 3rd positional role z create_access_token
- NEW: test_v18_to_v19 migration test (test_db.py),
test_can_access_table_no_implicit_public (test_rbac.py),
test_admin_set_role_returns_hardfail (test_cli_admin.py)
- OpenAPI snapshot regenerated
Docs:
- CHANGELOG: BREAKING entry pod [Unreleased]
- CLAUDE.md: schema v18 → v19
- docs/architecture.md: schema table + RBAC sekce přepsána
- docs/auth-google-oauth.md: admin promotion přes da admin break-glass
- cli/skills/security.md: kompletně přepsáno na group-based model
- docs/TODO-rbac-data-enforcement.md: smazáno (TODO splněn)
Test results: 2363 passed, 19 failed. Zbývající failures jsou pre-existing
Windows-specific issues (fcntl, charset) nesouvisející s tímto PR —
ověřeno git stash pop.
Plan: ~/.claude/plans/floofy-coalescing-parnas.md
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
* chore(release): cut 0.27.0
---------
Co-authored-by: Minas Arustamyan <arustamyan.minas@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: ZdenekSrotyr <zdenek.srotyr@keboola.com>
134 lines
4.8 KiB
Python
134 lines
4.8 KiB
Python
"""J4 — RBAC journey tests (v19+ resource_grants flow).
|
|
|
|
Full permission lifecycle: analyst denied by default → admin grants via
|
|
resource_grants → analyst can query → admin revokes → blocked again.
|
|
The legacy /api/admin/permissions and /api/access-requests/* endpoints
|
|
were removed in v19 along with `is_public`.
|
|
"""
|
|
|
|
import pytest
|
|
from tests.conftest import create_mock_extract
|
|
|
|
|
|
def _auth(token: str) -> dict:
|
|
return {"Authorization": f"Bearer {token}"}
|
|
|
|
|
|
def _grant_table(conn, user_id: str, table_id: str) -> str:
|
|
from src.repositories.user_groups import UserGroupsRepository
|
|
from src.repositories.user_group_members import UserGroupMembersRepository
|
|
from src.repositories.resource_grants import ResourceGrantsRepository
|
|
grp = UserGroupsRepository(conn).get_by_name(f"j-{user_id}")
|
|
if not grp:
|
|
grp = UserGroupsRepository(conn).create(
|
|
name=f"j-{user_id}", description="journey", created_by="test",
|
|
)
|
|
members = UserGroupMembersRepository(conn)
|
|
if not members.has_membership(user_id, grp["id"]):
|
|
members.add_member(user_id, grp["id"], source="admin", added_by="test")
|
|
grants = ResourceGrantsRepository(conn)
|
|
if not grants.has_grant([grp["id"]], "table", table_id):
|
|
return grants.create(
|
|
group_id=grp["id"], resource_type="table", resource_id=table_id,
|
|
assigned_by="test",
|
|
)
|
|
existing = next(
|
|
g for g in grants.list_for_groups([grp["id"]], "table")
|
|
if g["resource_id"] == table_id
|
|
)
|
|
return existing["id"]
|
|
|
|
|
|
@pytest.mark.journey
|
|
class TestRBACJourney:
|
|
def _setup_table(self, seeded_app, mock_extract_factory):
|
|
c = seeded_app["client"]
|
|
env = seeded_app["env"]
|
|
c.post(
|
|
"/api/admin/register-table",
|
|
json={
|
|
"name": "private_data",
|
|
"source_type": "keboola",
|
|
"query_mode": "local",
|
|
"description": "Private dataset",
|
|
},
|
|
headers=_auth(seeded_app["admin_token"]),
|
|
)
|
|
mock_extract_factory(
|
|
"keboola",
|
|
[{"name": "private_data", "data": [{"id": "1", "secret": "top_secret"}]}],
|
|
)
|
|
from src.orchestrator import SyncOrchestrator
|
|
SyncOrchestrator(analytics_db_path=env["analytics_db"]).rebuild()
|
|
|
|
def test_analyst_blocked_without_grant(self, seeded_app, mock_extract_factory):
|
|
c = seeded_app["client"]
|
|
self._setup_table(seeded_app, mock_extract_factory)
|
|
resp = c.post(
|
|
"/api/query",
|
|
json={"sql": "SELECT * FROM private_data"},
|
|
headers=_auth(seeded_app["analyst_token"]),
|
|
)
|
|
assert resp.status_code == 403
|
|
|
|
def test_admin_grants_then_analyst_can_query(self, seeded_app, mock_extract_factory):
|
|
c = seeded_app["client"]
|
|
self._setup_table(seeded_app, mock_extract_factory)
|
|
# Admin grants TABLE access via resource_grants
|
|
from src.db import get_system_db
|
|
conn = get_system_db()
|
|
try:
|
|
_grant_table(conn, "analyst1", "private_data")
|
|
finally:
|
|
conn.close()
|
|
resp = c.post(
|
|
"/api/query",
|
|
json={"sql": "SELECT * FROM private_data"},
|
|
headers=_auth(seeded_app["analyst_token"]),
|
|
)
|
|
assert resp.status_code == 200
|
|
|
|
def test_admin_revokes_grant_blocks_analyst(self, seeded_app, mock_extract_factory):
|
|
c = seeded_app["client"]
|
|
self._setup_table(seeded_app, mock_extract_factory)
|
|
|
|
from src.db import get_system_db
|
|
conn = get_system_db()
|
|
try:
|
|
grant_id = _grant_table(conn, "analyst1", "private_data")
|
|
finally:
|
|
conn.close()
|
|
|
|
# Verify analyst can query
|
|
resp = c.post(
|
|
"/api/query",
|
|
json={"sql": "SELECT * FROM private_data"},
|
|
headers=_auth(seeded_app["analyst_token"]),
|
|
)
|
|
assert resp.status_code == 200
|
|
|
|
# Admin revokes the grant via REST API
|
|
resp = c.delete(
|
|
f"/api/admin/grants/{grant_id}",
|
|
headers=_auth(seeded_app["admin_token"]),
|
|
)
|
|
assert resp.status_code == 204
|
|
|
|
# Analyst is blocked again
|
|
resp = c.post(
|
|
"/api/query",
|
|
json={"sql": "SELECT * FROM private_data"},
|
|
headers=_auth(seeded_app["analyst_token"]),
|
|
)
|
|
assert resp.status_code == 403
|
|
|
|
def test_admin_can_query_any_table(self, seeded_app, mock_extract_factory):
|
|
"""Admin shortcut: members of the Admin group never need explicit grants."""
|
|
c = seeded_app["client"]
|
|
self._setup_table(seeded_app, mock_extract_factory)
|
|
resp = c.post(
|
|
"/api/query",
|
|
json={"sql": "SELECT * FROM private_data"},
|
|
headers=_auth(seeded_app["admin_token"]),
|
|
)
|
|
assert resp.status_code == 200
|