AI-Cognitive-Leap/agnes-the-ai-analyst
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
agnes-the-ai-analyst/tests
History
Petr 8bb46a9e0a Add per-partition streaming sync and hybrid query architecture 
Partitioned sync: iterates day-by-day instead of loading full dataset.
Each partition: query BQ -> stream to disk -> free RAM. Peak ~50 MB.
New helpers: _sync_single_partition, _cleanup_old_partitions, _generate_partition_dates.

Config: added partition_column_type (DATE/TIMESTAMP/DATETIME), query_mode (local/remote/hybrid).
DuckDB manager: hybrid architecture support (local Parquet + remote BQ tables).
Data sync: skips remote tables, filters by query_mode.

Tests: 113 passing (adapter, client, config, data_sync, duckdb_manager).
2026-03-12 13:20:41 +01:00
..
__init__.py Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
test_account_service.py OSS cleanup: remove internal references, harden deployment, add config env interpolation 2026-03-09 07:59:57 +01:00
test_auto_profiling.py Add self-service data onboarding system 2026-03-09 14:25:37 +01:00
test_bigquery_adapter.py Add per-partition streaming sync and hybrid query architecture 2026-03-12 13:20:41 +01:00
test_bigquery_client.py Add per-partition streaming sync and hybrid query architecture 2026-03-12 13:20:41 +01:00
test_config_query_mode.py Add per-partition streaming sync and hybrid query architecture 2026-03-12 13:20:41 +01:00
test_data_sync_query_mode.py Add per-partition streaming sync and hybrid query architecture 2026-03-12 13:20:41 +01:00
test_deploy_guard.py OSS cleanup: remove internal references, harden deployment, add config env interpolation 2026-03-09 07:59:57 +01:00
test_duckdb_manager.py Add per-partition streaming sync and hybrid query architecture 2026-03-12 13:20:41 +01:00
test_email_auth.py Add multi-domain support and full-email username generation 2026-03-10 10:50:01 +01:00
test_generate_sample_data.py Add --format parquet using project's ParquetManager 2026-03-10 21:46:20 +01:00
test_metrics.py Add dynamic Business Metrics with sample e-commerce definitions 2026-03-10 22:38:44 +01:00
test_profiler.py Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
test_sync_data.py Extract Jira into connectors/jira module 2026-03-09 11:17:50 +01:00
test_table_registry.py Add self-service data onboarding system 2026-03-09 14:25:37 +01:00
test_user_service.py Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
test_username_generation.py Add multi-domain support and full-email username generation 2026-03-10 10:50:01 +01:00