agnes-the-ai-analyst/docs
Petr d180b2014e Step 28: Remote query architecture for local+remote table JOINs
Add src/remote_query.py CLI module enabling the AI agent to run SQL
queries spanning local Parquet tables and remote BigQuery tables in a
single DuckDB session on the server. Two-phase protocol: BQ sub-queries
(--register-bq) fetch filtered/aggregated data, then DuckDB SQL (--sql)
joins everything.

Safety: COUNT(*) pre-check, memory estimation (2GB cap), row limits
(500K per BQ sub-query, 100K final result).

Changes:
- New src/remote_query.py with CLI, BQ registration, output formatting
- Add bq_entity_type field to TableConfig (view vs table routing)
- Extract create_local_views() from duckdb_manager.py for reuse
- Update claude_md_template.txt with remote query agent instructions
- Update example configs with remote_query section and docs
- 52 new tests (42 remote_query + 10 bq_entity_type), all passing
2026-03-21 11:39:15 +01:00
..
future Restructure docs for OSS readability 2026-03-09 10:42:45 +01:00
metrics/revenue Add sample metric YAML as fallback when OpenMetadata metrics unavailable 2026-03-12 15:14:04 +01:00
setup Step 28: Remote query architecture for local+remote table JOINs 2026-03-21 11:39:15 +01:00
testing docs 2026-03-10 11:43:11 +01:00
architecture.md docs 2026-03-10 11:43:11 +01:00
auto-install.md Remove hardcoded Jira and Telemetry cards from catalog 2026-03-10 22:48:07 +01:00
CONFIGURATION.md Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
DATA_SOURCES.md Branding cleanup: remove Keboola-specific references from docs and config 2026-03-09 12:22:27 +01:00
DEPLOYMENT.md Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
PLAN.md Move standalone services from server/ to services/ 2026-03-09 12:54:30 +01:00
QUICKSTART.md Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
sample-data.md Add --format parquet using project's ParquetManager 2026-03-10 21:46:20 +01:00
theme-reference.html Fix clipped annotation badges in theme-reference.html 2026-03-11 14:09:04 +01:00