agnes-the-ai-analyst/config
Petr d180b2014e Step 28: Remote query architecture for local+remote table JOINs
Add src/remote_query.py CLI module enabling the AI agent to run SQL
queries spanning local Parquet tables and remote BigQuery tables in a
single DuckDB session on the server. Two-phase protocol: BQ sub-queries
(--register-bq) fetch filtered/aggregated data, then DuckDB SQL (--sql)
joins everything.

Safety: COUNT(*) pre-check, memory estimation (2GB cap), row limits
(500K per BQ sub-query, 100K final result).

Changes:
- New src/remote_query.py with CLI, BQ registration, output formatting
- Add bq_entity_type field to TableConfig (view vs table routing)
- Extract create_local_views() from duckdb_manager.py for reuse
- Update claude_md_template.txt with remote query agent instructions
- Update example configs with remote_query section and docs
- 52 new tests (42 remote_query + 10 bq_entity_type), all passing
2026-03-21 11:39:15 +01:00
..
.env.template OSS cleanup: remove internal references, harden deployment, add config env interpolation 2026-03-09 07:59:57 +01:00
__init__.py Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
data_description.md.example Step 28: Remote query architecture for local+remote table JOINs 2026-03-21 11:39:15 +01:00
instance.yaml.example Step 28: Remote query architecture for local+remote table JOINs 2026-03-21 11:39:15 +01:00
loader.py Security fixes: sanitize dev_docs, harden sudoers and config validation 2026-03-09 08:06:45 +01:00