agnes-the-ai-analyst/config
Petr 758910463b Add BigQuery data source adapter
BigQuery connector that syncs BQ tables to local Parquet files via PyArrow
(no CSV intermediate step). Supports full refresh, timestamp-based
incremental (via incremental_column), and partition-based sync strategies.

- connectors/bigquery/client.py: BQ API wrapper with ADC auth, parameterized
  queries, metadata cache, cross-project support (job project != data project)
- connectors/bigquery/adapter.py: DataSource implementation with merge/dedup
- src/config.py: Add incremental_column field to TableConfig
- 72 unit tests (mocked, no GCP SDK required)
2026-03-11 13:56:12 +01:00
..
.env.template OSS cleanup: remove internal references, harden deployment, add config env interpolation 2026-03-09 07:59:57 +01:00
__init__.py Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
data_description.md.example Initial commit: OSS data distribution platform 2026-03-08 23:31:28 +01:00
instance.yaml.example Add BigQuery data source adapter 2026-03-11 13:56:12 +01:00
loader.py Security fixes: sanitize dev_docs, harden sudoers and config validation 2026-03-09 08:06:45 +01:00