agnes-the-ai-analyst/connectors/bigquery
Petr ee70da86c3 Stream BQ results to Parquet instead of loading into memory
Replace to_arrow() (loads entire result into RAM) with
to_arrow_iterable() (streams RecordBatches). Each batch is written
directly to disk via ParquetWriter - constant memory regardless
of table size. Prevents OOM on 8GB server for multi-million row tables.
2026-03-11 20:13:03 +01:00
..
__init__.py Add BigQuery data source adapter 2026-03-11 13:56:12 +01:00
adapter.py Stream BQ results to Parquet instead of loading into memory 2026-03-11 20:13:03 +01:00
client.py Stream BQ results to Parquet instead of loading into memory 2026-03-11 20:13:03 +01:00