Replace to_arrow() (loads entire result into RAM) with to_arrow_iterable() (streams RecordBatches). Each batch is written directly to disk via ParquetWriter - constant memory regardless of table size. Prevents OOM on 8GB server for multi-million row tables. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| adapter.py | ||
| client.py | ||