feed is very valid.
Quick benchmark on how to read/write/store your Pandas dataframe if you don’t want to read from CSV all the time. Conclusion:
- Parquet gives smallest files
- Feather has fastest read
- HDF5 (no PyTables) has fastest write
- Benchmark suspect. Feather throughput exceeds RAID bandwidth.