Tag Archives: php

Parsing large files with pgfouine in linux

pgfouine is a nice logfile analyzer for PostgreSQL written in php. I’m doing a trace on a very long running ETL process and the logfile generated is ~11GB. I’m running up against a 2GB barrier in php for fopen(). If you’ve got a 64bit machine and can recompile php with -D_FILE_OFFSET_BITS=64 then you’re good to [...]