RuleForge: found our own 1GB storage ceiling, fixed it same day
We advertise RuleForge's pipeline tested to 8 million rows. Turns out the storage layer had a lower, hidden ceiling: every job was saved as one SQLite BLOB, and the SQLite driver hard-codes a 1GB limit in its C source. Real jobs against FTD/PAN-OS targets started failing to save around ~810K rows — nowhere near the 8 million the converter itself can handle.
Fixed same day: results now write to a compressed file instead of one big BLOB. Existing installs migrate automatically.
Re-tested with the real code path at 8 million rows: FTD saved a 9.99GB job, PAN-OS saved a 17GB job — both read back correctly. Honest number if you're planning capacity: PAN-OS at that scale peaked at ~98.6GB RAM, so budget 128GB for full-scale PAN-OS conversions.
Sample reports: github.com/nizartuanku/ruleforge/docs/samples
