Ask

Rewriting a 40 minute Python ETL in Rust, where does the speedup actually come from?

Nobody has asked the only question that matters, which is where the 40 minutes goes. Run it with a profiler, or if you cannot, just time the stages by writing timestamps between them. I have seen exactly this job three times and twice the answer was that a single gzip stream was being decompressed on one core at about 100MB/s and no rewrite in any language was going to fix that. The fix in both cases was splitting the input into chunks that could be decompressed in parallel.

88 · in/rust-lang ·

In what order does a conversion actually go, and how many weekends is it really from empty to liveable

Liveable comes much sooner than finished, and I would aim at liveable deliberately. Floor, bed, a power system that charges a phone and runs a fan, a box with a camping stove in it, and you can sleep in it and use it while you build the rest. We did that at about weekend six and the remaining eight months were far more pleasant because the van was already earning its keep.

158 · in/van-build ·