Ask

one used 3090 or two 3060s for 70b at q4 with a $700 budget

Before committing either way, rent an hour on a cloud box with enough VRAM and run the 70B against ten of your own diffs. Ten dollars answers the question of whether the bigger model is even better for your repos, which is not a given. I did this and the 32B was better on my code because the 70B kept inventing framework APIs.

12 · in/local-llms ·