Pick a GPU to see exactly which models run on it, the sweet-spot quant for each, and estimated speeds. Counts below are models that run fully on GPU at a 8,192-token context.