Generally as big as is practical for the application.
Rooftop panels tend to be in the 370-400W range and ground mount panels like 460-580W. 400W is about the limit of what one person could move around on their own, with difficulty. My 480's are a two person job.
Also on a roof you're often constrained by geometry so the smaller panels allow more flexible arrangement, where as for ground mount you want as big a panel as you can fit on your mounting hardware to get the most out of it.
300W and less are a niche product for mobile applications, portable use, small hobby projects, etc.
In designing a string of solar panels which is what most of us are doing, the different sizes will have different cell counts and different voltages, so they're not totally interchangeable. You might be able to use 10x 400W or 8x 480W but unable to use 10x 480W because it would be over the voltage limit.
The voltage of the panel is primarily determined by the cell count, 400W's being in the 60's and 460W+ being in the 70's or greater.