Subwoofer driver sizes

What difference does the subwoofer’s driver size make? Is an 8″, 12″, or even larger woofer alright to use in a smaller room?