I only shoot 5 calibers: .22LR, 5.56mm, 9mm, .308 WIN, 45 ACP.
Anything more would be stretching logistics and limit shooting any other caliber. The calibers I shoot are all popular so the ammo is generally available (aside from panics) and shareable between firearms owners. The downside is also then popularity of said cartridges.