I concur. Don not shoot rifled slugs out of your rilfed barrel. You can in short order make an accurate gun very inaccurate. And why take a chance at wounding a deer, or missing that buck of a lifetime. As stated above shoot the sabot slugs.
There are a ton of different sabots to shoot, and some really cool rounds. Do your homework, and you'll find a round that shoots well in your gun, and fits your hunting style. I shoot a 20gage with a rifled barrel, 2-3/4 inche sabots, the Remington Copper Solids. I'm a brush hunter so distance isn't what I'm interested in, usually a 50 yard shot is a long ways in the places I like to hunt. With open sights at 50 yards, I can put 3 slugs in the top of soup. That shooting off the picnic table in my inlaws hay field. You'll spend more money for five rounds, but that may make you take only good shots, as emptying you gun will be a $15 investment.
Good Luck