After James Shields pitched nine brilliant innings for Tampa Bay, Brian Stokes (1-4) faced only two batters before giving up the game's lone run. Ramon Hernandez hit a fly to center before Huff drove a 1-1 pitch over the wall in center, his fourth homer of the season and second against the Devil Rays.
Huff played for five seasons in Tampa Bay and briefly with Houston last year before signing with Baltimore as a free agent in January.
John Parrish (1-0) worked out of a bases-loaded jam in the 10th, retiring B.J. Upton on a slow roller with two outs after yielding three straight singles.
Shields failed to earn a win in his longest career outing. The right-hander allowed three hits, walked one and struck out four.
The only Baltimore batter to reach over the first five innings was Huff, who singled with one out in the second. Shields retired 11 straight batters before issuing a leadoff walk to Jay Gibbons in the sixth.
Kevin Millar reached on an infield hit with one out in the eighth, but pinch-runner Corey Patterson was thrown out trying to steal after Shields retired Gibbons on a foul pop.
Baltimore starter Erik Bedard struck out 10 in seven innings to take over the AL lead in strikeouts with 56. The left-hander allowed three hits, walked three and did not allow a runner past second base.
After throwing 97 pitches, Bedard was replaced by Danys Baez, who hit Baldelli with a pitch to start the eighth before getting three straight outs.
Chris Ray wrked out of trouble after giving up a one-out double to Young in the ninth.
Bedard allowed a first-inning double to Carl Crawford and two singles to Jorge Cantu through the opening five innings. In the sixth, Bedard walked Elijah Dukes and Crawford with one out before striking out Wigginton and retiring Upton on a fielder's choice.
The Devil Rays have yet to steal a base in May after swiping a major-league high 28 in April. ... Baltimore started the night with 144 runs scored and 144 allowed. ... The Orioles have doubled in 31 of 34 games this season.