Chris Tillman has the other quality start after allowing one run in 8 1/3 innings in Detroit.
Gonzalez allowed three runs and seven hits in six innings, with one walk, three strikeouts and two home runs. He threw 85 pitches, 55 for strikes.
Evan Meek replaced Gonzalez, whose pitch count seemed to suggest that he'd keep working into the seventh.
Gonzalez permitted seven runs and threw 78 pitches over 3 1/3 innings in his first start in Detroit. Tonight's effort qualifies as a big improvement.
Carlos Beltran went 3-for-3 against Gonzalez and came within a triple of the cycle.
Gonzalez has issued only two walks in 9 1/3 innings.
Masahiro Tanaka is at 101 pitches in seven innings. The Orioles haven't scored since Jonathan Schoop hit a three-run homer in the second inning.
Tanaka has retired seven batters in a row. He's walked one batter and struck out 10.
He seems legit, but it's early.
You've just got to respect a guy who hasn't lost a decision in two years.
Instant update: Meek retired the Yankees in order in the seventh, striking out Yangervis Solarte to end the inning. And Matt Thornton has replaced Tanaka.
Update: The Orioles stranded two runners in the top of the eighth after Adam Jones singled and Matt Wieters walked for the second time tonight.
Brett Gardner led off the bottom of the eighth with a double off Meek, and he took third on Derek Jeter's sacrifice bunt. Brian Matusz replaced Meek and retired Jacoby Ellsbury on a pop up, walked Beltran intentionally and retired Brian McCann on a fly ball to center field.
Ellsbury was 2-for-6 with a double against Matusz. McCann was 2-for-3 with a double and home run.
Matusz has stranded 51 of 56 inherited runners since the start of 2012.
Update II: The Orioles scored twice in the ninth against Yankees interim closer Shawn Kelley. They got four straight hits to start the inning - Ryan Flaherty's hustle double and singles by Jonathan Schoop, Nick Markakis and Delmon Young.
Markakis broke the tie with a nice piece of hitting, going down for a pitch almost in the dirt.
Chris Davis' sacrifice fly increased the lead to 5-3.
Young has back-to-back three-hit games for the 10th time in his career, and the first since July 19-20, 2013.
Update III: The Yankees scored once in the bottom of the ninth on Brian Roberts' sacrifice fly in an eight-pitch battle with closer Tommy Hunter, but Yangervis Solarte grounded into a double play to end the game.
Orioles 5, Yankees 4.
Hunter picked up his third save and the Orioles gained their first back-to-back and series wins.