The win kept Pitt (15-0, 4-0 Big East) one of three unbeaten Division I teams along with No. 1 Duke and No. 2 Florida, both of which won Wednesday.
Levon Kendall had 14 points to lead four other Panthers in double figures.
Quincy Douby, the Big East's leading scorer at 23.3 points per game, had 27 for Rutgers (12-5, 2-2), which scored only five points in the first 17 minutes of the second half as Pitt slowly pulled away.
After Douby's basket with 17:00 left gave Rutgers its last lead at 43-42, the Scarlet Knights managed just one field goal and two free throws before Marquis Webb scored on a drive with 7:23 left.
Pitt built an eight-point lead during the stretch before Douby - who sat for more than 4 minutes not long after picking up his third foul with 11:21 left - hit a long 3-pointer to make it 57-52 with a little over 5 minutes left.
The Panthers' Carl Krauser answered with a 3-pointer and Pitt never led by fewer than seven points after that as Gray went 7-of-10 from the line down the stretch.
Rutgers came close for the second time in a week on their home court against a Top 10 team. Last Wednesday, the Scarlet Knights lost to then-No. 3 Villanova 84-78 in overtime.
Three more wins will match Pitt's 18-0 start in 2003-04, and six more will tie the all-time school mark set in 1928.