The Gators (4-4) made a season-high 10 3-pointers and ended a two-game losing streak.
Florida controlled the game from the opening tip, taking advantage of their size inside and their athleticism outside to get any shot they wanted and make Yale work for everything.
The Bulldogs (8-3) were coming off a signature win at defending national champion UConn three days earlier. Jack Montague hit a 3-pointer from the corner with 1.7 seconds left to beat the Huskies.
Florida, which blew an 18-point lead at then-No. 11 Kansas on Friday, left no doubt about this one.
The Gators opened up a double-digit lead early, were ahead by 26 at halftime and up by as many as 49 in the second half.
Chris Walker had a career-high 13 points for Florida, and walk-on Jacob Kurtz chipped in 10.
The only question for Florida was about Frazier's health. He took a shot to the face early in the second half, went to the locker room for several minutes, eventually returned and re-entered the game.
Justin Sears led Yale with 15 points.
Montague finished with eight points.
Florida played its second straight game without guard Eli Carter, who is dealing with a sprained left foot. His absence left coach Billy Donovan's team with just seven scholarship players available.
It was plenty against the Bulldogs.
Donovan pressed early and often, creating turnovers and seemingly making Yale uncomfortable. The Bulldogs had nine turnovers in the first half and 15 for the game.
Florida shot a blistering 68 percent in the first half and 64 for the game.
Yale: With the win at UConn, Yale became the second Ivy League team to knock off a defending national champion since Princeton beat UCLA in 1996. ... The Bulldogs' schedule includes 10 teams that made the postseason last year, including five selected for the NCAA tournament.
Florida: Walk-on Zach Hodskins, who was born without a left hand, got in the game and missed his only shot. ... Gators had been under .500 for the first time since the end of the 1988-89 season. ... Florida improved to 8-2 against Ivy League teams.
Yale plays at Vermont on Dec. 18.
Florida hosts Texas Southern on Friday.