Though Rector has offers from both, he didn't want to pass on the two local schools giving him an opportunity to work with their respective coaching staffs.
"I'm going to UCLA on Wednesday and USC on Thursday," said Rector. "I'm working as an outside linebacker at both of them. They're the closest ones to go to and I'm trying to do some things this summer."
The two Los Angeles schools are making a push for him, with former coaches at Loyola on staff at both USC and UCLA.
"I'd say they're definitely both recruiting me the hardest," said Rector. "I'm still pretty open, but they're both recruiting me hard."
Jeff Ulbrich and Mike Tuiasosopo are recruiting him at UCLA, with some help from Kennedy Polamalu while Peter Sirmon and Chris Wilson are recruiting him at USC.
Nebraska is also making a push, with Loyola head coach Marvin Sanders a former Nebraska assistant before he was at USC.
"I went to Nebraska earlier this summer and it was a pretty good trip," said Rector. "It really opened my eyes to other schools outside the West coast and that aren't local."
Rector is hoping to visit Vanderbilt this summer and likely will be visiting them officially.
"I have in mind a couple of schools I want to visit, like Boston College and Vanderbilt," said Rector.
Rector decided to give up basketball after playing for Loyola.
"I want to just focus on playing football so no more basketball," said Rector. "I'm lifting and having practice, and we'll be going to tournaments pretty soon and doing 7v7 for school."