"It was great. I actually had a chance to sit down with Coach Swinney and his family and it was great. I learned a lot from him," he said
"(It wasn't about) just how I can become a better football player there, but how I can become a better person, with the good group of guys they have there, and I can come in and contribute to a winning program."
The 6-foot-1, 170-pound cornerback sees an opportunity for him to make an impact with the Clemson program.
"They were saying they really have all the pieces but they're missing that secondary, so I feel that I could come in and not solve it, but help out," he said.
"I actually agree because I watched a lot of their games and I've seen their secondary, either their beat-up or just not getting it done, so the opportunity is really there."
"For high profile athletes, they're cool. They're not stuck up or into themselves. They're really cool," Baker said.
Really the only thing standing between Baker and a final decision is his official visit to Oklahoma next week.
"I like Oklahoma, so I'm not going to commit to Clemson and then not be able to see Oklahoma. Once you commit to Clemson, it's a saying there that you're ‘all in.' So that's pretty much in the way is me getting over to Norman," he said.
"(I'll be looking to see) the same thing as at Clemson, if I can fit in there, if I can become a better student athlete. Clemson really laid that out there for me – that I can better myself on and off the field. I really like that because for me it's not just football, education plays an important part too."
Technically, Baker remains committed to Florida State, but he says that commitment is pretty soft at this point.
"I'm committed there obviously, but there's so much going on down there (with coaching changes). We'll just have to see what happens."
Stay tuned to FOX Sports NEXT for the latest on Baker and his recruitment.