The 20-year-old recently returned to the fold following a hip injury last season, but he has claimed that he still has to "work hard" in the weeks ahead.
"I've still got a lot more to gain in terms of building up my fitness. I haven't had much of a pre-season and to come straight in has been tough. I've got to work hard to get back to where I was last year. That's all I can do," Byram told LUTV.
"It's about four-and-a-half months so to come back to the level of fitness and intensity takes time and I think I was getting more frustrated than anyone because I just wanted to be back playing the best I can and helping the team.
"I can't go gung-ho, I need to be patient, so it will take time. I just want to do my best for the team."
Byram started last week's League Cup defeat to Newcastle United.