There is nothing quite like having the latest program update to ensure that whatever software or hardware which you are using at the moment would be able to run as efficiently as possible, not to mention to squash whatever discovered bugs that there are along the way. I seems as though Microsoft has begun to introduce a new update for their Preview program for the Xbox One console that will be able to fix up whatever responsiveness issue that certain people have encountered. This particular update has already started to roll out over the weekend, and if you have yet to see it happen, you can always look for it in the system update via a manual method.
Just to make sure that you happen to be on the right page, this particular update would bump up the version number to xb_rel_1411.141023-2232, which can be quite a mouthful and difficult to remember unless you happen to have photographic memory, so it is best to write it down somewhere on a piece of paper, or to make do with what some people tend to do these days – capture down such information with your camera phone.
There is an Xbox post on Reddit that claims this particular update would be able to fix the following issue, “A fix for an issue some users reported where returning to Home from a game was unresponsive.” Have you already performed a download for the update already, and did it work as “advertised”?