With a freshly cloned kernel (at commit 5af43c24ca59a448c9312dd4a4a51d27ec3b9a73) I don't have any issues with my FTU on an XHCI port. Are you still experiencing this problem?