As a Mounted Fury you lose fast movement (it's given to any mount you ride), and you give up uncanny dodge and improved uncanny dodge.
At 5th level you gain a bestial mount which shares in your rage, and advances like a druid's animal companion.