I would recommend staying at a hotel in Rexburg and just doing the max 15 min. converse from St. Anthony's to the motel 8 or shilo inn right off of the high way. St. Anthony is some of the steepest dunes in North America and you should definitely hit Big bowl, Devils Dune, and The mother of them all choke cherry.
Just PM me before you go if you want a guide. And here in Idaho you can never guess the weather so be prepared for rain or wind but most of the time its perfect riding.