France have just two away clashes in this year's RBS 6 Nations but they were comprehensively beaten in their first, losing 27-6 to Wales at the Millennium Stadium last month.
Next up was a visit to Murrayfield and, despite looking second best for much of Saturday afternoon, Jean-Marc Doussain's late penalty handed Les Bleus a 19-17 win.
Huget had earlier intercepted a Duncan Weir pass and run 80 metres to score France's only try of the match and ensure they head into next weekend's clash with Ireland in contention for the Championship.
"It is a good sign how we got back into the game and this win is especially important as it shows we can win away from home," said Huget
France will return home for the Ireland clash and head coach Philippe Saint-Andre believes the French crowd will spur his side on next weekend.
"It will be a different game at home at the Stade de France in front of our crowd," he said.
"We need to start well and accelerate during the 80 minutes but I am sure the guys can do this.
"The target (against Scotland) was to win, to keep our discipline, keep our composure and we did this during the 80 minutes."