Tries from Stuart Hogg and Lee Jones had set Andy Robinson's side on course for their first victory in the tournament since beating Italy at Murrayfield last year.
However Maxime Medard crossed soon after Jones to help claim victory for the French and keep alive their hopes of a Grand Slam.
Scotland drew great praise for pushing the World Cup runners-up all the way but Rennie insists it's points not plaudits they are seeking.
"Everyone's just a bit bored of this feeling," said flanker Ross Rennie.
"It's very frustrating. We are improving week to week and the games are showing that.
"We've got two games left and everyone's targeting Dublin to put that record right."
The defeat left coach Robinson with just two wins from 13 RBS 6 Nations games but winger Jones claims the performance against France sets Scotland up well for the trip to Ireland in their penultimate game.
"We've shown we can compete against the side which contested the World Cup final so we're in a good place going to Dublin," he said.
"We just need to take what we can and get a win against Ireland.
"If we can score tries against France, Ireland have a similar defensive system. We can take confidence from that and hopefully score tries and make the breaks against Ireland.
"We just need to take what we can and get a win against Ireland."