But in every other area, the Wallabies ruled the roost creating three superbly worked tries to leave Johnson fuming.
He said: "I think that's as harsh as I've been with them.
"The scrum played a big factor in the game but not enough for us to win.
"We said we should be angry with ourselves. If you give it a decent shot and get beaten that is one thing but when you add to it in the way we did it is disappointing.
"We make it too easy for the opposition. You have to be very good down here to win games and we didn't help ourselves.
"We started very poorly. We were more than a little off the pace, gave them a lot of chances and put ourselves in trouble.
"We had enough chances to put ourselves in the game but their composure on the ball was better.
"It is accuracy and execution. Their line speed was better and took away our time on the ball.
"But if you concede three tries you are probably not going to win. The missed tackle count was not healthy."