Spurs striker Kane, 21, was introduced as a second-half substitute by boss Gareth Southgate and had the desired impact by firing England to eight wins from nine games in their group.
Lithuania 0-1 England
UEFA European U21 Championship
Group One Qualifying
Friday 5 September 2014
Dariaus ir Gireno Stadium, Kaunas
With qualification to next month’s play-offs already secured, a victory wasn’t necessarily essential for England but Kane is keen to keep the momentum going.
"We wanted to come here and win and we want to win our next game as well to finish the group as strongly as possible as we go into the play-offs," said Kane.
"They made it a tough game and we knew it would be like that coming away from home, it always is at places like this.
"We had to be patient, which I thought we were, and we got the goal in the end so we’re happy with the win."
Kane has been a regular in Southgate’s squad as England aim to reach the Euro Finals in Czech Republic next summer.
But his only previous three goals in the campaign came in last October’s win against San Marino, where the east Londoner bagged a hat-trick.
So when he climbed highest in the box to power home James Ward-Prowse's cross after 81 minutes in Kaunas, there was relief all-round after a dominant performance from England.
Watch Kane's match-winning header against Lithuania
"You always want to make an impact when you come off the bench so it was great to get the goal and most importantly the win," he added.
"It was a great ball in from Prowsey, I knew he was going to put it in the box so I just made a quick movement and fortunately he put it right on my head and I was able to put it in the back of the net.
"There’s always an opportunity when the opposition get more tired in a period of the game, so I always feel that I’m going to get a chance when I’m on the pitch."
The squad will now remain at their base in Kaunas until Monday, when they will head further east to Moldova for their final match in qualifying group one.
And Kane is happy with that, following the welcome the England squad have received in the Baltic state since their arrival on Thursday.
"It’s a really nice country," he revealed.
"We’ve enjoyed our stay here so far and I’m sure we will enjoy the next couple of days before we go to Moldova.
"Everyone’s been very nice and welcoming."
