The Villa boss believes they will play a huge part if the good times are to return to Villa Park, having had to endure goal droughts and a relegation battle this season before looking forward to a first trip to Wembley since 2010.
Aston Villa 2-0 West Bromwich Albion
The FA Cup
Sixth Round Proper
5.30pm, Saturday 7 March 2015
Villa Park, Aston Villa FC
Winners receive £360,000 from prize fund
Live on BBC1
And Sherwood says the players are keen to dedicate the quarter-final win to the people who have stuck with them through thick and thin.
"The players want to dedicate the win to the fans," he said after the game.
"They think the fans have had some hard times and everyone at the club now realises we are going to need those supporters.
"There are going to be ups and downs, it won’t all be rosy in the garden.
"There will be down times and we will need them to pick us up because they look like a magnificent group of fans."
Villa overcame a timid start to the game to secure victory and Sherwood admits, in hindsight, he is not surprised his team were not fully at the races in the first period.
"I think the slow start was partly down to the changes in formation but second-half, they played how I wanted them to play in that shape with Scott Sinclair finding a bit of room, penetrating more and showing his real class to finish the second goal," he explained.
"We had three fit defenders today and a special mention for Leo Bacuna.
"First-half, I thought he looked out of position but second-half I thought he looked like he’d played there all his life and that shows real character.
"It has been a very good week for us but we know there’s a lot of hard work still to be done."
Sherwood admitted he didn’t know where he would watch Monday’s Semi-Final draw but was in playful mood when asked who he would like in the next round.
"Anyone would do as long as it is Bradford or Reading," he laughed.
"Anyone in the Semi-Final of The FA Cup is going to be a tough game, I’m only kidding."