The Villa boss enjoyed his first League win since taking charge of the club against the Baggies on Tuesday night and the local rivals will come face-to-face again just four days later in the Sixth Round.
And after being heavily linked with the vacant Hawthorns hot-seat last summer and in December, prior to the appointment of Tony Pulis, the former Spurs boss is keen to record another win against their near-neighbours.
Aston Villa v West Bromwich Albion
The FA Cup
Sixth Round Proper
5.30pm, Saturday 7 March 2015
Villa Park, Aston Villa
Winners receive £360,000 from prize fund
Live on BBC1
"I had discussions with them on two occasions, but we just decided that it wasn't the right one for me," revealed Sherwood.
"But I'm just grateful that I now have the opportunity to manage the biggest club in Birmingham.
"I admire Tony Pulis, he's a good guy and I've had a lot of conversations with him, so I wish him all the best after this one."
There’s a spot at Wembley in the Semi-Final waiting as a reward for the winners, which Sherwood hopes will be motivation enough for his players, buoyed by their 2-1 win on Tuesday.
And Sherwood, who was appointed the day after Villa’s Fifth Round victory against Leicester City, admits a trip to the national stadium would come as a boost for the club.
"To win and take this club to the Semi-Final would be huge," he added.
"A lot of the guys have never been to Wembley before and the fans deserve some joy this season and that would certainly bring some.
Aston Villa boss Tim Sherwood speaks ahead of their FA Cup clash with West Brom
"Everyone dreams of playing in an FA Cup Final, so second-best surely must be managing a team to The FA Cup Final."
Sherwood’s primary focus remains on keeping Villa in the top flight though and following the confidence-boosting win this week, he believes there is enough in his squad to succeed.
"I'm learning all the time and I think the spirit's there, I really do," he revealed.
"There's no shortage of effort and I just think we need to show more quality when the pressure's on and when there's a little bit of anxiety breathing around the stands.
"That's normal because of the position we are in the league but I can assure the Villa fans that these players really do care."