The Worcestershire club, who currently lie in 13th place in the Southern League Division One South & West, drew 0-0 at Histon when they first met on Saturday, despite the hosts playing in a higher league.
Evesham United v Histon
The FA Cup
Second Round Qualifying replay
7.45pm, Wednesday 1 October 2014
Spiers & Hartwell Jubilee Stadium
Winning clubs receive £4500
And the club known as the Robins will build on that good result to push on and attempt to win the tie at home.
Former Swindon Town player Collicutt said: "We are the home side, so you have to take the initiative and we will be looking to go forward as much as possible.
"We went there with a game plan to give it a go and we were on the front foot, creating chances but were unable to take them."
Histon created many opportunities too, testing goalkeeper Kevin Sawyer on many occasions but Collicutt was happy with 34-year-old's work at the weekend.
"In the first 15-20 minutes, he made a few good saves and he kept a good clean sheet," he added.
Sawyer has now kept seven clean sheets in the opening 13 games this season in all competitions, an impressive record at any level.
Collicutt revealed: "He has not conceded a goal in most games so far this season and it is what I expect from him."
Histon currently lie in 22nd place in the Southern League and have only managed to accumulate one league win this season.
However, the club from Cambridgeshire has good pedigree in this competition, reaching The FA Cup proper on three occasions since 2003 and caused major upsets over Swindon Town and Leeds United in the 2008–09 season.