Carla Ward edged Sheffield in front, but Billie Haynes drew Albion level before Abigail Cottam converted from the penalty spot after Leigh Dugmore had gone down under a challenge from Lynn Goodman.
And Cottam booked Albion’s spot in the last 16 with her second of the tie with 12 minutes left on the clock.
The SS Women's FA Cup
Fourth Round Proper
Sunday 28 February 2016
Winners receive £500 from prize fund
By Josh Richards
Everton, twice winners of the competition, saw off Nottingham Forest with a 5-0 win.
Kelly Jones broke the deadlock on 40 minutes and Claudia Walker doubled the advantage before half-time.
Michelle Hinnigan scored twice to put the Toffees in total control before Emily Hollinshead rounded things off.
Yeovil Town will join them in Monday's fifth round draw after beating Bristol City on penalties. Jodie Brett, on loan from FA Cup holders Chelsea, went closest to breaking the deadlock but saw an effort come back off the post.
And Yeovil profited with Atlanta Primus, Sarah Wiltshire and Helen Bleazard all successful from the spot.
Elsewhere, Tottenham Hotspur gave Aston Villa a scare before eventually succumbing by 3-2 after extra time.
Bianca Baptiste chipped Spurs in front, but Destiny Toussaint equalised before the interval. The home side led again through Baptiste, however with seven minutes remaining Mollie Rouse scored to force extra time. And a Katie Wilkinson penalty in the 109th minute saw Villa progress.
Millwall Lionesses also required extra time to beat Loughborough Foxes by 2-1 on the road. After a goalless 90 minutes Naomi Cole and Danielle Carlton netted for Millwall, before Millie Chandarana’s late effort set up a nervy finale.
Two goals from Natalie Gutteridge saw Durham beat Charlton Athletic 3-1. Beth Hepple put Durham ahead, but Gemma Shepherd levelled for the Londoners.
Kit Graham wasted the chance to give Charlton the lead with a missed penalty and Gutteridge made them pay.
And Brighton & Hove Albion defeated Blackburn Rovers by 2-1. Kate Natkiel opened the scoring on three minutes, but Rovers equalised midway through the second half with a Lynda Shepherd penalty.
Amy Taylor though slotted beyond the clutches of goalkeeper Danielle Hill with nine minutes left to send Brighton through.