A barnstorming Sevu Reece scored with 20 minutes to play to swing the game in the Crusaders' favour.
His devastating line break and try came against the run of play as the Chiefs, who started the half down by just three points thanks to two first-half tries from Alex Nankivell, looked for a go-ahead try.
Leicester Fainga'anuku then carried four men over the line from close range to all but seal the second-placed Crusaders' fourth win from five starts as crowds returned to New Zealand Super games.
The Chiefs remain in fifth place and will have concerns over star lock Brodie Retallick after he left the field late in the first half with a thumb injury.
Crusaders captain Scott Barrett said the loss a fortnight ago had stung his side into action.
"Last time they hurt us at home; it's a tough place to come out on top here, we talked out effort all week," he said after the five tries to three win.
"Last time the Chiefs had better of it, dominated physically.
"We had to turn up physically and I thought the boys showed plenty of effort in that area."
Chiefs skipper Sam Cane lamented their inability to match the competition heavyweights.
"To be fair they won the majority of the little battles that go on inside a rugby game," he said.
"They put us under a lot of pressure ... it's disappointing at home for the first time in a long time, because today we took a couple of backward steps.
"But credit has to go to the Crusaders for the pressure and attitude they showed up with tonight.
"Man it makes you appreciate it when you haven't had it for a wee while."
Crusaders 34 (Cullen Grace, Will Jordan, Sevu Reece, Leicester Fainga’anuku, Codie Taylor; Richie Mo’unga 3 con, pen) Chiefs 19 (Alex Nankivell 2 tries, Cortez Ratima; Bryn Gatland 2 con). HT: 15-12
Chiefs: 1 Ollie Norris, 2 Samisoni Taukei'aho, 3 Sione Mafileo, 4 Josh Lord, 5 Brodie Retallick, 6 Tupou Vaa'i, 7 Sam Cane (cc), 8 Semipeni Finau, 9 Brad Weber (cc), 10 Bryn Gatland, 11 Etene Nanai-Seturo, 12 Quinn Tuapea, 13 Alex Nankivell, 14 Shaun Stevenson, 15 Kaleb Trask
Replacements: 16 Tyrone Thompson, 17 Aidan Ross, 18 Angus Ta'avao, 19 Naitoa Ah Kuoi, 20 Kaylum Boshier, 21 Mitch Jacobson, 22 Cortez Ratima, 23 Josh Ioane
CRUSADERS: 15 Will Jordan, 14 Chay Fihaki, 13 Leicester Fainga’anuku, 12 David Havili, 11 George Bridge, 10 Richie Mo'unga, 9 Bryn Hall, 8 Cullen Grace, 7 Tom Christie, 6 Ethan Blackadder, 5 Quinten Strange, 4 Scott Barrett (captain), 3 Oli Jager, 2 Codie Taylor, 1 Finlay Brewis.
Replacements: 16 Brodie McAlister, 17 George Bower, 18 Tamaiti Williams, 19 Mitch Dunshea, 20 Corey Kellow, 21 Mitch Drummond, 22 Fergus Burke, 23 Sevu Reece.
Referee: James Doleman
Assistant referees: Dan Waegna, Mike Winter