With the German defence at full stretch and time almost up, Bulut provided the killer blow with the 95th-minute second-leg winner which put Schalke out of the competition with a 3-4 aggregate loss over the two legs of the last 16 tie.
The German side failed in its bid to join Bundesliga rivals Borussia Dortmund in the quarter-finals.
With some 10,000 Galatasaray fans among the 54,142 strong crowd, in part due to Gelsenkirchen’s sizeable Turkish community, the first-half was a breathtaking affair as control slipped from the host’s grip and into that of the Turkish side.
Midfielder Roman Neustädter gave the German side an early lead in the 17th minute, when the ball fell to him after captain Benedikt Höwedes’s header was blocked and he fired past goalkeeper Fernando Muslera.
The advantage lasted 20 minutes as Galatasaray got back on level terms when a short free-kick caught the hosts cold and Altintop planted an unstoppable shot which clipped the post as it flew in, just out of Hildebrand’s reach.
The Turkish league leaders then went 3-2 ahead on aggregate in the 42nd minute from an innocuous situation when left-back Albert Riera slid in to dispossess Marco Höger in the Schalke half.
The ball flew over the home defence and into the path of Yilmaz, who bolted onto the loose ball, held off Höwedes and lobbed Hildebrand to put Galatasaray ahead.
The Royal Blues took the game by the scruff of the neck with Finland striker Teemu Pukki, in for injured Dutch star Klaas-Jan Huntelaar, going close, while Julian Draxler, 19, also tested Muslera.
Schalke equalised when Muslera’s save fell to Japan right-back Atsuto Uchida who slid a pass out to Michel Bastos, who fired home from close range to give his team a lifeline.
Both sides had their chances to settle the matter as Pukki, with the ball as his feet, forced Muslera into a great save, as did Bastos, while at the other end Hildebrand was called into action to deny Nordin Amrabat.
But when Schalke were caught out by a late counter-attack, it was Bulut who rounded Hildebrand to knock the hosts out.
“We are all very disappointed,” said Schalke goalkeeper Timo Hildebrand. “We made a mistake for their first goal (by Altintop), the sort you can’t afford in the Champions League and we were punished straight away.”
Having scored Galatasaray’s first goal with a beautifully stuck long-range shot, Altintop, the ex-Schalke midfielder who was born in Gelsenkirchen, asked for the home fans’ forgiveness.
“I learnt to play football here, I started my career here and a part of me is still Schalke, I hope the fans can forgive my celebration,” said Altintop, who left the Royal Blues in 2007 after a four year stay.