Pagano won't be directing Ray Lewis, Ed Reed, Terrell Suggs and company in Super Bowl XLVI, which will be played on Feb. 5 in Indianapolis.
Instead, he will spearhead the rebuilding of the Indianapolis Colts as the team's new head coach, according to the Associated Press.
The Colts went 2-14 in 2011 as franchise quarterback Peyton Manning missed the entire season. The team's failure to adjust to losing Manning cost coach Jim Caldwell his job.
Pagano was hailed in Baltimore for bringing back the chaotic, aggressive defensive schemes more reminiscent of the Rex Ryan era than previous coordinator Greg Mattison, who left the Ravens to take over the defense at Michigan following the 2011 NFL postseason.
Pagano was effective in his one season as the Ravens' defensive coordinator. The team ranked third in the NFL in points allowed (16.6 points per game) and third in total yards allowed (288.9 yards per game). The Ravens were also third in the NFL in sacks, two behind league-leaders Minnesota and Philadelphia.