What is the significance of the band gap in a semiconductor?

The band gap is the energy needed to lift an electron into the conduction band, where it can carry current.

A small gap, as in silicon, lets some electrons cross at room temperature, so the material conducts a little. A large gap, as in an insulator, keeps electrons in place, so it does not conduct.