You don't have to add it but it helps with Damping Off Prevention... Covering the seed tray with vermiculite wards off the fungus that causes damping off in seedlings. It also helps to aerate the soil, so roots breathe better and insulates against temperature and humidity changes in your seed box.
Wouldn't worry for now, but it's something to beat in mind for next time
