Pull the fuse from it's holder. Put your meter test leads across the fuse tabs. If the display still says infinity "&" or reads 0 then the fuse is open (blown).
If the meter reading says a low number, most times less than 1 ohm (like 0.2 etc) then the fuse is good. If your meter has a continuity beeper, it will beep when you put it across the fuse.
Fuses are cheap, if any doubt with a fuse buy a new one.