Technically, if nuclear fusion inside the sun's core stopped this second?

Essentially, yes. Of course, it would not shine for that period of time and then instantaneously go dark. Rather, it would gradually become dimmer. It would probably shine brightly enough, for long enough, that humans would have the chance to build adequate protection and survive anyway.