The constant nagging by you systemd people worked. I’ve written a unit that does what I need it to do. That was more annoying than I think it needed to be, but well… my solution didn’t work at all.
AFAIK kernel itself doesn't send any signals to processes on shutdown/reboot, it just stops executing them. This is a job service manager (e.g. systemd) that terminates processes using SIGTERM before asking kernel to shutdown.
You are never guaranteed to be able to do anything during a crash. You are better off handling these kinds of edge cases in a recovery phase during the start of your app.
Crash-only software. To be resilient you need some kind of ACID anyway which means that you can let go of your shutdown procedure and just send yourself SIGKILL instead.
SIGINT is sent when you press Ctrl+C. SIGTERM is sent in just about every other situation - basically when the system wants the program to end. For instance when systemd wants to stop the service or the default signal with programs like killpkillhtop etc. You should catch both of these signals.
I can't remember off the top of my head, but your shell script might not be relaying the SIGTERM. Make sure you start your node process with the "exec" statement. This will replace the script's process with node instead of having node be a subprocess of your script.
My computer has a problem where occasionally it will become completely unresponsive. (Mouse cursor doesn't move. Keys have no apparently effect. Whatever app is running freezes. I think its a hardware problem with the graphics card, but I don't know what. Logs at the time it freezes say "the GPU has fallen off the bus".)
Anyway... I recently learnt about Magic SysRq. And I've been able to shutdown the computer from this unresponsive state with SysRq, R E I S U O. Where as I understand it, the "E" tells processes the end nicely if they can; and then the "I" just ends them by force.
(At this point, I'm realising that the E is SIGTERM, not SIGINT - so that screws up the relevance of my story; but I figure I'll keep going anyway.)
The point is, I've been using key combo with a nice pause between each key, thinking there was some chance that processes might be ending gracefully. But when I tried it while the computer wasn't frozen, the computer was able to inform me that the E and I commands were disabled. (I don't know why.) So even though I wanted to give a nice "please end" signal, in the end that just wasn't happening.
I didn't know why a person would go to these lengths to deal with a misbehaving computer, as compute devices are generally for work, and need to work in order to do work, and any kind of crash is going to get my entire focus until it is banished to Hades...
...but then, learned something along the way I probably otherwise would not have, because of @bleistift2@sopuli.xyz's tenacity.
It turns out I’m getting SIGCHLD. It might be related to how my script is started – it is a bash script that starts a node process and is itself run by Cinnamon’s (?) startup applications feature.