@nathan-clark from what I see with JMP19's add-in builder, it is not quite like that. Unfortunately I don't have time at the moment to fully document my experience, but I'll quickly outline what I have. I am not an expert though. My goal was to fully replicate my old shared drive version, but in a different area using the JMP19 method.
Create an add-in using file->new->add in.
Set up the add-in by adding your scripts / icons. For mine, these are on a shared drive.
Have it automatically update files (in include files tab), and check for updates when JMP starts in General tab.
Save as to create a new .jmpaddin in an accessible location. Leave it there and have others install from that location.
Other JMP users will install from that location and their version of JMP will check that location to detect changes.
When you want to edit any files, open up the add-in builder / jmpaddin file so you are seeing the add in editor. then make your edits to the script. Then the 'save' button should appear visible in the add-in builder. Or use save as and save the addin with the same name. If you just drop an updated script file, or edit the jsl file and close it, and then later open the add-in builder, you won't see the save option. This a bug that has been reported to the developer.
JMP users using older versions of JMP will need to update the add-in by reinstalling the .jmpaddin file. JMP19 users should be prompted to update the add-in if they installed it from the same location. I don't know what happens if we go emailing the .jmpaddin file... presumably JMP wouldn't know where to later check for updates.