What change are you making to that line. If the plugin is unpublished, i don’t think that it should show up there at all, because the whitelist is downloaded from the library. If the plugin is unpublished the library shouldnt know about it.
But now following your comment I just deleted the line completely and… and it seems to work perfectly. All the modules are in the Module Browser and not disappearing!