The plugin replaced the output's encoders with ones made from the server's configuration and never put OBS's own back, so a reconnect (or the next stream) whose configuration listed no encoders of a kind kept the old tracks. Remember OBS's slot-0 encoders at start and restore them, removing only the plugin's own.