supervisor: backport autorun configuration API

This is backport of autorun configuration API from 4.x.
6 jobs for 3.x-4.x-backport in 5 minutes and 39 seconds (queued for 45 seconds)