supervisor: backport autorun configuration API

This is backport of autorun configuration API from 4.x.
6 jobs for 3.x-4.x-backport
in 5 minutes and 39 seconds and was queued for 45 seconds