Fix crash in barrier sync when vlib_worker_threads is zero