vlib: Handle race in thread barrier processing