Clean up the L2 interface configs when creating the interfaces