Measure latency only in special cases