acl-plugin: fix the high cpu usage caused by the connection cleaner