Found by Coverity.
If there's actually another thread using the list when the refcount
hits zero, you're going to have a bad time regardless of the lock.

Coverity has been pointing this out for a while, but we've been
ignoring it as a false positive.