If do_scale ever failed, it would result in graphics buffers not
returning to the pool, resulting in them never being reused.