As Evan Jones points out, the threadpool is a common tool for concurrent and parallel tasks. For Python, I've been using the solid, but long in the tooth, Xoltar toolkit. I'm putting Jones' workqueue module in my backpocket since it's of recent vintage.