I first ran into this when trying to determine the relative performance of two generators:
t = timeit.repeat('g.get()', setup='g = my_generator()')
So I dug into the timeit module and found that the setup and statement are evaluated with their own private, initially empty namespaces so naturally the binding of g never becomes accessible to the g.get() statement. The obvious solution is to wrap them into a class, thus adding to the global namespace.
I bumped into this again when attempting, in another project, to use the multiprocessing module to divide a task among workers. I even bundled everything nicely into a class but unfortunately the call
pool.apply_async(runmc, arg)
fails with a PicklingError because buried inside the work object that runmc instantiates is (effectively) an assignment:
self.predicate = lambda x, y: x > y
so the whole object can't be (understandably) pickled and whereas:
def foo(x, y):
return x > y
pickle.dumps(foo)
is fine, the sequence
bar = lambda x, y: x > y
yields True from callable(bar) and from type(bar), but it Can't pickle <function <lambda> at 0xb759b764>: it's not found as __main__.<lambda>.
I've given only code fragments because I can easily fix these cases by merely pulling them out into module or object level defs. The bug here appears to be in my understanding of the semantics of namespace use in general. If the nature of the language requires that I create more def statements I'll happily do so; I fear that I'm missing an essential concept though. Why is there such a strong reliance on the global namespace? Or, what am I failing to understand?
Namespaces are one honking great idea -- let's do more of those!
