Parallel Python

Hello,

I have recently been trying to parallelize an enthought traits application I have using pp.

My efforts have failed so far, pp cannot find a definition for CHasTraits, I am curious if anybody out there has encountered anything similar?

I have python 2.7 and pp 1.6.1 installed and I am running ubuntu 11.04.

There is a lot of chatter out there concerning pp failing to find class definitions, I have tried passing traits, traitsui, traits.ctraits via the modules argument and tried importing them before hand and passing in the globals(), nothing has worked.

here is the exception (I added in some print statements showing it was looking for CHasTraits)

  File "/usr/local/lib/python2.7/dist-packages/pp.py", line 458, in submit
   sfunc = self.__dumpsfunc((func, ) + depfuncs, modules)
  File "/usr/local/lib/python2.7/dist-packages/pp.py", line 629, in __dumpsfunc
   sources = [self.__get_source(func) for func in funcs]
  File "/usr/local/lib/python2.7/dist-packages/pp.py", line 696, in __get_source
   sourcelines = inspect.getsourcelines(func)[0]
  File "/usr/lib/python2.7/inspect.py", line 688, in getsourcelines
   lines, lnum = findsource(object)
  File "/usr/lib/python2.7/dist-packages/IPython/ultraTB.py", line 175, in findsource
   raise IOError("could not find class definition \n\t{0}\n\t{1}\n\t{2}\n\t{3}".format(name, object, candidates, lines))
IOError: could not find class definition
   CHasTraits
   <type 'traits.ctraits.CHasTraits'>
   []

here is my code, I have not cooked up a working example at this point, I can in the future....

Code:

   import pp
   import traits, traitsui
   import traits.ctraits as ctraits
   #print("* GLOBALS")
   #for k,v in globals().items():
   # print("k: {0}".format(k))
   # print("v: {0}\n".format(v))
   js = pp.Server(secret='test')
   tasks = []
   for rec in records:
   #http://stackoverflow.com/questions/9995391/parallel-python-create-objects-into-another-class-in-parallel-execution
   #http://www.parallelpython.com/component/option,com_smf/Itemid,1/topic,614.0
   #http://www.parallelpython.com/component/option,com_smf/Itemid,1/topic,413.0
   #http://www.parallelpython.com/component/option,com_smf/Itemid,1/topic,655.0/wap2,wap2
   #http://www.parallelpython.com/component/option,com_smf/Itemid,1/topic,293.0
   #raise Exception("this never worked, ImportErrors originating from sjv and numpy")
   tasks.append(js.submit(self.sdm.intersection,
   args=(timePeriod, rec),
   globals = globals(),
   #modules=("sjv","numpy", "traits", "traitsui", "traits.ctraits")
   #modules=("sjv","numpy", "traits", "traitsui", "traits.ctraits")
   #modules=("sjv","numpy")
   #modules=("traits",)
   #depfuncs=(self.sdm.__class__, timePeriod.__class__, tr.__class__))
   #depfuncs=(traits.ctraits))
   ))

	Author	Topic: pp and enthought traits (Read 1385 times)
0 Members and 1 Guest are viewing this topic.