Parallel Python

Show Posts
Pages: [1] 2 3 ... 35

1	Python Forums / Parallel Python Forum / Re: simple questions about pp	on: March 16, 2013, 09:08:38 AM
1. Those that cannot be pickled with cPickle 2. node-1> is a shell prompt on workstation 1 3. if pp.Server() returns 1 core that is most likely the optimal configuration for CPU bound jobs. 4. When you run serial application on single core computer.

2	Python Forums / Parallel Python Forum / Re: Fix for importing numpy on Debian	on: February 24, 2013, 08:29:10 PM
Your patch is included in 1.6.4: http://www.parallelpython.com/component/option,com_smf/Itemid,29/topic,715.msg1928#msg1928 Thanks!

3	Python Forums / Parallel Python Forum / Re: PP 1.6.3 and a reference to non-existent signal.SIGUSR1?	on: February 24, 2013, 08:28:40 PM
Your patch is included in 1.6.4: http://www.parallelpython.com/component/option,com_smf/Itemid,29/topic,715.msg1928#msg1928 Thanks!

4	Python Forums / Parallel Python Forum / PP 1.6.4 is released!	on: February 24, 2013, 08:24:22 PM
Changes w.r.t pp-1.6.3: 1) Start ppworker using -m 2) Fixed windows compatibility issue. Downloads: http://www.parallelpython.com/downloads/pp/pp-1.6.4.zip http://www.parallelpython.com/downloads/pp/pp-1.6.4.tar.gz http://www.parallelpython.com/downloads/pp/pp-1.6.4.tar.bz2 http://www.parallelpython.com/downloads/pp/pp-1.6.4.exe

5	Python Forums / Parallel Python Forum / Re: PP locks forever!	on: February 24, 2013, 08:06:13 PM
Code that writes directly to stderr or stdout (i.e. does not obey python override which is done in ppworker.py) might cause issues.

6	Python Forums / Parallel Python Forum / Re: @Vitalii: "with" warnings	on: February 24, 2013, 07:55:03 PM
linecache.py is not a PP file. PP uses 'with' only as a keyword = something else is causing the problem.

Python Forums / Parallel Python Forum / Re: Return an object from a function

on: February 24, 2013, 07:43:15 PM

This is a bug in python pickle module. Here is an example that fails and does NOT use PP:

Code: (python)

class DataObject(object):
    def __init__(self):
      self.header_array = {}
 
    def __getattr__(self, name):
      return self.header_array[name]
 
    def __setattr__(self, name, value):
      self.header_array[name] = value
 
import pickle
if __name__ == '__main__':
    obj1 = DataObject()
    obj1.longitude = 32
    a = pickle.dumps(obj1)
    print pickle.loads(a)

The bug and a workaround are described here:
http://bugs.python.org/issue5370

8	Python Forums / Parallel Python Forum / Re: Fault Tolerance	on: December 21, 2012, 12:00:08 AM
1) if there is no response from a remote job socket connection will time out and job will be resubmitted. 2) Should not happen, however it should not be waiting from the callback function. 3) Now with 1.6.3 version you can send SIGUSR1 to the ppserver.py and see how many jobs are active. 4) Callback functions is executed only when job succeeds, so it should never execute twice for a job.

9	Python Forums / Parallel Python Forum / PP 1.6.3 is released!	on: December 20, 2012, 11:45:13 PM
Changes w.r.t pp-1.6.2: 1) Added -P pid_file command line argument to ppserver.py 2) Modified print_stats() to output the number of active tasks. 3) Added SIGUSR1 handler to ppserver.py to print stats when signal is received. Downloads: http://www.parallelpython.com/downloads/pp/pp-1.6.3.zip http://www.parallelpython.com/downloads/pp/pp-1.6.3.tar.gz http://www.parallelpython.com/downloads/pp/pp-1.6.3.tar.bz2 http://www.parallelpython.com/downloads/pp/pp-1.6.3.exe Supported Python versions: 2.5, 2.6, 2.7 Example of the new features usage: Code: (bash) ppserver.py -P /tmp/ppserver.pid kill -s SIGUSR1 `cat /tmp/ppserver.pid`

10	Python Forums / Parallel Python Forum / Re: PP 1.6.2 is released!	on: December 19, 2012, 12:40:57 AM
It uses second protocol for serialization.

11	Python Forums / Parallel Python Forum / Re: code works with local workers, but fails with ppserver	on: December 18, 2012, 11:57:02 PM
PP is not compatible with py2exe

12	Python Forums / Parallel Python Forum / Re: Feature request: Save PID of ppserver in file for remote killing of the server	on: December 18, 2012, 11:56:09 PM
Good idea. It will be available in 1.6.3 release: Code: (bash) ./ppserver.py -P /tmp/ppserver.pid

13	Python Forums / Parallel Python Forum / Re: RuntimeError: Communication pipe read error	on: December 18, 2012, 11:46:44 PM
Source of functions cannot be retrieved in py2exec binaries. PP won't work with them.

14	Python Forums / Parallel Python Forum / Re: Error on callback on OSX 10.8, Python 2.7	on: December 18, 2012, 11:45:03 PM
Based on the error you posted "No module named _Qd" ... module cannot be found. Could be a problem with module search or installation.

15	Python Forums / Parallel Python Forum / Re: Memory leak?	on: December 18, 2012, 11:43:37 PM
When you submit functions they do use memory which is freed up only when their results are retrieved. I suggest to batch submission and retrieval process. Instead of submitting 1000 of unit of work and then retrieving all of them, split the work in 10 batches. Then for each batch submit and retrieve 100 units of work.

Pages: [1] 2 3 ... 35