013-05-17 13:49:11,562.562 [IPClusterStart] Using existing profile dir: u'/xxxx/.ipython/profile_hpc'
2013-05-17 13:49:11.567 [IPClusterStart] Starting ipcluster with [daemon=False]
2013-05-17 13:49:11.571 [IPClusterStart] Creating pid file: /xxxx/.ipython/profile_hpc/pid/ipcluster.pid
2013-05-17 13:49:11.574 [IPClusterStart] Starting Controller with LSF
2013-05-17 13:49:11.603 [IPClusterStart] Job submitted with job id: '231710'
2013-05-17 13:49:12.598 [IPClusterStart] Starting 2 Engines with LSF
2013-05-17 13:49:12.654 [IPClusterStart] Job submitted with job id: '231711'
2013-05-17 13:49:42.741 [IPClusterStart] Engines appear to have started successfully
2013-05-17 13:53:06.188 [IPClusterStart] IPython cluster: stopping
2013-05-17 13:53:06.188 [IPClusterStart] Stopping Engines...
successfully
bjobs shows ipython in the queue with status RUN, but if I then open an ipython session (as ipython --profile="hpc"), I don't get any engines:
from IPython import parallel
rc=parallel.Client()
rc.ids # this returns []
The logged output from ipcontroller seems to suggest that connections did indeed take place as I entered variations of rc=parallel.Client():
2013-05-17 13:49:17,562.562 [IPControllerApp] Using existing profile dir: u'/xxxx/.ipython/profile_hpc'
2013-05-17 13:49:17.576 [IPControllerApp] Hub listening on tcp://*:42013 for registration.
2013-05-17 13:49:17.577 [IPControllerApp] Hub using DB backend: 'NoDB'
2013-05-17 13:49:17.829 [IPControllerApp] hub::created hub
2013-05-17 13:49:17.829 [IPControllerApp] writing connection info to /xxxx/.ipython/profile_hpc/security/ipcontroller-client.json
2013-05-17 13:49:17.838 [IPControllerApp] writing connection info to /xxxx/.ipython/profile_hpc/security/ipcontroller-engine.json
2013-05-17 13:49:17.846 [IPControllerApp] task::using Python leastload Task scheduler
2013-05-17 13:49:17.846 [IPControllerApp] Heartmonitor started
2013-05-17 13:49:17.853 [scheduler] Scheduler started [leastload]
2013-05-17 13:49:17.884 [IPControllerApp] Creating pid file: /xxxx/.ipython/profile_hpc/pid/ipcontroller.pid
2013-05-17 13:49:17.888 [IPControllerApp] client::client '\x00*\x01\xb8\x89\xea(Nb\x9d \xd9\x17\xde\x12%\x8b' requested u'connection_request'
2013-05-17 13:49:17.888 [IPControllerApp] client::client ['\x00*\x01\xb8\x89\xea(Nb\x9d \xd9\x17\xde\x12%\x8b'] connected
2013-05-17 13:50:00.959 [IPControllerApp] client::client '\x006\xffL\xa7\xdc\x08Gl\x88o[I\x10\x05\xefd' requested u'connection_request'
2013-05-17 13:50:00.959 [IPControllerApp] client::client ['\x006\xffL\xa7\xdc\x08Gl\x88o[I\x10\x05\xefd'] connected
2013-05-17 13:51:37.280 [IPControllerApp] client::client "\x00\xbf3\xf9'B\x8bLV\xa5\x92\x06\x1f;\xccQ#" requested u'connection_request'
2013-05-17 13:51:37.280 [IPControllerApp] client::client ["\x00\xbf3\xf9'B\x8bLV\xa5\x92\x06\x1f;\xccQ#"] connected
2013-05-17 13:52:12.845 [IPControllerApp] client::client '\x00\x96Ag\xef\xf6\xc9E/\xb4 <at> d3D\xa3\x8e\xb5' requested u'connection_request'
2013-05-17 13:52:12.845 [IPControllerApp] client::client ['\x00\x96Ag\xef\xf6\xc9E/\xb4 <at> d3D\xa3\x8e\xb5'] connected