So when testing to see if I could remove the step of having to flux proxy in Maestro, I encountered the following in the test of passing the URI to the Flux handle object. To my understanding, this should have succeeded so there's something that seems to be happening here.
The test was simply just loading our version of Flux from spack and then scheduling it. I then opened up a new terminal, spack loaded Flux, and used ipython to try and access the running instance through the handle object.
fdinatal@lassen708 /p/gpfs1/fdinatal/flux_testing ipython
Python 3.7.3 (default, Jul 26 2019, 00:19:46)
Type 'copyright', 'credits' or 'license' for more information
IPython 7.3.0 -- An enhanced Interactive Python. Type '?' for help.
In [1]: import flux
In [2]: h = flux.Flux?
Signature: flux.Flux(*args, **kwargs)
Docstring: <no docstring>
File: /usr/gapps/kras/spack5/opt/spack/linux-rhel7-ppc64le/gcc-7.3.1/flux-core-0.11.2-d7gy3jfzbvgeydvv2ycph2umio4g6rec/lib/python3.7/site-packages/flux/__init__.py
Type: function
In [3]: h = flux.Flux(url="ssh://lassen5/var/tmp/flux-IFi7Jx/0")
---------------------------------------------------------------------------
FileNotFoundError Traceback (most recent call last)
<ipython-input-3-e64be991c47a> in <module>
----> 1 h = flux.Flux(url="ssh://lassen5/var/tmp/flux-IFi7Jx/0")
/usr/gapps/kras/spack5/opt/spack/linux-rhel7-ppc64le/gcc-7.3.1/flux-core-0.11.2-d7gy3jfzbvgeydvv2ycph2umio4g6rec/lib/python3.7/site-packages/flux/__init__.py in Flux(*args, **kwargs)
17 import flux.core.handle
18
---> 19 return flux.core.handle.Flux(*args, **kwargs)
20
21
/usr/gapps/kras/spack5/opt/spack/linux-rhel7-ppc64le/gcc-7.3.1/flux-core-0.11.2-d7gy3jfzbvgeydvv2ycph2umio4g6rec/lib/python3.7/site-packages/flux/core/handle.py in __init__(self, url, flags, handle)
39
40 if handle is None:
---> 41 self.handle = raw.flux_open(url, flags)
42
43 self.aux_txn = None
/usr/gapps/kras/spack5/opt/spack/linux-rhel7-ppc64le/gcc-7.3.1/flux-core-0.11.2-d7gy3jfzbvgeydvv2ycph2umio4g6rec/lib/python3.7/site-packages/flux/wrapper.py in __call__(self, calling_object, *args_in)
207 err = calling_object.ffi.errno
208 if err != 0:
--> 209 raise EnvironmentError(err, os.strerror(err))
210
211 return result
FileNotFoundError: [Errno 2] No such file or directory
So when testing to see if I could remove the step of having to
flux proxyin Maestro, I encountered the following in the test of passing the URI to the Flux handle object. To my understanding, this should have succeeded so there's something that seems to be happening here.The test was simply just loading our version of Flux from spack and then scheduling it. I then opened up a new terminal, spack loaded Flux, and used ipython to try and access the running instance through the handle object.