enthought / enthought/distarray

TypeErrors with numpy 1.10

Open
#652 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
5
Forks
1
PR merge metrics
No merged PRs in 30d

Description

``` python
======================================================================
ERROR: test_mean_dtype (distarray.globalapi.tests.test_distarray.TestReduceMethods)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/travis/build/enthought/distarray/distarray/globalapi/tests/test_distarray.py", line 817, in test_mean_dtype
da_mean = self.darr.mean(axis=0, dtype=int)
File "/home/travis/build/enthought/distarray/distarray/globalapi/distarray.py", line 387, in mean
return self._reduce('mean_reducer', axis, dtype, out)
File "/home/travis/build/enthought/distarray/distarray/globalapi/distarray.py", line 374, in _reduce
targets=self.targets)[0]
File "/home/travis/build/enthought/distarray/distarray/globalapi/context.py", line 819, in apply
return self.view.apply_sync(func_wrapper, *wrapped_args)
File "", line 2, in apply_sync
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 63, in spin_after
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 234, in apply_sync
return self._really_apply(f, args, kwargs, block=True)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 54, in sync_results
ret = f(self, *args, **kwargs)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 39, in save_ids
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 571, in _really_apply
return ar.get()
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 104, in get
raise self._exception
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 139, in wait
results = error.collect_exceptions(results, self._fname)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 233, in collect_exceptions
raise e
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 231, in collect_exceptions
raise CompositeError(msg, elist)
ipyparallel.error.CompositeError: one or more exceptions from call to method: func_wrapper
[0:apply]: TypeError: ufunc 'true_divide' output (typecode 'd') could not be coerced to provided output parameter (typecode 'l') according to the casting rule ''same_kind''
[1:apply]: TypeError: ufunc 'true_divide' output (typecode 'd') could not be coerced to provided output parameter (typecode 'l') according to the casting rule ''same_kind''
======================================================================
ERROR: test_std_dtype (distarray.globalapi.tests.test_distarray.TestReduceMethods)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/travis/build/enthought/distarray/distarray/globalapi/tests/test_distarray.py", line 855, in test_std_dtype
da_std = self.darr.std(dtype=int)
File "/home/travis/build/enthought/distarray/distarray/globalapi/distarray.py", line 395, in std
return self._reduce('std_reducer', axis, dtype, out)
File "/home/travis/build/enthought/distarray/distarray/globalapi/distarray.py", line 374, in _reduce
targets=self.targets)[0]
File "/home/travis/build/enthought/distarray/distarray/globalapi/context.py", line 819, in apply
return self.view.apply_sync(func_wrapper, *wrapped_args)
File "", line 2, in apply_sync
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 63, in spin_after
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 234, in apply_sync
return self._really_apply(f, args, kwargs, block=True)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 54, in sync_results
ret = f(self, *args, **kwargs)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 39, in save_ids
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 571, in _really_apply
return ar.get()
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 104, in get
raise self._exception
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 139, in wait
results = error.collect_exceptions(results, self._fname)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 233, in collect_exceptions
raise e
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 231, in collect_exceptions
raise CompositeError(msg, elist)
ipyparallel.error.CompositeError: one or more exceptions from call to method: func_wrapper
[0:apply]: TypeError: ufunc 'true_divide' output (typecode 'd') could not be coerced to provided output parameter (typecode 'l') according to the casting rule ''same_kind''
======================================================================
ERROR: test_var_dtype (distarray.globalapi.tests.test_distarray.TestReduceMethods)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/travis/build/enthought/distarray/distarray/globalapi/tests/test_distarray.py", line 845, in test_var_dtype
da_var = self.darr.var(dtype=int)
File "/home/travis/build/enthought/distarray/distarray/globalapi/distarray.py", line 391, in var
return self._reduce('var_reducer', axis, dtype, out)
File "/home/travis/build/enthought/distarray/distarray/globalapi/distarray.py", line 374, in _reduce
targets=self.targets)[0]
File "/home/travis/build/enthought/distarray/distarray/globalapi/context.py", line 819, in apply
return self.view.apply_sync(func_wrapper, *wrapped_args)
File "", line 2, in apply_sync
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 63, in spin_after
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 234, in apply_sync
return self._really_apply(f, args, kwargs, block=True)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 54, in sync_results
ret = f(self, *args, **kwargs)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 39, in save_ids
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 571, in _really_apply
return ar.get()
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 104, in get
raise self._exception
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 139, in wait
results = error.collect_exceptions(results, self._fname)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 233, in collect_exceptions
raise e
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 231, in collect_exceptions
raise CompositeError(msg, elist)
ipyparallel.error.CompositeError: one or more exceptions from call to method: func_wrapper
[0:apply]: TypeError: ufunc 'true_divide' output (typecode 'd') could not be coerced to provided output parameter (typecode 'l') according to the casting rule ''same_kind''
======================================================================
ERROR: test_save_load_with_filenames (distarray.globalapi.tests.test_distributed_io.TestDnpyFileIO)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/travis/build/enthought/distarray/distarray/globalapi/tests/test_distributed_io.py", line 52, in test_save_load_with_filenames
db = self.context.load_dnpy(self.output_paths)
File "/home/travis/build/enthought/distarray/distarray/globalapi/context.py", line 331, in load_dnpy
da_key = self.apply(func, (self.comm, name), targets=self.targets)
File "/home/travis/build/enthought/distarray/distarray/globalapi/context.py", line 819, in apply
return self.view.apply_sync(func_wrapper, *wrapped_args)
File "", line 2, in apply_sync
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 63, in spin_after
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 234, in apply_sync
return self._really_apply(f, args, kwargs, block=True)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 54, in sync_results
ret = f(self, *args, **kwargs)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 39, in save_ids
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 571, in _really_apply
return ar.get()
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 104, in get
raise self._exception
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 139, in wait
results = error.collect_exceptions(results, self._fname)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 233, in collect_exceptions
raise e
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 231, in collect_exceptions
raise CompositeError(msg, elist)
ipyparallel.error.CompositeError: one or more exceptions from call to method: func_wrapper
[0:apply]: ValueError: malformed node or string: b"{'__version__': '0.10.0', 'dim_data': ({'proc_grid_rank': 0, 'proc_grid_size': 4, 'size': 100, 'stop': 25, 'dist_type': 'b', 'start': 0},), } \n"
[1:apply]: ValueError: malformed node or string: b"{'__version__': '0.10.0', 'dim_data': ({'proc_grid_rank': 1, 'stop': 50, 'dist_type': 'b', 'proc_grid_size': 4, 'start': 25, 'size': 100},), } \n"
[2:apply]: ValueError: malformed node or string: b"{'__version__': '0.10.0', 'dim_data': ({'stop': 75, 'size': 100, 'dist_type': 'b', 'start': 50, 'proc_grid_rank': 2, 'proc_grid_size': 4},), } \n"
[3:apply]: ValueError: malformed node or string: b"{'__version__': '0.10.0', 'dim_data': ({'proc_grid_size': 4, 'size': 100, 'start': 75, 'dist_type': 'b', 'proc_grid_rank': 3, 'stop': 100},), } \n"
======================================================================
ERROR: test_save_load_with_prefix (distarray.globalapi.tests.test_distributed_io.TestDnpyFileIO)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/travis/build/enthought/distarray/distarray/globalapi/tests/test_distributed_io.py", line 64, in test_save_load_with_prefix
db = self.context.load_dnpy(output_path)
File "/home/travis/build/enthought/distarray/distarray/globalapi/context.py", line 331, in load_dnpy
da_key = self.apply(func, (self.comm, name), targets=self.targets)
File "/home/travis/build/enthought/distarray/distarray/globalapi/context.py", line 819, in apply
return self.view.apply_sync(func_wrapper, *wrapped_args)
File "", line 2, in apply_sync
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 63, in spin_after
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 234, in apply_sync
return self._really_apply(f, args, kwargs, block=True)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 54, in sync_results
ret = f(self, *args, **kwargs)
File "", line 2, in _really_apply
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 39, in save_ids
ret = f(self, *args, **kwargs)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/view.py", line 571, in _really_apply
return ar.get()
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 104, in get
raise self._exception
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/client/asyncresult.py", line 139, in wait
results = error.collect_exceptions(results, self._fname)
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 233, in collect_exceptions
raise e
File "/home/travis/miniconda/envs/distarray-env/lib/python3.4/site-packages/ipyparallel/error.py", line 231, in collect_exceptions
raise CompositeError(msg, elist)
ipyparallel.error.CompositeError: one or more exceptions from call to method: func_wrapper
[0:apply]: ValueError: malformed node or string: b"{'__version__': '0.10.0', 'dim_data': ({'proc_grid_rank': 0, 'proc_grid_size': 4, 'size': 100, 'stop': 25, 'dist_type': 'b', 'start': 0},), } \n"
[1:apply]: ValueError: malformed node or string: b"{'__version__': '0.10.0', 'dim_data': ({'proc_grid_rank': 1, 'stop': 50, 'dist_type': 'b', 'proc_grid_size': 4, 'start': 25, 'size': 100},), } \n"
[2:apply]: ValueError: malformed node or string: b"{'__version__': '0.10.0', 'dim_data': ({'stop': 75, 'size': 100, 'dist_type': 'b', 'start': 50, 'proc_grid_rank': 2, 'proc_grid_size': 4},), } \n"
[3:apply]: ValueError: malformed node or string: b"{'__version__': '0.10.0', 'dim_data': ({'proc_grid_size': 4, 'size': 100, 'start': 75, 'dist_type': 'b', 'proc_grid_rank': 3, 'stop': 100},), } \n"
```

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the failures in distarray/globalapi/tests/test_distarray.py, especially test_mean_dtype, test_var_dtype, and test_std_dtype, and in distarray/globalapi/tests/test_distributed_io.py for test_save_load_with_filenames. Trace the calls through distarray/globalapi/distarray.py and distarray/globalapi/context.py, then verify that these tests pass with NumPy 1.10 and that filename-based loading works.

Written by the indexing model from the issue text.

Assessment

Tech stack
numpy, python
Domain
data, distributed-systems
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.