[julia-users] parallel threads broken, replacing module

[l***@gmail.com]

Parallel threads has stopped working for me. Any ideas ?
Code using addprocs and @everywhere include has stopped working (is broken)
on one machine. Code that used to work now causes a number of varying
errors to be printed, crashes, runaway processes, etc. when it is loaded.
Both a recent v0.4 and a 2 month old version that did run the code in the
past cause the failure. The same code on a different machine continues to
run normally. Maybe my user Julia environment has a problem ? Or maybe I
upgraded a system library ?

If I use just 2 processes, the code will sometimes both load and run
correctly.

A minimal example

test.jl
------
using Distributions
------

julia -p 4
@everywhere include("test.jl")

WARNING: replacing module Distributions ( 4 times )
signal (11): Segmentation fault
unknown function (ip: 0x7f235c7ffd98)
jl_module_import at /usr/local/julia-0.4a/bin/../lib/julia/libjulia.so
(unknown line)

etc.

I am running unstable debian linux.

Thanks, John

[l***@gmail.com]

I can file a bug report. But, I'm not entirely sure what to write.

julia -p 4
@everywhere using ZChop (simple modules)

The following version is from a completely fresh build today. I don't get a
crash immediately, but I do get
WARNING: replacing module ZChop (4 times)
Version 0.4.0-dev+6394 (2015-07-29 21:58 UTC)
Commit a2a218b* (0 days old master)

Five days ago, i did git pull and built from an older clone
Version 0.4.0-dev+6202 (2015-07-24 01:47 UTC)
Commit 53a7f2e* (5 days old master)
This version prints the same warning and spews many errors including
unknown function (ip: 0x7fe94d596ff7)
ERROR (unhandled task failure): EOFError: read end of file

The following version will load ZChop with no problem, but when loading
Distributions, it still prints many errors
and fails. It loads some other modules (i.e with @everywhere, as above),
such as Roots with no apparent errors.
Version 0.4.0-dev+3965 (2015-03-22 12:24 UTC)
Commit e1f0310* (129 days old master)

A fresh build today on another machine gives errors with @everywhere using
Roots.
It fails to load Distributions even with no parallel threads, but this
appears to be unrelated.

On the same (other) machine, the following version loads and runs parallel
code using the modules
mentioned above, and more.
Version 0.4.0-dev+4096 (2015-03-31 08:05 UTC)
Commit a3c0743* (120 days old master)

I see no error with 0.3.5-pre+121 (2015-01-07 00:19 UTC)

Parallel threads has stopped working for me. Any ideas ?
broken) on one machine. Code that used to work now causes a number of
varying errors to be printed, crashes, runaway processes, etc. when it is
loaded. Both a recent v0.4 and a 2 month old version that did run the code
in the past cause the failure. The same code on a different machine
continues to run normally. Maybe my user Julia environment has a problem ?
Or maybe I upgraded a system library ?
If I use just 2 processes, the code will sometimes both load and run
correctly.
A minimal example
test.jl
------
using Distributions
------

julia -p 4
@everywhere include("test.jl")

WARNING: replacing module Distributions ( 4 times )
signal (11): Segmentation fault
unknown function (ip: 0x7f235c7ffd98)
jl_module_import at /usr/local/julia-0.4a/bin/../lib/julia/libjulia.so
(unknown line)
etc.
I am running unstable debian linux.
Thanks, John

[Seth]

For what it's worth, I'm seeing the same thing:

julia> @everywhere using LightGraphs
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
exception on 4:
...
(Lots of error messages / backtraces removed)
...
ERROR: ProcessExitedException()
in wait at /usr/local/julia-latest/lib/julia/sys.dylib
in sync_end at /usr/local/julia-latest/lib/julia/sys.dylib
in anonymous at multi.jl:348

Post by l***@gmail.com
I can file a bug report. But, I'm not entirely sure what to write.

julia -p 4
@everywhere using ZChop (simple modules)

The following version is from a completely fresh build today. I don't get
a crash immediately, but I do get
WARNING: replacing module ZChop (4 times)
Version 0.4.0-dev+6394 (2015-07-29 21:58 UTC)
Commit a2a218b* (0 days old master)
Five days ago, i did git pull and built from an older clone
Version 0.4.0-dev+6202 (2015-07-24 01:47 UTC)
Commit 53a7f2e* (5 days old master)
This version prints the same warning and spews many errors including
unknown function (ip: 0x7fe94d596ff7)
ERROR (unhandled task failure): EOFError: read end of file
The following version will load ZChop with no problem, but when loading
Distributions, it still prints many errors
such as Roots with no apparent errors.
Version 0.4.0-dev+3965 (2015-03-22 12:24 UTC)
Commit e1f0310* (129 days old master)
Roots.
It fails to load Distributions even with no parallel threads, but this
appears to be unrelated.
On the same (other) machine, the following version loads and runs parallel
code using the modules
mentioned above, and more.
Version 0.4.0-dev+4096 (2015-03-31 08:05 UTC)
Commit a3c0743* (120 days old master)
I see no error with 0.3.5-pre+121 (2015-01-07 00:19 UTC)

Parallel threads has stopped working for me. Any ideas ?
broken) on one machine. Code that used to work now causes a number of
varying errors to be printed, crashes, runaway processes, etc. when it is
loaded. Both a recent v0.4 and a 2 month old version that did run the code
in the past cause the failure. The same code on a different machine
continues to run normally. Maybe my user Julia environment has a problem ?
Or maybe I upgraded a system library ?
If I use just 2 processes, the code will sometimes both load and run
correctly.
A minimal example
test.jl
------
using Distributions
------

julia -p 4
@everywhere include("test.jl")

WARNING: replacing module Distributions ( 4 times )
signal (11): Segmentation fault
unknown function (ip: 0x7f235c7ffd98)
jl_module_import at /usr/local/julia-0.4a/bin/../lib/julia/libjulia.so
(unknown line)
etc.
I am running unstable debian linux.
Thanks, John

[Seth]

Reference: https://github.com/JuliaLang/julia/issues/12381

Post by Seth
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
...
(Lots of error messages / backtraces removed)
...
ERROR: ProcessExitedException()
in wait at /usr/local/julia-latest/lib/julia/sys.dylib
in sync_end at /usr/local/julia-latest/lib/julia/sys.dylib
in anonymous at multi.jl:348

Post by l***@gmail.com
I can file a bug report. But, I'm not entirely sure what to write.

julia -p 4
@everywhere using ZChop (simple modules)

The following version is from a completely fresh build today. I don't get
a crash immediately, but I do get
WARNING: replacing module ZChop (4 times)
Version 0.4.0-dev+6394 (2015-07-29 21:58 UTC)
Commit a2a218b* (0 days old master)
Five days ago, i did git pull and built from an older clone
Version 0.4.0-dev+6202 (2015-07-24 01:47 UTC)
Commit 53a7f2e* (5 days old master)
This version prints the same warning and spews many errors including
unknown function (ip: 0x7fe94d596ff7)
ERROR (unhandled task failure): EOFError: read end of file
The following version will load ZChop with no problem, but when loading
Distributions, it still prints many errors
such as Roots with no apparent errors.
Version 0.4.0-dev+3965 (2015-03-22 12:24 UTC)
Commit e1f0310* (129 days old master)
using Roots.
It fails to load Distributions even with no parallel threads, but this
appears to be unrelated.
On the same (other) machine, the following version loads and runs
parallel code using the modules
mentioned above, and more.
Version 0.4.0-dev+4096 (2015-03-31 08:05 UTC)
Commit a3c0743* (120 days old master)
I see no error with 0.3.5-pre+121 (2015-01-07 00:19 UTC)

Parallel threads has stopped working for me. Any ideas ?
broken) on one machine. Code that used to work now causes a number of
varying errors to be printed, crashes, runaway processes, etc. when it is
loaded. Both a recent v0.4 and a 2 month old version that did run the code
in the past cause the failure. The same code on a different machine
continues to run normally. Maybe my user Julia environment has a problem ?
Or maybe I upgraded a system library ?
If I use just 2 processes, the code will sometimes both load and run
correctly.
A minimal example
test.jl
------
using Distributions
------

julia -p 4
@everywhere include("test.jl")

WARNING: replacing module Distributions ( 4 times )
signal (11): Segmentation fault
unknown function (ip: 0x7f235c7ffd98)
jl_module_import at /usr/local/julia-0.4a/bin/../lib/julia/libjulia.so
(unknown line)
etc.
I am running unstable debian linux.
Thanks, John

[l***@gmail.com]

Thanks Seth.

Post by Seth
Reference: https://github.com/JuliaLang/julia/issues/12381

Post by Seth
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
WARNING: replacing module LightGraphs
...
(Lots of error messages / backtraces removed)
...
ERROR: ProcessExitedException()
in wait at /usr/local/julia-latest/lib/julia/sys.dylib
in sync_end at /usr/local/julia-latest/lib/julia/sys.dylib
in anonymous at multi.jl:348

Post by l***@gmail.com
I can file a bug report. But, I'm not entirely sure what to write.

julia -p 4
@everywhere using ZChop (simple modules)

The following version is from a completely fresh build today. I don't
get a crash immediately, but I do get
WARNING: replacing module ZChop (4 times)
Version 0.4.0-dev+6394 (2015-07-29 21:58 UTC)
Commit a2a218b* (0 days old master)
Five days ago, i did git pull and built from an older clone
Version 0.4.0-dev+6202 (2015-07-24 01:47 UTC)
Commit 53a7f2e* (5 days old master)
This version prints the same warning and spews many errors including
unknown function (ip: 0x7fe94d596ff7)
ERROR (unhandled task failure): EOFError: read end of file
The following version will load ZChop with no problem, but when loading
Distributions, it still prints many errors
such as Roots with no apparent errors.
Version 0.4.0-dev+3965 (2015-03-22 12:24 UTC)
Commit e1f0310* (129 days old master)
using Roots.
It fails to load Distributions even with no parallel threads, but this
appears to be unrelated.
On the same (other) machine, the following version loads and runs
parallel code using the modules
mentioned above, and more.
Version 0.4.0-dev+4096 (2015-03-31 08:05 UTC)
Commit a3c0743* (120 days old master)
I see no error with 0.3.5-pre+121 (2015-01-07 00:19 UTC)

Parallel threads has stopped working for me. Any ideas ?
broken) on one machine. Code that used to work now causes a number of
varying errors to be printed, crashes, runaway processes, etc. when it is
loaded. Both a recent v0.4 and a 2 month old version that did run the code
in the past cause the failure. The same code on a different machine
continues to run normally. Maybe my user Julia environment has a problem ?
Or maybe I upgraded a system library ?
If I use just 2 processes, the code will sometimes both load and run
correctly.
A minimal example
test.jl
------
using Distributions
------

julia -p 4
@everywhere include("test.jl")

WARNING: replacing module Distributions ( 4 times )
signal (11): Segmentation fault
unknown function (ip: 0x7f235c7ffd98)
jl_module_import at /usr/local/julia-0.4a/bin/../lib/julia/libjulia.so
(unknown line)
etc.
I am running unstable debian linux.
Thanks, John