Skip to content

Tests of describe and multithreading fail in Julia-1.10.0-beta3 #3383

Closed
#3385
Closed
Tests of describe and multithreading fail in Julia-1.10.0-beta3#3383
#3385
Labels
bugmultithreading
Milestone
patch
@George9000

Description

@George9000
George9000
opened on Oct 4, 2023

versioninfo

tested with ENV["JULIA_USE_FLISP_PARSER"] = 1 and with JuliaSyntax parser

saw similar errors in Julia 1.11.0-DEV.582 (a4562e608f)

describe failures 
describe: Test Failed at /Users/foo/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:571
  Expression: describe_output[:, [:variable; default_fields]] == describe(df)
   Evaluated: 6×7 DataFrame
 Row │ variable        mean    min         median      max         nmissing  e ⋯
     │ Symbol          Union…  Any         Any         Any         Int64     T ⋯
─────┼──────────────────────────────────────────────────────────────────────────
   1 │ number          2.5     1.0         2.5         4.0                0  I ⋯
   2 │ number_missing  2.0     1.0         2.0         3.0                1  U
   3 │ string                  a                       d                  0  S
   4 │ string_missing          a                       c                  1  U
   5 │ dates                   2000-01-01  2002-01-01  2004-01-01         0  D ⋯
   6 │ catarray                1                       2                  0  C
                                                                1 column omitted == 6×7 DataFrame
 Row │ variable        mean    min         median  max         nmissing  eltyp ⋯
     │ Symbol          Union…  Any         Union…  Any         Int64     Type  ⋯
─────┼──────────────────────────────────────────────────────────────────────────
   1 │ number          2.5     1           2.5     4                  0  Int64 ⋯
   2 │ number_missing  2.0     1           2.0     3                  1  Union
   3 │ string                  a                   d                  0  Strin
   4 │ string_missing          a                   c                  1  Union
   5 │ dates                   2000-01-01          2004-01-01         0  Date  ⋯
   6 │ catarray                1                   2                  0  Categ
                                                                1 column omitted

Stacktrace:
 [1] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined]
 [2] macro expansion
   @ ~/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:571 [inlined]
 [3] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined]
 [4] top-level scope
   @ ~/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:541

describe: Test Failed at /Users/foo/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:577
  Expression: describe_output ≅ describe(df, :all)
   Evaluated: 6×16 DataFrame
 Row │ variable        mean    std      min         q25     median      q75    ⋯
     │ Symbol          Union…  Union…   Any         Union…  Any         Union… ⋯
─────┼──────────────────────────────────────────────────────────────────────────
   1 │ number          2.5     1.29099  1.0         1.75    2.5         3.25   ⋯
   2 │ number_missing  2.0     1.0      1.0         1.5     2.0         2.5
   3 │ string                           a
   4 │ string_missing                   a
   5 │ dates                            2000-01-01          2002-01-01         ⋯
   6 │ catarray                         1
                                                               9 columns omitted ≅ 6×16 DataFrame
 Row │ variable        mean    std      min         q25     median  q75     ma ⋯
     │ Symbol          Union…  Union…   Any         Union…  Union…  Union…  An ⋯
─────┼──────────────────────────────────────────────────────────────────────────
   1 │ number          2.5     1.29099  1           1.75    2.5     3.25    4  ⋯
   2 │ number_missing  2.0     1.0      1           1.5     2.0     2.5     3
   3 │ string                           a                                   d
   4 │ string_missing                   a                                   c
   5 │ dates                            2000-01-01                          20 ⋯
   6 │ catarray                         1                                   2
                                                               9 columns omitted

Stacktrace:
 [1] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined]
 [2] macro expansion
   @ ~/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:577 [inlined]
 [3] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined]
 [4] top-level scope
   @ ~/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:541

describe: Test Failed at /Users/foo/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:580
  Expression: describe_output[:, [:variable, :mean, :std, :min, :q25, :median, :q75, :max, :nunique, :nmissing, :eltype]] ≅ describe(df, :detailed)
   Evaluated: 6×11 DataFrame
 Row │ variable        mean    std      min         q25     median      q75    ⋯
     │ Symbol          Union…  Union…   Any         Union…  Any         Union… ⋯
─────┼──────────────────────────────────────────────────────────────────────────
   1 │ number          2.5     1.29099  1.0         1.75    2.5         3.25   ⋯
   2 │ number_missing  2.0     1.0      1.0         1.5     2.0         2.5
   3 │ string                           a
   4 │ string_missing                   a
   5 │ dates                            2000-01-01          2002-01-01         ⋯
   6 │ catarray                         1
                                                               4 columns omitted ≅ 6×11 DataFrame
 Row │ variable        mean    std      min         q25     median  q75     ma ⋯
     │ Symbol          Union…  Union…   Any         Union…  Union…  Union…  An ⋯
─────┼──────────────────────────────────────────────────────────────────────────
   1 │ number          2.5     1.29099  1           1.75    2.5     3.25    4  ⋯
   2 │ number_missing  2.0     1.0      1           1.5     2.0     2.5     3
   3 │ string                           a                                   d
   4 │ string_missing                   a                                   c
   5 │ dates                            2000-01-01                          20 ⋯
   6 │ catarray                         1                                   2
                                                               4 columns omitted

Stacktrace:
 [1] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined]
 [2] macro expansion
   @ ~/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:580 [inlined]
 [3] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined]
 [4] top-level scope
   @ ~/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:541
Test Summary: | Pass  Fail  Total  Time
describe      |   13     3     16  2.2s
        FAILED: dataframe.jl
LoadError: Some tests did not pass: 13 passed, 3 failed, 0 errored, 0 broken.
in expression starting at /Users/foo/.julia/packages/DataFrames/58MUJ/test/dataframe.jl:1
multithreading disable failures 
disabling multithreading via keyword argument: Test Failed at /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:157
  Expression: combine(gd, [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:157 =#
                        Threads.threadid()
                    end) => :id1), [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:158 =#
                        Threads.threadid()
                    end) => :id2), threads = true) != DataFrame(y = 1:4, id1 = 1, id2 = 1)
   Evaluated: 4×3 DataFrame
 Row │ y      id1    id2
     │ Int64  Int64  Int64
─────┼─────────────────────
   1 │     1      1      1
   2 │     2      1      1
   3 │     3      1      1
   4 │     4      1      1 != 4×3 DataFrame
 Row │ y      id1    id2
     │ Int64  Int64  Int64
─────┼─────────────────────
   1 │     1      1      1
   2 │     2      1      1
   3 │     3      1      1
   4 │     4      1      1

Stacktrace:
 [1] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined]
 [2] macro expansion
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:157 [inlined]
 [3] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined]
 [4] top-level scope
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:80

disabling multithreading via keyword argument: Test Failed at /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:177
  Expression: select(gd, [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:177 =#
                        Threads.threadid()
                    end) => :id1), [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:178 =#
                        Threads.threadid()
                    end) => :id2), threads = true) != DataFrame(y = refdf.y, id1 = 1, id2 = 1)
   Evaluated: 1000×3 DataFrame
  Row │ y      id1    id2
      │ Int64  Int64  Int64
──────┼─────────────────────
    1 │     2      1      1
    2 │     3      1      1
    3 │     1      1      1
    4 │     4      1      1
    5 │     2      1      1
    6 │     2      1      1
    7 │     4      1      1
    8 │     4      1      1
  ⋮   │   ⋮      ⋮      ⋮
  994 │     4      1      1
  995 │     2      1      1
  996 │     4      1      1
  997 │     4      1      1
  998 │     1      1      1
  999 │     1      1      1
 1000 │     4      1      1
            985 rows omitted != 1000×3 DataFrame
  Row │ y      id1    id2
      │ Int64  Int64  Int64
──────┼─────────────────────
    1 │     2      1      1
    2 │     3      1      1
    3 │     1      1      1
    4 │     4      1      1
    5 │     2      1      1
    6 │     2      1      1
    7 │     4      1      1
    8 │     4      1      1
  ⋮   │   ⋮      ⋮      ⋮
  994 │     4      1      1
  995 │     2      1      1
  996 │     4      1      1
  997 │     4      1      1
  998 │     1      1      1
  999 │     1      1      1
 1000 │     4      1      1
            985 rows omitted

Stacktrace:
 [1] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined]
 [2] macro expansion
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:177 [inlined]
 [3] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined]
 [4] top-level scope
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:80

disabling multithreading via keyword argument: Test Failed at /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:181
  Expression: select!(gd, [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:181 =#
                        Threads.threadid()
                    end) => :id1), [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:182 =#
                        Threads.threadid()
                    end) => :id2), threads = true) != DataFrame(y = refdf.y, id1 = 1, id2 = 1)
   Evaluated: 1000×3 DataFrame
  Row │ y      id1    id2
      │ Int64  Int64  Int64
──────┼─────────────────────
    1 │     2      1      1
    2 │     3      1      1
    3 │     1      1      1
    4 │     4      1      1
    5 │     2      1      1
    6 │     2      1      1
    7 │     4      1      1
    8 │     4      1      1
  ⋮   │   ⋮      ⋮      ⋮
  994 │     4      1      1
  995 │     2      1      1
  996 │     4      1      1
  997 │     4      1      1
  998 │     1      1      1
  999 │     1      1      1
 1000 │     4      1      1
            985 rows omitted != 1000×3 DataFrame
  Row │ y      id1    id2
      │ Int64  Int64  Int64
──────┼─────────────────────
    1 │     2      1      1
    2 │     3      1      1
    3 │     1      1      1
    4 │     4      1      1
    5 │     2      1      1
    6 │     2      1      1
    7 │     4      1      1
    8 │     4      1      1
  ⋮   │   ⋮      ⋮      ⋮
  994 │     4      1      1
  995 │     2      1      1
  996 │     4      1      1
  997 │     4      1      1
  998 │     1      1      1
  999 │     1      1      1
 1000 │     4      1      1
            985 rows omitted

Stacktrace:
 [1] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined]
 [2] macro expansion
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:181 [inlined]
 [3] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined]
 [4] top-level scope
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:80

disabling multithreading via keyword argument: Test Failed at /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:201
  Expression: transform(gd, [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:201 =#
                        Threads.threadid()
                    end) => :id1), [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:202 =#
                        Threads.threadid()
                    end) => :id2), threads = true) != [refdf DataFrame(id1 = fill(1, nrow(refdf)), id2 = 1)]
   Evaluated: 1000×4 DataFrame
  Row │ x      y      id1    id2
      │ Int64  Int64  Int64  Int64
──────┼────────────────────────────
    1 │     1      2      1      1
    2 │     2      3      1      1
    3 │     3      1      1      1
    4 │     4      4      1      1
    5 │     5      2      1      1
    6 │     6      2      1      1
    7 │     7      4      1      1
    8 │     8      4      1      1
  ⋮   │   ⋮      ⋮      ⋮      ⋮
  994 │   994      4      1      1
  995 │   995      2      1      1
  996 │   996      4      1      1
  997 │   997      4      1      1
  998 │   998      1      1      1
  999 │   999      1      1      1
 1000 │  1000      4      1      1
                   985 rows omitted != 1000×4 DataFrame
  Row │ x      y      id1    id2
      │ Int64  Int64  Int64  Int64
──────┼────────────────────────────
    1 │     1      2      1      1
    2 │     2      3      1      1
    3 │     3      1      1      1
    4 │     4      4      1      1
    5 │     5      2      1      1
    6 │     6      2      1      1
    7 │     7      4      1      1
    8 │     8      4      1      1
  ⋮   │   ⋮      ⋮      ⋮      ⋮
  994 │   994      4      1      1
  995 │   995      2      1      1
  996 │   996      4      1      1
  997 │   997      4      1      1
  998 │   998      1      1      1
  999 │   999      1      1      1
 1000 │  1000      4      1      1
                   985 rows omitted

Stacktrace:
 [1] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined]
 [2] macro expansion
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:201 [inlined]
 [3] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined]
 [4] top-level scope
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:80

disabling multithreading via keyword argument: Test Failed at /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:205
  Expression: transform!(gd, [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:205 =#
                        Threads.threadid()
                    end) => :id1), [] => ((()->begin
                        #= /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:206 =#
                        Threads.threadid()
                    end) => :id2), threads = true) != [refdf DataFrame(id1 = fill(1, nrow(refdf)), id2 = 1)]
   Evaluated: 1000×4 DataFrame
  Row │ x      y      id1    id2
      │ Int64  Int64  Int64  Int64
──────┼────────────────────────────
    1 │     1      2      1      1
    2 │     2      3      1      1
    3 │     3      1      1      1
    4 │     4      4      1      1
    5 │     5      2      1      1
    6 │     6      2      1      1
    7 │     7      4      1      1
    8 │     8      4      1      1
  ⋮   │   ⋮      ⋮      ⋮      ⋮
  994 │   994      4      1      1
  995 │   995      2      1      1
  996 │   996      4      1      1
  997 │   997      4      1      1
  998 │   998      1      1      1
  999 │   999      1      1      1
 1000 │  1000      4      1      1
                   985 rows omitted != 1000×4 DataFrame
  Row │ x      y      id1    id2
      │ Int64  Int64  Int64  Int64
──────┼────────────────────────────
    1 │     1      2      1      1
    2 │     2      3      1      1
    3 │     3      1      1      1
    4 │     4      4      1      1
    5 │     5      2      1      1
    6 │     6      2      1      1
    7 │     7      4      1      1
    8 │     8      4      1      1
  ⋮   │   ⋮      ⋮      ⋮      ⋮
  994 │   994      4      1      1
  995 │   995      2      1      1
  996 │   996      4      1      1
  997 │   997      4      1      1
  998 │   998      1      1      1
  999 │   999      1      1      1
 1000 │  1000      4      1      1
                   985 rows omitted

Stacktrace:
 [1] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:672 [inlined]
 [2] macro expansion
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:205 [inlined]
 [3] macro expansion
   @ ~/applications/juliadev/usr/share/julia/stdlib/v1.10/Test/src/Test.jl:1577 [inlined]
 [4] top-level scope
   @ ~/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:80
Test Summary:                                 | Pass  Fail  Total  Time
disabling multithreading via keyword argument |   15     5     20  4.1s
        FAILED: multithreading.jl
LoadError: Some tests did not pass: 15 passed, 5 failed, 0 errored, 0 broken.
in expression starting at /Users/foo/.julia/packages/DataFrames/58MUJ/test/multithreading.jl:1

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugmultithreading

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions