Skip to content

Overflow with large experiments #5

@timydaley

Description

@timydaley

Hi, I'm applying SpadeR to estimate immune repertoire. These experiments are extremely large, on the order of millions. I'm getting the following error:

Diversity(TCR_L3_24_F89_sample, datatype = "abundance")
Error in if (f1 - f2 * f3/2/f4 > 0 & f3 != 0) { :
missing value where TRUE/FALSE needed
In addition: Warning messages:
1: In f2 * f3 : NAs produced by integer overflow
2: In f2 * f3 : NAs produced by integer overflow

Where f2 and f3 are respectively

TCR_L3_24_F89_sample_hist[2,2]
[1] 79859
TCR_L3_24_F89_sample_hist[3,2]
[1] 38548

As it is currently written, SpadeR cannot be applied to this scale of experiments. If the estimates were done in double precision arithmetic then there would naturally be some loss in numerical accuracy, but I think it would be minimal.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions