ES|QL: IntArrayBlock cannot be cast to DoubleBlock

[luigidellaquila]

With the CSV tests dataset
(load the dataset with ./gradlew :x-pack:plugin:esql:qa:testFixtures:loadCsvSpecData --args="http://elastic-admin:elastic-password@localhost:9200")

from *,sample_data_ts_long* 
| enrich languages_policy on cluster
| rename languages.byte as language_code 
| lookup join languages_lookup on language_code 
| stats  still_hired = count_distinct(`height.scaled_float`), salary_change.long = max(ratings), foo = max(num) by ip1

{
    "error": {
        "root_cause": [
            {
                "type": "class_cast_exception",
                "reason": "class org.elasticsearch.compute.data.IntArrayBlock cannot be cast to class org.elasticsearch.compute.data.DoubleBlock (org.elasticsearch.compute.data.IntArrayBlock and org.elasticsearch.compute.data.DoubleBlock are in unnamed module of loader java.net.FactoryURLClassLoader @541afb85)"
            }
        ],
        "type": "class_cast_exception",
        "reason": "class org.elasticsearch.compute.data.IntArrayBlock cannot be cast to class org.elasticsearch.compute.data.DoubleBlock (org.elasticsearch.compute.data.IntArrayBlock and org.elasticsearch.compute.data.DoubleBlock are in unnamed module of loader java.net.FactoryURLClassLoader @541afb85)"
    },
    "status": 500
}

java.lang.ClassCastException: class org.elasticsearch.compute.data.IntArrayBlock cannot be cast to class org.elasticsearch.compute.data.DoubleBlock (org.elasticsearch.compute.data.IntArrayBlock and org.elasticsearch.compute.data.DoubleBlock are in unnamed module of loader java.net.FactoryURLClassLoader @541afb85)
        at org.elasticsearch.compute.aggregation.MaxDoubleGroupingAggregatorFunction.prepareProcessPage(MaxDoubleGroupingAggregatorFunction.java:62)
        at org.elasticsearch.compute.aggregation.GroupingAggregator.prepareProcessPage(GroupingAggregator.java:57)
        at org.elasticsearch.compute.operator.HashAggregationOperator.addInput(HashAggregationOperator.java:189)
        at org.elasticsearch.compute.operator.Driver.runSingleLoopIteration(Driver.java:276)
        at org.elasticsearch.compute.operator.Driver.run(Driver.java:184)
        at org.elasticsearch.compute.operator.Driver$1.doRun(Driver.java:403)
        at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:27)
        at org.elasticsearch.compute.operator.DriverScheduler$1.doRun(DriverScheduler.java:57)
        at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:27)
        at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.TimedRunnable.doRun(TimedRunnable.java:34)
        at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:1044)
        at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:27)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)

[elasticsearchmachine]

Pinging @elastic/es-analytical-engine (Team:Analytics)

[alex-spies]

There's a chance this is the same as #121754. I guess the FROM *,... means that this is run in batches, some of which will run against indices with missing fields, which we know currently can mess up layouts.

I'm working on a fix in #125764. I'll check if that also fixes this.

[alex-spies]

Yeah, this reproduces on main but doesn't repro with #125764 anymore.

[alex-spies]

Was able to condense the reproducer to

from * | enrich languages_policy on cluster | rename languages.byte as language_code | lookup join languages_lookup on language_code | stats  salary_change.long = max(ratings), foo = max(num)