Skip to content

[CI] LinearRankClientYamlTestSuiteIT test {yaml=linear/10_linear_retriever/should normalize initial scores with l2_norm} failing #128774

@elasticsearchmachine

Description

@elasticsearchmachine

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:rank-rrf:yamlRestTest" --tests "org.elasticsearch.xpack.rank.rrf.LinearRankClientYamlTestSuiteIT.test {yaml=linear/10_linear_retriever/should normalize initial scores with l2_norm}" -Dtests.seed=B392F52F3B06DCB1 -Dtests.jvm.argline="-Des.concurrent_search=true" -Dtests.locale=en-MS -Dtests.timezone=ECT -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: Failure at [linear/10_linear_retriever:319]: field [hits.hits.3._score] doesn't match the expected value
Expected: <1.2>
     but: was <1.2000000476837158>

Issue Reasons:

  • [main] 7 consecutive failures in test test {yaml=linear/10_linear_retriever/should normalize initial scores with l2_norm}
  • [main] 19 failures in test test {yaml=linear/10_linear_retriever/should normalize initial scores with l2_norm} (73.1% fail rate in 26 executions)
  • [main] 4 failures in step part2 (57.1% fail rate in 7 executions)
  • [main] 4 failures in pipeline elasticsearch-intake (57.1% fail rate in 7 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

Metadata

Metadata

Assignees

Labels

:Search Relevance/RankingScoring, rescoring, rank evaluation.>test-failureTriaged test failures from CITeam:Search RelevanceMeta label for the Search Relevance team in Elasticsearchneeds:riskRequires assignment of a risk label (low, medium, blocker)

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions