Skip to content

Skip the validation when retrieving the index mode during reindexing a time series data stream. #127824

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
May 8, 2025

Conversation

gmarouli
Copy link
Contributor

@gmarouli gmarouli commented May 7, 2025

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in #125607.

I do not see a reason to not fix this as suggested in #125607 (comment).

Fixes: #125607

@gmarouli gmarouli added >bug :Data Management/Data streams Data streams and their lifecycles :StorageEngine/TSDB You know, for Metrics labels May 7, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

@elasticsearchmachine
Copy link
Collaborator

Hi @gmarouli, I've created a changelog YAML for you.

Copy link
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

I think this bug fix should also be back ported to the 8.19 branch.

@gmarouli gmarouli added auto-backport Automatically create backport pull requests when merged v8.19.0 labels May 8, 2025
@gmarouli
Copy link
Contributor Author

gmarouli commented May 8, 2025

I think this bug fix should also be back ported to the 8.19 branch.

You are right, I will add the other active versions as well.

@elasticsearchmachine
Copy link
Collaborator

Hi @gmarouli, I've updated the changelog YAML for you.

@gmarouli gmarouli merged commit 077b6b9 into elastic:main May 8, 2025
17 checks passed
@gmarouli gmarouli deleted the fix-reindex-ts-index branch May 8, 2025 07:25
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.19 Commit could not be cherrypicked due to conflicts
8.17 Commit could not be cherrypicked due to conflicts
8.18 Commit could not be cherrypicked due to conflicts
9.0 Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 127824

gmarouli added a commit to gmarouli/elasticsearch that referenced this pull request May 8, 2025
…a time series data stream. (elastic#127824)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in elastic#125607.

I do not see a reason to not fix this as suggested in elastic#125607 (comment).

Fixes: elastic#125607
(cherry picked from commit 077b6b9)

# Conflicts:
#	modules/data-streams/build.gradle
#	modules/reindex/src/main/java/org/elasticsearch/reindex/Reindexer.java
gmarouli added a commit to gmarouli/elasticsearch that referenced this pull request May 8, 2025
…a time series data stream. (elastic#127824)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in elastic#125607.

I do not see a reason to not fix this as suggested in elastic#125607 (comment).

Fixes: elastic#125607
(cherry picked from commit 077b6b9)

# Conflicts:
#	modules/data-streams/build.gradle
#	modules/reindex/src/main/java/org/elasticsearch/reindex/Reindexer.java
gmarouli added a commit to gmarouli/elasticsearch that referenced this pull request May 8, 2025
…a time series data stream. (elastic#127824)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in elastic#125607.

I do not see a reason to not fix this as suggested in elastic#125607 (comment).

Fixes: elastic#125607
(cherry picked from commit 077b6b9)

# Conflicts:
#	modules/data-streams/build.gradle
#	modules/reindex/src/main/java/org/elasticsearch/reindex/Reindexer.java
@gmarouli
Copy link
Contributor Author

gmarouli commented May 8, 2025

💚 All backports created successfully

Status Branch Result
9.0
8.19
8.18
8.17

Questions ?

Please refer to the Backport tool documentation

gmarouli added a commit to gmarouli/elasticsearch that referenced this pull request May 8, 2025
…a time series data stream. (elastic#127824)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in elastic#125607.

I do not see a reason to not fix this as suggested in elastic#125607 (comment).

Fixes: elastic#125607
(cherry picked from commit 077b6b9)

# Conflicts:
#	modules/data-streams/build.gradle
#	modules/reindex/src/main/java/org/elasticsearch/reindex/Reindexer.java
elasticsearchmachine pushed a commit that referenced this pull request May 8, 2025
…a time series data stream. (#127824) (#127894)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in #125607.

I do not see a reason to not fix this as suggested in #125607 (comment).

Fixes: #125607
(cherry picked from commit 077b6b9)

# Conflicts:
#	modules/data-streams/build.gradle
#	modules/reindex/src/main/java/org/elasticsearch/reindex/Reindexer.java
elasticsearchmachine pushed a commit that referenced this pull request May 8, 2025
…a time series data stream. (#127824) (#127898)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in #125607.

I do not see a reason to not fix this as suggested in #125607 (comment).

Fixes: #125607
(cherry picked from commit 077b6b9)

# Conflicts:
#	modules/data-streams/build.gradle
#	modules/reindex/src/main/java/org/elasticsearch/reindex/Reindexer.java
elasticsearchmachine pushed a commit that referenced this pull request May 8, 2025
…a time series data stream. (#127824) (#127900)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in #125607.

I do not see a reason to not fix this as suggested in #125607 (comment).

Fixes: #125607
(cherry picked from commit 077b6b9)

# Conflicts:
#	modules/data-streams/build.gradle
#	modules/reindex/src/main/java/org/elasticsearch/reindex/Reindexer.java
elasticsearchmachine pushed a commit that referenced this pull request May 8, 2025
…a time series data stream. (#127824) (#127901)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in #125607.

I do not see a reason to not fix this as suggested in #125607 (comment).

Fixes: #125607
(cherry picked from commit 077b6b9)

# Conflicts:
#	modules/data-streams/build.gradle
#	modules/reindex/src/main/java/org/elasticsearch/reindex/Reindexer.java
ywangd pushed a commit to ywangd/elasticsearch that referenced this pull request May 9, 2025
…a time series data stream. (elastic#127824)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in elastic#125607.

I do not see a reason to not fix this as suggested in elastic#125607 (comment).

Fixes: elastic#125607
jfreden pushed a commit to jfreden/elasticsearch that referenced this pull request May 12, 2025
…a time series data stream. (elastic#127824)

During reindexing we retrieve the index mode from the template settings. However, we do not fully resolve the settings as we do when validating a template or when creating a data stream. This results on throwing the error reported in elastic#125607.

I do not see a reason to not fix this as suggested in elastic#125607 (comment).

Fixes: elastic#125607
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Automatically create backport pull requests when merged >bug :Data Management/Data streams Data streams and their lifecycles :StorageEngine/TSDB You know, for Metrics Team:Data Management Meta label for data/management team Team:StorageEngine v8.17.7 v8.18.2 v8.19.0 v9.0.2 v9.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[TSDS] Reindexing seems to ignore routing_path derived from mappings
3 participants