Move windows/security data stream back to system #728

fearful-symmetry · 2021-02-18T17:19:21Z

What does this PR do?

This fixes an issue introduced in #685, namely that the security data stream was introduced back into windows, duplicating it into two integrations. This moves the updated system integration from the above PR back into system. CC @leehinman

Checklist

I have reviewed tips for building integrations and this pull request is aligned with them.
I have verified that all data streams collect metrics or logs.
I have added an entry to my package's changelog.yml file.

elasticmachine · 2021-02-18T17:35:11Z

❕ Build Aborted

Either there was a build timeout or someone aborted the build.'}

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #728 updated
Start Time: 2021-02-19T16:54:37.720+0000
Duration: 122 min 50 sec
Commit: 7eff575

Test stats 🧪

Test	Results
Failed	0
Passed	36
Skipped	0
Total	36

Trends 🧪

Log output

Expand to view the last 100 lines of log output

[2021-02-19T17:01:28.871Z] Step 3/3 : COPY ${STACK_DIR}/development/ /packages/development
[2021-02-19T17:01:28.871Z]  ---> ae8e7fb58831
[2021-02-19T17:01:28.871Z] 
[2021-02-19T17:01:28.871Z] Successfully built ae8e7fb58831
[2021-02-19T17:01:28.871Z] Successfully tagged elastic-package-stack_package-registry:latest
[2021-02-19T17:01:28.871Z] 2021/02/19 17:01:28 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/gest-manager_integrations_PR-728/.elastic-package/stack/snapshot.yml -p elastic-package-stack up -d
[2021-02-19T17:01:29.444Z] Creating network "elastic-package-stack_default" with the default driver
[2021-02-19T17:01:29.444Z] Pulling elasticsearch (docker.elastic.co/elasticsearch/elasticsearch:7.12.0-SNAPSHOT)...
[2021-02-19T17:01:30.019Z] 7.12.0-SNAPSHOT: Pulling from elasticsearch/elasticsearch
[2021-02-19T17:01:42.408Z] Digest: sha256:8913a7234abdcc3350d694b57e7ece95641e1863378c7f1586186fef195fd958
[2021-02-19T17:01:42.408Z] Status: Downloaded newer image for docker.elastic.co/elasticsearch/elasticsearch:7.12.0-SNAPSHOT
[2021-02-19T17:01:42.408Z] Pulling elasticsearch_is_ready (tianon/true:)...
[2021-02-19T17:01:42.408Z] latest: Pulling from tianon/true
[2021-02-19T17:01:42.408Z] Digest: sha256:009cce421096698832595ce039aa13fa44327d96beedb84282a69d3dbcf5a81b
[2021-02-19T17:01:42.408Z] Status: Downloaded newer image for tianon/true:latest
[2021-02-19T17:01:42.408Z] Pulling kibana (docker.elastic.co/kibana/kibana:7.12.0-SNAPSHOT)...
[2021-02-19T17:01:42.408Z] 7.12.0-SNAPSHOT: Pulling from kibana/kibana
[2021-02-19T17:02:04.545Z] Digest: sha256:83dcdb6ae1c47b824d677a0d41c0d40ad6c8c5cacbd83f67d858ed17379c0efa
[2021-02-19T17:02:04.545Z] Status: Downloaded newer image for docker.elastic.co/kibana/kibana:7.12.0-SNAPSHOT
[2021-02-19T17:02:04.545Z] Pulling elastic-agent (docker.elastic.co/beats/elastic-agent:7.12.0-SNAPSHOT)...
[2021-02-19T17:02:04.545Z] 7.12.0-SNAPSHOT: Pulling from beats/elastic-agent
[2021-02-19T17:02:08.785Z] Digest: sha256:75c9fbf835a7d24166bceb82f28f4c6c5d00048ba9f0a25b945818e4cf2bba69
[2021-02-19T17:02:08.785Z] Status: Downloaded newer image for docker.elastic.co/beats/elastic-agent:7.12.0-SNAPSHOT
[2021-02-19T17:02:08.785Z] Creating elastic-package-stack_package-registry_1 ... 
[2021-02-19T17:02:08.785Z] Creating elastic-package-stack_elasticsearch_1    ... 
[2021-02-19T17:02:27.314Z] 
Creating elastic-package-stack_elasticsearch_1    ... done

Creating elastic-package-stack_package-registry_1 ... done
Creating elastic-package-stack_package-registry_is_ready_1 ... 
[2021-02-19T17:02:50.407Z] 
Creating elastic-package-stack_package-registry_is_ready_1 ... done
Creating elastic-package-stack_elasticsearch_is_ready_1    ... 
[2021-02-19T17:02:50.407Z] Creating elastic-package-stack_kibana_1                    ... 
[2021-02-19T17:03:10.641Z] 
Creating elastic-package-stack_elasticsearch_is_ready_1    ... done

Creating elastic-package-stack_kibana_1                    ... done
Creating elastic-package-stack_elastic-agent_1             ... 
[2021-02-19T17:03:10.641Z] Creating elastic-package-stack_kibana_is_ready_1           ... 
[2021-02-19T17:03:37.243Z] 
Creating elastic-package-stack_kibana_is_ready_1           ... done

Creating elastic-package-stack_elastic-agent_1             ... done
Creating elastic-package-stack_elastic-agent_is_ready_1    ... 
[2021-02-19T17:03:37.243Z] 
Creating elastic-package-stack_elastic-agent_is_ready_1    ... done
Done
[2021-02-19T17:03:37.553Z] + egrep _dev/deploy/k8s$
[2021-02-19T17:03:37.553Z] + find . -type d
[2021-02-19T17:03:37.832Z] [INFO] getVaultSecret: Getting secrets
[2021-02-19T17:03:37.915Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-02-19T17:03:38.643Z] + ../../build/elastic-package stack shellinit
[2021-02-19T17:03:39.356Z] + eval export ELASTIC_PACKAGE_ELASTICSEARCH_HOST=http://127.0.0.1:9200
[2021-02-19T17:03:39.356Z] export ELASTIC_PACKAGE_ELASTICSEARCH_USERNAME=elastic
[2021-02-19T17:03:39.356Z] export ELASTIC_PACKAGE_ELASTICSEARCH_PASSWORD=changeme
[2021-02-19T17:03:39.356Z] export ELASTIC_PACKAGE_KIBANA_HOST=http://127.0.0.1:5601
[2021-02-19T17:03:39.357Z] + export ELASTIC_PACKAGE_ELASTICSEARCH_HOST=http://127.0.0.1:9200
[2021-02-19T17:03:39.357Z] + export ELASTIC_PACKAGE_ELASTICSEARCH_USERNAME=elastic
[2021-02-19T17:03:39.357Z] + export ELASTIC_PACKAGE_ELASTICSEARCH_PASSWORD=changeme
[2021-02-19T17:03:39.357Z] + export ELASTIC_PACKAGE_KIBANA_HOST=http://127.0.0.1:5601
[2021-02-19T17:03:39.357Z] + ../../build/elastic-package test -v --report-format xUnit --report-output file
[2021-02-19T17:03:39.357Z] 2021/02/19 17:03:39 DEBUG Enable verbose logging
[2021-02-19T17:03:39.357Z] Run test suite for the package
[2021-02-19T17:03:39.357Z] Run asset tests for the package
[2021-02-19T17:03:39.357Z] 2021/02/19 17:03:39 DEBUG installing package...
[2021-02-19T17:03:39.357Z] 2021/02/19 17:03:39 DEBUG POST http://127.0.0.1:5601/api/fleet/epm/packages/windows-0.4.2
[2021-02-19T17:03:47.491Z] Run pipeline tests for the package
[2021-02-19T17:03:47.491Z] Run system tests for the package
[2021-02-19T17:03:47.558Z] Running in /var/lib/jenkins/workspace/gest-manager_integrations_PR-728/src/github.com/elastic/integrations
[2021-02-19T17:03:47.577Z] Archiving artifacts
[2021-02-19T17:03:47.615Z] Recording test results
[2021-02-19T17:03:48.363Z] [Checks API] No suitable checks publisher found.
[2021-02-19T17:03:48.690Z] + build/elastic-package stack dump -v --output build/elastic-stack-dump/windows
[2021-02-19T17:03:48.690Z] 2021/02/19 17:03:48 DEBUG Enable verbose logging
[2021-02-19T17:03:48.690Z] 2021/02/19 17:03:48 DEBUG Dump Elastic stack data
[2021-02-19T17:03:48.690Z] 2021/02/19 17:03:48 DEBUG Dump stack logs
[2021-02-19T17:03:48.690Z] 2021/02/19 17:03:48 DEBUG Recreate the output location (path: build/elastic-stack-dump/windows)
[2021-02-19T17:03:48.690Z] 2021/02/19 17:03:48 DEBUG Dump stack logs for elasticsearch
[2021-02-19T17:03:48.690Z] 2021/02/19 17:03:48 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/gest-manager_integrations_PR-728/.elastic-package/stack/snapshot.yml -p elastic-package-stack logs elasticsearch
[2021-02-19T17:03:50.099Z] 2021/02/19 17:03:49 DEBUG Dump stack logs for elastic-agent
[2021-02-19T17:03:50.099Z] 2021/02/19 17:03:49 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/gest-manager_integrations_PR-728/.elastic-package/stack/snapshot.yml -p elastic-package-stack logs elastic-agent
[2021-02-19T17:03:51.481Z] 2021/02/19 17:03:51 DEBUG Dump stack logs for kibana
[2021-02-19T17:03:51.481Z] 2021/02/19 17:03:51 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/gest-manager_integrations_PR-728/.elastic-package/stack/snapshot.yml -p elastic-package-stack logs kibana
[2021-02-19T17:03:52.863Z] 2021/02/19 17:03:52 DEBUG Dump stack logs for package-registry
[2021-02-19T17:03:52.863Z] 2021/02/19 17:03:52 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/gest-manager_integrations_PR-728/.elastic-package/stack/snapshot.yml -p elastic-package-stack logs package-registry
[2021-02-19T17:03:53.437Z] Path to stack dump: build/elastic-stack-dump/windows
[2021-02-19T17:03:53.437Z] Done
[2021-02-19T17:03:53.454Z] Archiving artifacts
[2021-02-19T17:03:53.783Z] + build/elastic-package stack down -v
[2021-02-19T17:03:53.783Z] 2021/02/19 17:03:53 DEBUG Enable verbose logging
[2021-02-19T17:03:53.783Z] Take down the Elastic stack
[2021-02-19T17:03:53.783Z] 2021/02/19 17:03:53 DEBUG running command: /usr/local/bin/docker-compose -f /var/lib/jenkins/workspace/gest-manager_integrations_PR-728/.elastic-package/stack/snapshot.yml -p elastic-package-stack down
[2021-02-19T17:03:54.354Z] Stopping elastic-package-stack_elastic-agent_1    ... 
[2021-02-19T17:03:54.354Z] Stopping elastic-package-stack_kibana_1           ... 
[2021-02-19T17:03:54.354Z] Stopping elastic-package-stack_elasticsearch_1    ... 
[2021-02-19T17:03:54.354Z] Stopping elastic-package-stack_package-registry_1 ... 
[2021-02-19T17:03:56.385Z] 
Stopping elastic-package-stack_elastic-agent_1    ... done

Stopping elastic-package-stack_kibana_1           ... done

Stopping elastic-package-stack_package-registry_1 ... done

Stopping elastic-package-stack_elasticsearch_1    ... done
Removing elastic-package-stack_elastic-agent_is_ready_1    ... 
[2021-02-19T17:03:56.385Z] Removing elastic-package-stack_kibana_is_ready_1           ... 
[2021-02-19T17:03:56.385Z] Removing elastic-package-stack_elastic-agent_1             ... 
[2021-02-19T17:03:56.385Z] Removing elastic-package-stack_kibana_1                    ... 
[2021-02-19T17:03:56.385Z] Removing elastic-package-stack_elasticsearch_is_ready_1    ... 
[2021-02-19T17:03:56.385Z] Removing elastic-package-stack_package-registry_is_ready_1 ... 
[2021-02-19T17:03:56.385Z] Removing elastic-package-stack_elasticsearch_1             ... 
[2021-02-19T17:03:56.385Z] Removing elastic-package-stack_package-registry_1          ... 
[2021-02-19T17:03:56.645Z] 
Removing elastic-package-stack_package-registry_is_ready_1 ... done

Removing elastic-package-stack_elasticsearch_is_ready_1    ... done

Removing elastic-package-stack_package-registry_1          ... done

Removing elastic-package-stack_kibana_is_ready_1           ... done

Removing elastic-package-stack_elastic-agent_is_ready_1    ... done

Removing elastic-package-stack_kibana_1                    ... done

Removing elastic-package-stack_elasticsearch_1             ... done

Removing elastic-package-stack_elastic-agent_1             ... done
Removing network elastic-package-stack_default
[2021-02-19T17:03:56.904Z] Done
[2021-02-19T18:56:26.773Z] Cancelling nested steps due to timeout
[2021-02-19T18:56:26.780Z] Failed in branch system
[2021-02-19T18:56:26.826Z] Stage "Update Package Storage" skipped due to earlier failure(s)
[2021-02-19T18:56:27.399Z] Running on Jenkins in /var/lib/jenkins/workspace/gest-manager_integrations_PR-728
[2021-02-19T18:56:27.426Z] [INFO] getVaultSecret: Getting secrets
[2021-02-19T18:56:27.505Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-02-19T18:56:28.465Z] + chmod 755 generate-build-data.sh
[2021-02-19T18:56:28.465Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-728/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-728/runs/3 ABORTED 7310483
[2021-02-19T18:56:29.015Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Ingest-manager/integrations/PR-728/runs/3/steps/?limit=10000 -o steps-info.json

elasticmachine · 2021-02-18T17:53:37Z

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

elasticmachine · 2021-02-18T17:53:37Z

Pinging @elastic/integrations (Team:Integrations)

packages/system/changelog.yml

packages/windows/changelog.yml

…dedup

move security integration to system

1a854c3

fearful-symmetry added bug Something isn't working, use only for issues enhancement New feature or request labels Feb 18, 2021

fearful-symmetry requested review from ycombinator, mtojek and marc-gr February 18, 2021 17:19

fearful-symmetry self-assigned this Feb 18, 2021

andresrc added Team:Integrations Label for the Integrations team Team:Security-External Integrations labels Feb 18, 2021

marc-gr reviewed Feb 19, 2021

View reviewed changes

packages/system/changelog.yml Outdated Show resolved Hide resolved

packages/system/changelog.yml Outdated Show resolved Hide resolved

packages/windows/changelog.yml Show resolved Hide resolved

fearful-symmetry added 3 commits February 19, 2021 08:53

Merge remote-tracking branch 'upstream/master' into windows-security-…

cc00fdf

…dedup

fix changelog

7eff575

fix comment

6bf1899

fearful-symmetry requested a review from marc-gr February 19, 2021 18:56

marc-gr approved these changes Feb 22, 2021

View reviewed changes

fearful-symmetry merged commit 291674b into elastic:master Feb 22, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Move windows/security data stream back to system #728

Move windows/security data stream back to system #728

Uh oh!

fearful-symmetry commented Feb 18, 2021

Uh oh!

elasticmachine commented Feb 18, 2021 •

edited

Loading

Build stats

Test stats 🧪

Trends 🧪

Uh oh!

elasticmachine commented Feb 18, 2021

Uh oh!

elasticmachine commented Feb 18, 2021

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Move windows/security data stream back to system #728

Move windows/security data stream back to system #728

Uh oh!

Conversation

fearful-symmetry commented Feb 18, 2021

What does this PR do?

Checklist

Uh oh!

elasticmachine commented Feb 18, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

❕ Build Aborted

Build stats

Test stats 🧪

Trends 🧪

Log output

Uh oh!

elasticmachine commented Feb 18, 2021

Uh oh!

elasticmachine commented Feb 18, 2021

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

elasticmachine commented Feb 18, 2021 •

edited

Loading