[Demo session] 관리형 Kafka 서비스 - Oracle Event Hub Service
1 like984 views
오라클 클라우드에서는 카프카를 관리형 서비스로 제공합니다. 밋업 세션에서는 관리형 카프카 서비스의 편의성을 소개하고 카프카 서비스의 데모를 진행합니다. 또한 MSA, 빅데이터 및 Blockchain의 인프라로 카프카가 핵심 위치를 갖는 것 뿐만 아니라 오라클 클라우드의 통합 핵심 컴포넌트로 카프카는 중요한 의미를 갖습니다. 오라클 클라우드의 통합 컴포넌트로 카프카의 역할과 주요 서비스의 구성을 소개합니다. * 본 세션은 “입문자/초급자/중급자” 분들께 두루 적합한 세션입니다.
![20
2018. 5. 17 오전 11시 35분 33초 UTC Activity Submitted
2018. 5. 17 오전 11시 35분 33초 UTC Activity Started
2018. 5. 17 오전 11시 35분 33초 UTC Started operation to create service [demokafka] in identity domain [idcs-c69311285cdb4062b8455d9a1fcb18c8].
2018. 5. 17 오전 11시 42분 32초 UTC Completed creating service [demokafka] resources in domain [idcs-c69311285cdb4062b8455d9a1fcb18c8].
2018. 5. 17 오전 11시 42분 37초 UTC Started operation to establish security on VMs for component [connect].
2018. 5. 17 오전 11시 42분 38초 UTC Started operation to establish security on VMs for component [restprxy].
2018. 5. 17 오전 11시 42분 38초 UTC Completed operation to establish security on VMs for component [restprxy]
2018. 5. 17 오전 11시 42분 47초 UTC Started operation to establish security on VMs for component [kafka].
2018. 5. 17 오전 11시 42분 48초 UTC Started operation to check provisioning status on the VMs for [kafka]
2018. 5. 17 오전 11시 42분 48초 UTC Started operation to check provisioning status on the VMs for [restprxy]
2018. 5. 17 오전 11시 42분 48초 UTC Started operation to check provisioning status on the VMs for [connect]
2018. 5. 17 오전 11시 44분 00초 UTC Provisioning of component [restprxy] succeeded.
2018. 5. 17 오전 11시 44분 00초 UTC Provisioning of component [kafka] succeeded.
2018. 5. 17 오전 11시 44분 00초 UTC Provisioning of component [connect] succeeded.
2018. 5. 17 오전 11시 44분 00초 UTC Started service reachability check operation for [restprxy].
2018. 5. 17 오전 11시 44분 00초 UTC Started service reachability check operation for [kafka].
2018. 5. 17 오전 11시 44분 00초 UTC Started service reachability check operation for [connect].
2018. 5. 17 오전 11시 44분 07초 UTC Successfully reached demokafka-connect-1 at port 8083. Successfully reached demokafka-connect-1 at port 1080.
2018. 5. 17 오전 11시 44분 07초 UTC Successfully completed service reachability check for [connect]
EHCS 인스턴스 생성 로그:
5 node, 11분 소요](https://image.slidesharecdn.com/oraclouddevmeetupeventhubpublic-180521084803/85/Demo-session-Kafka-Oracle-Event-Hub-Service-20-320.jpg)
![40
Oracle PaaS Service Manager
$ sudo -H psm oehpcs help
DESCRIPTION
Oracle Event Hub Cloud Service - Dedicated
SYNOPSIS
psm OEHPCS <command> [parameters]
AVAILABLE COMMANDS
o services o service
o create-serviceo delete-service
o restart-service o scale-out
o stop o start
o restart o add-storage
o scale o available-patches
o applied-patches
o patch o precheck-patch
o rollback
o check-health
o operation-status o activities
o access-rules o create-access-rule
o delete-access-rule o enable-access-rule
o disable-access-rule o add-ssh-public-key
o help](https://image.slidesharecdn.com/oraclouddevmeetupeventhubpublic-180521084803/85/Demo-session-Kafka-Oracle-Event-Hub-Service-40-320.jpg)
More Related Content
What's hot (20)
Similar to [Demo session] 관리형 Kafka 서비스 - Oracle Event Hub Service (20)
More from Oracle Korea (20)
![[Main Session] 카프카, 데이터 플랫폼의 최강자](https://cdn.slidesharecdn.com/ss_thumbnails/180519-kafka-oraclefin-180521125323-thumbnail.jpg?width=560&fit=bounds)
![[Hands-on] CQRS(Command Query Responsibility Segregation) 와 Event Sourcing 패턴 실습](https://cdn.slidesharecdn.com/ss_thumbnails/cqrsesv201804221730publish-180422082848-180423040836-thumbnail.jpg?width=560&fit=bounds)
Recently uploaded (20)
[Demo session] 관리형 Kafka 서비스 - Oracle Event Hub Service
- 3. 3 About: Me • 1999 ~ 2006 Java (SI, Developer) • 2007 ~ 2013 Middleware (Oracle, SC) – WAS, Memory Cache, CEP, DB Replication • 2013 ~ 2014 NoSQL, CouchDB (SE) • 2015 ~ Big Data, ML, Deep Learning(SC) 민수 수학 Analysis 컨텐츠
- 4. 4 Compute Networking Storage Load Balancing Edge Services Container Container Pipline FastConnect Ravello Compute Classic Networking Classic Storage Classic Infrastructure Service Platform Service Database Database Backup Big Data Big Data Cloud Event Hub MySQL Autonomous NoSQL Database Cloud Data Hub Autonomous Data Warehouse Cloud Data Management Application Development Java Application Container Mobile and Chatbots Autonomous Visual Builder Cloud AI Platform Blockchain Developer Messaging API Catalog Autonomous Integration Cloud Oracle Integration Cloud Data Integration Internet of Things API Management Self-Service Integration Self-Service Integration SOA Integration Process Automation Application Performance Monitoring Infrastructure Monitoring Log Analytics Orchestration IT Analytics Management Content and Experience Content and Experience WebCenter Portal Cloud DIVA Cloud Business Analytics Autonomous Analytics Cloud Analytics Cloud Business Intelligence Data Visualization Essbase Security CASB Identity Configuration and Compliance Security Monitoring and Analytics
- 5. 5 Compute Networking Storage Load Balancing Edge Services Container Container Pipline FastConnect Ravello Compute Classic Networking Classic Storage Classic Infrastructure Service Platform Service Database Database Backup Big Data Big Data Cloud Event Hub MySQL Autonomous NoSQL Database Cloud Data Hub Autonomous Data Warehouse Cloud Data Management Application Development Java Application Container Mobile and Chatbots Autonomous Visual Builder Cloud AI Platform Blockchain Developer Messaging API Catalog Autonomous Integration Cloud Oracle Integration Cloud Data Integration Internet of Things API Management Self-Service Integration Self-Service Integration SOA Integration Process Automation Application Performance Monitoring Infrastructure Monitoring Log Analytics Orchestration IT Analytics Management Content and Experience Content and Experience WebCenter Portal Cloud DIVA Cloud Business Analytics Autonomous Analytics Cloud Analytics Cloud Business Intelligence Data Visualization Essbase Security CASB Identity Configuration and Compliance Security Monitoring and Analytics
- 6. 6 Compute Networking Storage Load Balancing Edge Services Container Container Pipline FastConnect Ravello Compute Classic Networking Classic Storage Classic Infrastructure Service Platform Service Database Database Backup Big Data Big Data Cloud Event Hub MySQL Autonomous NoSQL Database Cloud Data Hub Autonomous Data Warehouse Cloud Data Management Application Development Java Application Container Mobile and Chatbots Autonomous Visual Builder Cloud AI Platform Blockchain Developer Messaging API Catalog Autonomous Integration Cloud Oracle Integration Cloud Data Integration Internet of Things API Management Self-Service Integration Self-Service Integration SOA Integration Process Automation Application Performance Monitoring Infrastructure Monitoring Log Analytics Orchestration IT Analytics Management Content and Experience Content and Experience WebCenter Portal Cloud DIVA Cloud Business Analytics Autonomous Analytics Cloud Analytics Cloud Business Intelligence Data Visualization Essbase Security CASB Identity Configuration and Compliance Security Monitoring and Analytics
- 13. 13 나의 아저씨
- 16. 16 In Oracle Cloud Self Managed Platform Managed Apache Kafka on IAAS Compute Event Hub Cloud Service (Dedicated) Event Hub Cloud Service (Topics) $0.06 OCPU/hour (69원) $0.27 OCPU/hour (290원)
- 18. 18
- 19. 19
- 20. 20 2018. 5. 17 오전 11시 35분 33초 UTC Activity Submitted 2018. 5. 17 오전 11시 35분 33초 UTC Activity Started 2018. 5. 17 오전 11시 35분 33초 UTC Started operation to create service [demokafka] in identity domain [idcs-c69311285cdb4062b8455d9a1fcb18c8]. 2018. 5. 17 오전 11시 42분 32초 UTC Completed creating service [demokafka] resources in domain [idcs-c69311285cdb4062b8455d9a1fcb18c8]. 2018. 5. 17 오전 11시 42분 37초 UTC Started operation to establish security on VMs for component [connect]. 2018. 5. 17 오전 11시 42분 38초 UTC Started operation to establish security on VMs for component [restprxy]. 2018. 5. 17 오전 11시 42분 38초 UTC Completed operation to establish security on VMs for component [restprxy] 2018. 5. 17 오전 11시 42분 47초 UTC Started operation to establish security on VMs for component [kafka]. 2018. 5. 17 오전 11시 42분 48초 UTC Started operation to check provisioning status on the VMs for [kafka] 2018. 5. 17 오전 11시 42분 48초 UTC Started operation to check provisioning status on the VMs for [restprxy] 2018. 5. 17 오전 11시 42분 48초 UTC Started operation to check provisioning status on the VMs for [connect] 2018. 5. 17 오전 11시 44분 00초 UTC Provisioning of component [restprxy] succeeded. 2018. 5. 17 오전 11시 44분 00초 UTC Provisioning of component [kafka] succeeded. 2018. 5. 17 오전 11시 44분 00초 UTC Provisioning of component [connect] succeeded. 2018. 5. 17 오전 11시 44분 00초 UTC Started service reachability check operation for [restprxy]. 2018. 5. 17 오전 11시 44분 00초 UTC Started service reachability check operation for [kafka]. 2018. 5. 17 오전 11시 44분 00초 UTC Started service reachability check operation for [connect]. 2018. 5. 17 오전 11시 44분 07초 UTC Successfully reached demokafka-connect-1 at port 8083. Successfully reached demokafka-connect-1 at port 1080. 2018. 5. 17 오전 11시 44분 07초 UTC Successfully completed service reachability check for [connect] EHCS 인스턴스 생성 로그: 5 node, 11분 소요
- 21. 21
- 23. 23 OEHCS 클러스터| REST Proxy REST Proxy AVRO Registry Monitoring App REST Proxy AVRO Registry Monitoring App REST Proxy AVRO Registry Monitoring App User 1080 Kafka brokers Kafka brokersKafka brokers • 포트 외부 오픈 • Zookeeper 2181 & JMX: 9098 • Kafka 6667 & JMX: 9097 Zookeeper Zookeeper Zookeeper Nimbula Sec List - Kafka 6667
- 24. 24
- 27. 27
- 28. 28
- 35. 35
- 38. 38 Oracle PaaS Service Manager Oracle Cloud Infrastructure REST API PaaS PaaS PaaS PaaS PaaS PaaS PaaS PaaS PaaS PaaS PaaS REST API REST API REST API REST API REST API REST API REST API REST API REST API REST API REST API OCI CLI Compute Network Storage DNS Load Balancing Security Web UI Chef Terraform Ansible PaaS Service Manager(PSM) Oracle PaaS Service Manager 소개 및 설치: http://taewan.kim/post/installing_pms/
- 40. 40 Oracle PaaS Service Manager $ sudo -H psm oehpcs help DESCRIPTION Oracle Event Hub Cloud Service - Dedicated SYNOPSIS psm OEHPCS <command> [parameters] AVAILABLE COMMANDS o services o service o create-serviceo delete-service o restart-service o scale-out o stop o start o restart o add-storage o scale o available-patches o applied-patches o patch o precheck-patch o rollback o check-health o operation-status o activities o access-rules o create-access-rule o delete-access-rule o enable-access-rule o disable-access-rule o add-ssh-public-key o help
- 44. 44 https://www.confluent.io/product/connectors/ - Scalable Framework - Open Source - Only Configuration
- 47. 47 OEHCS의 Kafka Connector 지원 – OCI Object Storage
- 48. 48 OEHCS의 Kafka Connector 지원 – JDBC Sink
- 49. 49 OEHCS Roadmap - Connector - Sink - Oracle DataHub: Cassandra - Apache Hbase - S3 - Elastic Search - Source - Twitter - Management - Auto Scale-out - Multi Datacenter - Audit - Disk Storage 암호화 - PCI 인준
- 52. 52 Oracle Integrations Confidential – Oracle 5 Oracle Application Container Cloud ServiceOracle Storage Cloud Service Oracle Database Cloud Service Oracle Java Cloud Service Oracle Golden Gate Cloud Service Oracle Big Data Cloud - CE Oracle IOT Cloud Service Oracle Integration Cloud Service Oracle Analytics Cloud Service
- 53. 53 Oracle Cloud – Data Lake Storage Cloud Service (Data Lake) Web Crawler Spark Streaming Event hub GPU Deep Learning Identity Domain • Upload CLI • OSACS (비동기 복제) BigData Connector SDK REST API Library IaaS Computing Data Processing Machine Learning ADWC OAC IaaS Computing On-Premise Server Oracle Software Appliance Cloud Service Visualization
- 54. 54 Oracle Trial http://taewan.kim/post/oracle_cloud_trial/
- 55. 55 실습 가이드 • Eventhub 소개 – http://taewan.kim/post/kafka_paas_eve nthub_cs/ • Eventhub – https://github.com/oracle/learning- library/blob/master/workshops/journey 2-new-data-lake/LabGuide400.md • Eventhub + Spark Streaming – https://github.com/oracle/learning- library/blob/master/workshops/journey 2-new-data-lake/LabGuide500.md
- 56. 56