From 99144a9c8591935749cda4609283937eeb799d26 Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Wed, 3 Oct 2018 15:16:22 +0300 Subject: [PATCH 01/12] Research-educational_topics basic proposal --- Research-educational_topics/Engineering_topics.md | 7 +++++++ Research-educational_topics/Management_topics.md | 5 +++++ 2 files changed, 12 insertions(+) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index 2154ddd..4063bd8 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -1,7 +1,14 @@ ## Associate +- Transition from DevOps to DevSecOps culture ## Basic +- Infrastructure as Code (example: Terraform) +- Identity and Access Management (example: Keycloak) +- Data visualisation implementations (example: Grafana) ## Professional +- Private cloud platforms (example: OpenStack) +- From batch to stream processing (examples: Lightbend Fast Data Platform, HDP (Hortonworks Data Platform) +and HDF (Hortonworks Data flow) ## Expert \ No newline at end of file diff --git a/Research-educational_topics/Management_topics.md b/Research-educational_topics/Management_topics.md index 2154ddd..acaa27b 100644 --- a/Research-educational_topics/Management_topics.md +++ b/Research-educational_topics/Management_topics.md @@ -1,7 +1,12 @@ ## Associate +- Client-centric approach ## Basic +- Business process +- KPI ## Professional +- Gamification +- People operations ## Expert \ No newline at end of file From eac8a747743e195b857eeac1c0664faede77b151 Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Mon, 22 Oct 2018 10:40:46 +0300 Subject: [PATCH 02/12] improve list add topics https://www.lightbend.com/certified-reactive-architect?sbrc=1CpVfb5AacNJmX_knrlKXwA%3D%3D%24eCg_mR768w5uhdt8s6_sgQ%3D%3D --- .../Engineering_topics.md | 27 ++++++++++++++++--- 1 file changed, 24 insertions(+), 3 deletions(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index 4063bd8..ccd0bf0 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -1,14 +1,35 @@ ## Associate +- Domain-Driven Design +- Scalability, Resilience, Consistency models +- Delivery guarantees - Transition from DevOps to DevSecOps culture ## Basic +- Distributed Systems Design +- Event-Sourcing, CQRS +- The Actor model +- Microservice systems - Infrastructure as Code (example: Terraform) - Identity and Access Management (example: Keycloak) - Data visualisation implementations (example: Grafana) - -## Professional - Private cloud platforms (example: OpenStack) - From batch to stream processing (examples: Lightbend Fast Data Platform, HDP (Hortonworks Data Platform) and HDF (Hortonworks Data flow) -## Expert \ No newline at end of file +## Professional +- CAP theorem (and more) +- SOLID design principles, hexagonal and onion architecture +- Kubernetes-native Management of Akka-based Applications +- Fast Data Platform (Lightbend) +- Reactive Production Tooling + +- Running in Multiple Zones - Kubernetes +- Running in Multiple Zones - OpenStack +- Running in Multiple Zones - Hadoop framework + +## Expert +- CRDTs, the Saga pattern +- Asynchronous, non-blocking designs +- Lightbend Enterprise Suite +- Lightbend Telemetry +- Lightbend Console From 7bb6a15a6bb27fdb2d6ee45d1c104ee59bf3941c Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Mon, 22 Oct 2018 10:41:16 +0300 Subject: [PATCH 03/12] Update Engineering_topics.md --- Research-educational_topics/Engineering_topics.md | 1 - 1 file changed, 1 deletion(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index ccd0bf0..fa0b4ac 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -22,7 +22,6 @@ and HDF (Hortonworks Data flow) - Kubernetes-native Management of Akka-based Applications - Fast Data Platform (Lightbend) - Reactive Production Tooling - - Running in Multiple Zones - Kubernetes - Running in Multiple Zones - OpenStack - Running in Multiple Zones - Hadoop framework From ce2ddc8f9595764a12ed7805de9ac2dcdf0072b9 Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Mon, 22 Oct 2018 10:51:05 +0300 Subject: [PATCH 04/12] Update Engineering_topics.md --- Research-educational_topics/Engineering_topics.md | 12 +++++++++--- 1 file changed, 9 insertions(+), 3 deletions(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index fa0b4ac..6407f44 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -1,10 +1,16 @@ ## Associate -- Domain-Driven Design -- Scalability, Resilience, Consistency models -- Delivery guarantees + +- Collections and Functional Programming Basics +- Inheritance and Traits +- Pattern Matching +- Dealing with Optional Values - Transition from DevOps to DevSecOps culture +- Continus Integration/Delivery/Monitoring concepts ## Basic +- Domain-Driven Design +- Scalability, Resilience, Consistency models +- Delivery guarantees - Distributed Systems Design - Event-Sourcing, CQRS - The Actor model From a11a67c7e9ab26d0e533210bb227c3e1a486e1ff Mon Sep 17 00:00:00 2001 From: Yuriy Drohobitskyy Date: Tue, 23 Oct 2018 17:52:19 +0300 Subject: [PATCH 05/12] Update Engineering_topics.md Proposals for Associate and Basic levels --- .../Engineering_topics.md | 24 ++++++++++++++++--- 1 file changed, 21 insertions(+), 3 deletions(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index 6407f44..1c6c359 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -1,13 +1,31 @@ ## Associate -- Collections and Functional Programming Basics -- Inheritance and Traits +- Functional Programming fundamentals +- OOP and OOD principals +- Design patterns + +Scala: +- Type system +- Collections +- Implicits +- Futures and Promises +- sbt basics - Pattern Matching -- Dealing with Optional Values +- Options and Eithers + +- Docker containers managment +- DB SQL and NoSQL data modeling and quering +- Big Data processing principals + - Transition from DevOps to DevSecOps culture - Continus Integration/Delivery/Monitoring concepts ## Basic +- Streaming data processing +- Cloud platforms and services (Google, AWS etc), PaaS, SaaS, IaaS +- ORM systems comparison +- Message brokers +- Scala JS - Domain-Driven Design - Scalability, Resilience, Consistency models - Delivery guarantees From e6c9b05ed43fba0d60c1f54212e6f60e1a88468c Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Tue, 23 Oct 2018 21:44:48 +0300 Subject: [PATCH 06/12] fix list --- Research-educational_topics/Engineering_topics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index 1c6c359..9649c27 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -4,7 +4,7 @@ - OOP and OOD principals - Design patterns -Scala: +### Scala: - Type system - Collections - Implicits From 38a0aac4eb3edab3d6dee576c4b3c8d7a9419e12 Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Tue, 23 Oct 2018 21:46:15 +0300 Subject: [PATCH 07/12] fix list --- .../Engineering_topics.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index 9649c27..b3d5593 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -4,14 +4,14 @@ - OOP and OOD principals - Design patterns -### Scala: -- Type system -- Collections -- Implicits -- Futures and Promises -- sbt basics -- Pattern Matching -- Options and Eithers +- Scala: + - Type system + - Collections + - Implicits + - Futures and Promises + - sbt basics + - Pattern Matching + - Options and Eithers - Docker containers managment - DB SQL and NoSQL data modeling and quering From 3dca9070d9dc1218c38453387e0eea81676fbff9 Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Wed, 24 Oct 2018 10:18:24 +0300 Subject: [PATCH 08/12] add data application topics --- Research-educational_topics/Engineering_topics.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index b3d5593..22fd030 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -46,6 +46,8 @@ and HDF (Hortonworks Data flow) - Kubernetes-native Management of Akka-based Applications - Fast Data Platform (Lightbend) - Reactive Production Tooling +- The Emerging Architecture for Modern Data Applications +- Design of a Cost Efficient Time Series Store for Big Data - Running in Multiple Zones - Kubernetes - Running in Multiple Zones - OpenStack - Running in Multiple Zones - Hadoop framework From 74abdda325d6ba6180c8764947ff2b0e69180f54 Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Wed, 24 Oct 2018 12:53:31 +0300 Subject: [PATCH 09/12] update --- Research-educational_topics/Engineering_topics.md | 1 + 1 file changed, 1 insertion(+) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index 22fd030..aeb8f41 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -46,6 +46,7 @@ and HDF (Hortonworks Data flow) - Kubernetes-native Management of Akka-based Applications - Fast Data Platform (Lightbend) - Reactive Production Tooling +- Connect, secure, control, and observe services. https://istio.io - The Emerging Architecture for Modern Data Applications - Design of a Cost Efficient Time Series Store for Big Data - Running in Multiple Zones - Kubernetes From 3eb0a259f810a42ff824c54a5c91ca5ea8145c7e Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Sat, 3 Nov 2018 13:18:13 +0200 Subject: [PATCH 10/12] data wrangling --- Research-educational_topics/Engineering_topics.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index aeb8f41..291afa4 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -13,10 +13,13 @@ - Pattern Matching - Options and Eithers -- Docker containers managment + - DB SQL and NoSQL data modeling and quering - Big Data processing principals +- Data wrangling tools review ([Trifacta](https://www.trifacta.com/),[OpenRefine](https://github.com/OpenRefine/OpenRefine), etc.) +### DevOps +- Docker containers managment - Transition from DevOps to DevSecOps culture - Continus Integration/Delivery/Monitoring concepts From 861a4b70ae63a90531b138475a64eb3cd20d22ea Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Sat, 3 Nov 2018 13:30:53 +0200 Subject: [PATCH 11/12] Udate Data Engineering --- Research-educational_topics/Engineering_topics.md | 15 ++++++++++++--- 1 file changed, 12 insertions(+), 3 deletions(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index 291afa4..168cb3a 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -13,10 +13,11 @@ - Pattern Matching - Options and Eithers - +### Data Engineering - DB SQL and NoSQL data modeling and quering - Big Data processing principals - Data wrangling tools review ([Trifacta](https://www.trifacta.com/),[OpenRefine](https://github.com/OpenRefine/OpenRefine), etc.) +- Business intelligence tools review ([Talend Data Preparation](https://www.talend.com/products/data-preparation/data-preparation-free-desktop/), [Google Data Studion](https://marketingplatform.google.com/about/data-studio/), ### DevOps - Docker containers managment @@ -36,12 +37,20 @@ - Event-Sourcing, CQRS - The Actor model - Microservice systems + +### Data Engineering +- From batch to stream processing (examples: Lightbend Fast Data Platform, HDP (Hortonworks Data Platform) +and HDF (Hortonworks Data flow) +- Review Analytics and machine learning platforms ([Google Cloud Dataflow ](https://cloud.google.com/dataflow/), [AWS Data Pipeline](https://aws.amazon.com/datapipeline/) etc.) + +### DevOps - Infrastructure as Code (example: Terraform) - Identity and Access Management (example: Keycloak) - Data visualisation implementations (example: Grafana) - Private cloud platforms (example: OpenStack) -- From batch to stream processing (examples: Lightbend Fast Data Platform, HDP (Hortonworks Data Platform) -and HDF (Hortonworks Data flow) +- Domain name, SSL expiration date resource monitorring and handling automation. +- Application availability monitoring and handling. + ## Professional - CAP theorem (and more) From 7a6746ebbd3b9a11d9ed1066b9185410981ecc4d Mon Sep 17 00:00:00 2001 From: Vitaly Brevus Date: Sat, 3 Nov 2018 13:32:02 +0200 Subject: [PATCH 12/12] fix description --- Research-educational_topics/Engineering_topics.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/Research-educational_topics/Engineering_topics.md b/Research-educational_topics/Engineering_topics.md index 168cb3a..d1e3031 100644 --- a/Research-educational_topics/Engineering_topics.md +++ b/Research-educational_topics/Engineering_topics.md @@ -17,7 +17,7 @@ - DB SQL and NoSQL data modeling and quering - Big Data processing principals - Data wrangling tools review ([Trifacta](https://www.trifacta.com/),[OpenRefine](https://github.com/OpenRefine/OpenRefine), etc.) -- Business intelligence tools review ([Talend Data Preparation](https://www.talend.com/products/data-preparation/data-preparation-free-desktop/), [Google Data Studion](https://marketingplatform.google.com/about/data-studio/), +- Business intelligence tools review ([Talend Data Preparation](https://www.talend.com/products/data-preparation/data-preparation-free-desktop/), [Google Data Studio](https://marketingplatform.google.com/about/data-studio/), etc.) ### DevOps - Docker containers managment