Apache Spark and Scala Professional Role Based Training.pdf - Google

Apache Spark and Scala Professional Competency Development Program We focus on delivering Role-Specific training rather than Product based Training

Apache Spark and Scala Role Based Training Course Duration: 25 Hours

Timings: Weekdays & Weekends Mode of Training: Online

C L

How Are We Different?  We just don’t teach Apache Spark and Scala Concepts but we share our real-time implementation experiences to get the audiences ready to face customers and Implement Solutions.  We don’t make Apache Spark and Scala but we make them Complete & Full-fledged Apache Spark and Scala by training them on Development, Administration & Application Design with Project based real-time scenarios and several Case Studies for practice  Our faculties are not just technical developers or trainers; they are industry experts and consultants for fortune 500 companies who are highly capable of understanding the business and know how technology can be closely connected with people and business.  Our Role-Specific training differs from any other training company in the world.

h c

L

e T

Training Highlights: Benefits:  25 hours Instructor Led Live Online Training  Quality Course Material & E-books  Focus on Hands on training with lot of  24 x 7 online access to trainers assignments, practice exercises and quizzes for Doubts Clarification.  Assignments, Video recordings after each session  Project based training with hands on exp. Course Title: Business Analyst Competency Development Program posted on Training Blog  Mock Interviews from Professional Course Duration: 45 hours Training  Quality StudyAllmaterial Training Materials: attendees would receive Consultants.  Case Studies based on Real-time project based  Real-time Project Documents  Training Scenariospresentation of each session,  Source Code for examples covered.  Certification Guidance  Certificate of Participation at the end. Training Format: This course is delivered as a highly interactive session, with extensive live examples. This

n a

r a

Z

course is delivered in Online using Web and Audio Conferencing. What will you learn?

The J2EE/JEE Training uses best practices and guidelines from Java Community Process (JCP®). The trainincontent

ZaranTech LLC. , http://www.zarantech.com, [email protected] , (515) 309-7846, Page - 1 5550 Wild Rose Lane, Suite 400, West Des Moines IA 50266

Apache Spark and Scala Professional Competency Development Program We focus on delivering Role-Specific training rather than Product based Training

In this training, attendees learn: 1. 2. 3. 4. 5. 6. 7. 8.

Apache Spark Scala Function args ( OOPS and Functional Programming in Scala ) Spark Core Architecture Spark Internals Spark Streaming Spark GraphX Programming Introducing Mllib

Pre-Requisites:  

C L

L

A basic understanding of functional programming and object oriented programming will help. Knowledge of Scala will definitely be a plus, but is not mandatory.

Who Should Join the Training?  Big Data enthusiasts  Software architects, engineers and developers  Data Scientists and analytics professionals

h c

e T

n a

r a

Z

ZaranTech LLC. , http://www.zarantech.com, [email protected] , (515) 309-7846, Page - 2 5550 Wild Rose Lane, Suite 400, West Des Moines IA 50266

Apache Spark and Scala Professional Competency Development Program

Apache Spark and Scala Role Based Training Program Enhancements

We focus on delivering Role-Specific training rather than Product based Training

Apache Spark and Scala ROLE BASED TRAINING PROGRAM ROADMAP Apache Spark

Introduction to Scala

h c

Spark Core Architecture

Spark Internals

C L

Function args (OOPS and Functional programming in Scala)

L

Spark Streaming

e T

Introducing Mllib

Spark GraphX Programming

n a

Project, Additional Concepts, Assignment and Case Studies Certification Guidance

r a

Z

ZaranTech LLC. , http://www.zarantech.com, [email protected] , (515) 309-7846, Page - 3 5550 Wild Rose Lane, Suite 400, West Des Moines IA 50266

Apache Spark and Scala Professional Competency Development Program We focus on delivering Role-Specific training rather than Product based Training

Topics covered: Introduction to Apache Spark 1. Introduction to Apache Spark 2. Why Spark 3. Batch Vs. Real Time Big Data Analytics 4. Batch Analytics - Hadoop Ecosystem Overview, 5. Real Time Analytics Options, 6. Streaming Data - Storm, 7. In Memory Data - Spark, What is Spark?, 8. Spark Value to Professionals 9. Limitations of MR in Hadoop 10. Components of Spark 11. Spark Execution Architecture 12. Benefits of Apache Spark 13. Hadoop vs Spark Introduction to Scala 1. What is Scala? 2. Why Scala & nature of scala? 3. Scala in Spark 4. What is Scala & REPL? 5. Primitives vs Vals vs Vars 6. If & match expressions in Scala 7. Recursion & nested functions in Scala 8. Collections overview 9. Control Stuctures & Function in Scala 10. Conditional & Block expression in Scala 11. Foreach & for comprehension in Scala 12. Define functions in Scala 13. Partial functions 14. Syntactic Sugar & Scala 15. Understand named, default & variable

C L

h c

L

e T

n a

r a

Function args (OOPS and Functional Programming in Scala) 1. Arrays, Maps & Tuples in Scala 2. Arrays vs ArrayBuffers 3. Transformations using Arrays 4. Array Algorithms 5. Maps & Tuples in Scala 6. Type Inference 7. What is REPL? 8. Objects & Classes in Scala 9. Functions as Objects in Scala 10. Anonymous Functions in Scala 11. Higher Order Functions 12. Lists in Scala 13. Maps

Z

ZaranTech LLC. , http://www.zarantech.com, [email protected] , (515) 309-7846, Page - 4 5550 Wild Rose Lane, Suite 400, West Des Moines IA 50266

Apache Spark and Scala Professional Competency Development Program We focus on delivering Role-Specific training rather than Product based Training

14. 15. 16. 17.

Pattern Matching & Regular expressions in Scala Traits in Scala Collections in Scala Actors in Scala

Spark Core Architecture 1. Spark & Distributed Systems 2. Spark for Scalable Systems 3. Spark Execution Context 4. What is RDD 5. RDD Deep Dive 6. RDD Dependencies 7. RDD Lineage 8. Spark Application In Depth 9. Spark Deployment 10. Parallelism in Spark 11. Caching in Spark

C L

h c

Spark Internals 1. Spark Transformations 2. Spark Actions 3. Spark Cluster 4. Spark SQL Introduction 5. Spark Data Frames in Depth 6. Spark SQL with CSV 7. Spark SQL with JSON 8. Spark SQL with Database

L

e T

n a

Spark Streaming 1. Features of Spark Streaming 2. Micro Batch 3. Dstreams 4. Transformations on Dstreams 5. Spark Streaming Use Case 1 6. Spark Streaming Use Case 2 7. Spark Streaming Use Case 3

r a

Spark GraphX Programming 1. Introduction to Graph Parallel Systems 2. Introduction to GraphX 3. Features of GraphX 4. GraphX Deep Dive 5. Graph Builder

Z

Introducing Mllib 1. Using Mllib for Movie Recommendations 2. Analyzing Recommendation Results using Spark

ZaranTech LLC. , http://www.zarantech.com, [email protected] , (515) 309-7846, Page - 5 5550 Wild Rose Lane, Suite 400, West Des Moines IA 50266

Apache Spark and Scala Professional Competency Development Program We focus on delivering Role-Specific training rather than Product based Training

About the trainer  

    

Experienced Software Professional with nearly 18 years of strong technology experience. Core competency skills involves Software Project Management, Development, Support and Maintenance using Apache Hadoop, Hive, Data Science, R, Python, Pig, Sqoop, Flume, Storm, Spark, Tableau, Talend, MS Project/Server, Asp.Net/C#, VB.Net, Smalltalk, Java, Oracle and MS SQL Server, WPF, Silverlight. Senior technologist with strong business acumen and technical experience in IT and Big Data space. Expertise in Design and Development of Apache Hadoop, Hive, Data Science, R, Python, Pig, Sqoop, Flume, Storm, Spark. Leader in IT & Big Data space that combines an entrepreneurial spirit with corporate-refined execution in Big Data strategy, Big Data consulting, implementations, CoE setup, architecture, presales and revenue optimization. Expertise in Design and Development of User Interfaces using Winforms, WPF, Silverlight and Asp.Net, Business object, Web Services and Data Access layers in C#. Expertise in Smalltalk, and Java2/1.3, JSP, Servlets.

C L

h c

L

e T

n a

r a

Z

ZaranTech LLC. , http://www.zarantech.com, [email protected] , (515) 309-7846, Page - 6 5550 Wild Rose Lane, Suite 400, West Des Moines IA 50266

Apache Spark and Scala Professional Competency Development Program We focus on delivering Role-Specific training rather than Product based Training

Sample CASE STUDY # 1 – “Healthcare System” Healthcare System Application:

C L

As the Product Manager for Inner Expressions you are asked to provide one of your largest clients with additional features in the EMR (Electronic Medical Records Management) System. The client has requested an integrated Referral Management System that tracks patients from Primary care into the Specialist departments. Appointments are created by either the Primary Care Physicians themselves or other clinical staff like Nurse Practitioners or Clinical Assistants. Each appointment must go through the appropriate checks including checking if the patient has an active insurance with the client, whether the insurance program covers the condition of the patient, patient’s preference for location and timings and availability of the Specialist doctor.

h c

L

Some appointments may have to be reviewed by the Specialists themselves before they can be approved, the administrator of the facility (hospital) must have the ability to choose by appointment type to either make it directly bookable by the Primary Care Staff or as a type that requires review by the specialist. The system should also allow the Primary Care Staff and specialists departments to exchange notes and comments about a particular appointment. If the specialist department requests tests or reports as mandatory for the appointment, the system must ensure that the patient has these available on the date of the appointment.

e T

n a

The system shall also allow users to track the status of patients’ appts & must store the entire clinical history of each patient. This will be used by the hospital for two main purposes; the specialist and the primary care providers will have access to the patients complete medical history before the patient walks in for the appt and hence allowing for better patient care, the Hospital also stores this data in a general data warehouse (without Protected Health Information) to do analytics on it and come up with local disease management programs for the area. This is aligned with the Hospitals mission of providing top quality preventive medical care.

r a

The Hospital sets about 300 appointments per day and must support about 50 users at the same time. The existing EMR system is based on Java and an Oracle database system.

Tasks:

Z

   

Identify Actors, Use Cases, Relationships, Draw Use Case Diagrams Identify Ideal, Alternate and Exception Flows Write a Business Requirements Document



Deploy and Test Application – Tomcat Server, Eclipse

ZaranTech LLC. , http://www.zarantech.com, [email protected] , (515) 309-7846, Page - 7 5550 Wild Rose Lane, Suite 400, West Des Moines IA 50266

Apache Spark and Scala Professional Competency Development Program We focus on delivering Role-Specific training rather than Product based Training

CASE STUDY # 2 – “Asset Management System” Asset Management Application:

C L

The asset management system keeps track of a number of assets that can be borrowed, their ownership, their availability, their current location, the current borrower and the asset history. Assets include books, software, computers, and peripherals. Assets are entered in the database when acquired, deleted from the database when disposed. The availability is updated whenever it is borrowed or returned. When a borrower fails to return an asset on time, the asset management system sends a reminder to the borrower and informs the asset owner.

L

The administrator enters new assets in the database, deletes obsolete ones, and updates any information related to assets. The borrower search for assets in the database to determine their availability and borrows and returns assets. The asset owner loans assets to borrowers. Each system has exactly one administrator, one or more asset owners, and one or more borrowers. When referring to any of the above actor, we use the term "user". All users are known to the system by their name and their email address. The system may keep track of other attributes such as the owner's telephone number, title, address, and position in the organization.

h c

e T

The system should support at least 200 borrowers and 2000 assets. The system should be extensible to other types of assets. The system should checkpoint the state of the database every day such that it can be recovered in case of data loss. Owners and the administrator are authenticated using a user/password combination. Actors interact with the system via a web browser capable of rendering HTML and HTTP without support for JavaScript and Java.

n a

r a

The persistent storage is realized using an MySQL database. The business logic is realized using the J2EE/JEE runtime system.

Tasks: 

     

OTHER

Identify Features - Login Page, Customer Information, Asset Information etc.

a storage subsystem managing persistent data HTML, JavaScript, CSS aDevelop session Prototype subsystem–controlling authentication, check out, and check in a notification subsystem sending past due notices Implement Functionality – Core Java, Servlets, JSP, Struts, Hibernate an administration subsystem realizing administration requests and Testsubsystem Applicationtranslating – Tomcat HTTP Server, Eclipse into requests to other subsystems and translating aDeploy user interface requests results into HTML pages. CASE STUDIES: Social Networking, Cruise Management System, Collegiate Sporting system

Z

ZaranTech LLC. , http://www.zarantech.com, [email protected] , (515) 309-7846, Page - 8 5550 Wild Rose Lane, Suite 400, West Des Moines IA 50266