Big data with Spark for engineers – advanced workshop

Machine learning training

Prerequisites

Python syntax
Previous experience with Spark

Skills your team will gain

An understanding of challenges in optical character recognition problems.

Experience in creating OCR solutions using modern deep learning methods.

Duration

2 days

Agenda

Part 1

Introduction

  • Functional programming in Scala
  • MapReduce paradigm in Spark
  • Beyond MapReduce, broadcasts, accumulators, caching, Spark SQL

Part 2

Spark Internals

  • Logical plan: partitions, computation graph
  • Physical plan: jobs, stages and tasks
  • Spark SQL Internals, PySpark Internals

Part 2

Spark Application on Cluster

  • Architecture: driver, workers, executors
  • Monitoring Spark applications
  • Tuning Spark applications

Contact us

The administrator of the personal data provided by you in the registration form is deepsense.ai sp. z o.o., headquartered at al. Jerozolimskie 44, 00-024 Warsaw, Poland. Your personal data will be processed for the purpose of directing marketing content to you.
Detailed information about the processing of your personal data, including your rights, can be found in our privacy policy.
* This consent is required to receive email communication from deepsense.ai sp. z o.o. regarding the company and its offerings.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Locations
  • deepsense.ai, Inc.
  • 2100 Geng Road, Suite 210
  • Palo Alto, CA 94303
  • United States of America
  • deepsense.ai Sp. z o.o.
  • al. Jerozolimskie 44
  • 00-024 Warsaw
  • Poland
  • ul. Łęczycka 59
  • 85-737 Bydgoszcz
  • Poland
Let us know how we can help