Python for Big Data

 

Duration: 24 hours

Course Objective

  • Master the fundamentals of writing Python scripts
  • Learn Python programming elements such as variables and flow control structures
  • Discover how to work with Python data structure lists and dictionary data
  • Write Python functions to facilitate code reuse
  • Use Python to handle data in files, xml, json and databases
  • Make their code robust by handling errors and exceptions properly
  • Work with the Python libraries
  • Explore Python’s object-oriented features
  • Search text using regular expressions
  • Data visualization
  • Hands on Practice Web scrapping to collection data
  • Hands on Practice Web development to represent information
  • Learn Data engineer roadmap

Outline

Python programming

  • Introduction to Python
  • Setup development IDE
  • Debug
  • Strings
  • Numbers
  • Control Structure

Data Structure

  • List
  • Dictionary

Data Operations

  • Flat file
  • JSON
  • XML
  • RDBMS

Regular expression

  • Matching
  • Searching
  • Searching and modifying

Common used Libraries

  • numPy
  • pandas
  • sciPy

Application Design

  • Requirements Collection
  • Configuration Design
  • Log mechanism
  • Data Migration and validation Practice

Web Scrapping

  • Web Scrapping basics
  • Web Scrapping advanced
  • The Yahoo! Finance Stock Quote Server

Data Visualization

  • Introduction
    • Data
    • Information
    • Knowledge
    • Data analysis and insight
  • Data Analysis and Visualization
    • Planning visualization
    • Visualization tools
  • Visualization Practice
    • Health Care
    • Sports
    • Trends over time
    • Financial and Statistical

Web Apps Development 

  • Web Frameworks
  • Building a Social Website
  • Sharing Content in Website
  • Tracking User Actions

Data Engineer roadmap