Python for Big Data

Duration: 24 hours

Course Objective

• Master the fundamentals of writing Python scripts
• Learn Python programming elements such as variables and flow control structures
• Discover how to work with Python data structure lists and dictionary data
• Write Python functions to facilitate code reuse
• Use Python to handle data in files, xml, json and databases
• Make their code robust by handling errors and exceptions properly
• Work with the Python libraries
• Explore Python’s object-oriented features
• Search text using regular expressions
• Data visualization
• Hands on Practice Web scrapping to collection data
• Hands on Practice Web development to represent information
• Learn Data engineer roadmap

Outline

Python programming

• Introduction to Python
• Setup development IDE
• Debug
• Strings
• Numbers
• Control Structure

Data Structure

• List
• Dictionary

Data Operations

• Flat file
• JSON
• XML
• RDBMS

Regular expression

• Matching
• Searching
• Searching and modifying

Common used Libraries

• numPy
• pandas
• sciPy

Application Design

• Requirements Collection
• Configuration Design
• Log mechanism
• Data Migration and validation Practice

Web Scrapping

• Web Scrapping basics
• Web Scrapping advanced
• The Yahoo! Finance Stock Quote Server

Data Visualization

• Introduction
  • Data
  • Information
  • Knowledge
  • Data analysis and insight
• Data Analysis and Visualization
  • Planning visualization
  • Visualization tools
• Visualization Practice
  • Health Care
  • Sports
  • Trends over time
  • Financial and Statistical

Web Apps Development 

• Web Frameworks
• Building a Social Website
• Sharing Content in Website
• Tracking User Actions

Data Engineer roadmap