Python for Big Data
Duration: 24 hours
Course Objective
- Master the fundamentals of writing Python scripts
- Learn Python programming elements such as variables and flow control structures
- Discover how to work with Python data structure lists and dictionary data
- Write Python functions to facilitate code reuse
- Use Python to handle data in files, xml, json and databases
- Make their code robust by handling errors and exceptions properly
- Work with the Python libraries
- Explore Python’s object-oriented features
- Search text using regular expressions
- Data visualization
- Hands on Practice Web scrapping to collection data
- Hands on Practice Web development to represent information
- Learn Data engineer roadmap
Outline
Python programming
- Introduction to Python
- Setup development IDE
- Debug
- Strings
- Numbers
- Control Structure
- List
- Dictionary
- Flat file
- JSON
- XML
- RDBMS
- Matching
- Searching
- Searching and modifying
Common used Libraries
- numPy
- pandas
- sciPy
Application Design
- Requirements Collection
- Configuration Design
- Log mechanism
- Data Migration and validation Practice
Web Scrapping
- Web Scrapping basics
- Web Scrapping advanced
- The Yahoo! Finance Stock Quote Server
Data Visualization
- Introduction
- Data
- Information
- Knowledge
- Data analysis and insight
- Data Analysis and Visualization
- Planning visualization
- Visualization tools
- Visualization Practice
- Health Care
- Sports
- Trends over time
- Financial and Statistical
Web Apps Development
- Web Frameworks
- Building a Social Website
- Sharing Content in Website
- Tracking User Actions
Data Engineer roadmap