Course outline
Module 1
Module 1: Introduction to Big Data
Introduction to Big Data
Knowledge check
Q1. What is the primary characteristic of big data?
Why: Big data is characterized by the three Vs: Volume, Velocity, and Variety.
Q2. Which of the following is NOT a type of big data?
Why: Big data includes structured, semi-structured, and unstructured data.
Q3. What does the term "Velocity" refer to in big data?
Why: Velocity refers to the speed at which data is generated and processed.
Q4. What is the main purpose of big data analytics?
Why: Big data analytics is used to extract insights and knowledge from large and complex data sets.
Q5. Which of the following is a common application of big data?
Why: Common applications of big data include healthcare, finance, and marketing.
Module 2
Module 2: Data Storage and Management
Data Storage and Management
Knowledge check
Q1. What is the primary purpose of data storage in big data systems?
- A. To process data in real-time
- B. To store large volumes of data efficiently ✓
- C. To analyze data using machine learning
- D. To visualize data for reporting
Why: Data storage in big data systems is primarily focused on efficiently storing large volumes of data, which can then be processed and analyzed later.
Q2. Which of the following is a distributed file system commonly used in big data storage?
- A. MySQL
- B. Hadoop Distributed File System (HDFS) ✓
- C. MongoDB
- D. Oracle
Why: Hadoop Distributed File System (HDFS) is a distributed file system designed to store large amounts of data across multiple machines in a distributed environment.
Q3. Which of the following is a NoSQL database used for big data storage?
- A. SQL Server
- B. Oracle Database
- C. MongoDB ✓
- D. PostgreSQL
Why: MongoDB is a NoSQL database that is widely used in big data storage due to its scalability and flexibility in handling unstructured data.
Q4. What does the term "schema-on-read" refer to in big data storage?
- A. Defining the data structure before data is stored
- B. Defining the data structure after data is stored ✓
- C. Storing data in a structured format
- D. Reading data in a structured format
Why: Schema-on-read refers to defining the data structure after the data has been stored, which is commonly used in big data systems like Hadoop.
Q5. Which of the following is a key characteristic of big data storage systems?
- A. Low scalability
- B. High latency
- C. High availability and fault tolerance ✓
- D. Limited data processing capabilities
Why: High availability and fault tolerance are key characteristics of big data storage systems, ensuring that data is accessible and protected even in the event of hardware failures.
Module 3
Module 3: Data Processing Techniques
Data Processing Techniques
Knowledge check
Q1. What is the primary purpose of data processing in big data?
- A. To store data in traditional databases
- B. To transform raw data into meaningful information ✓
- C. To increase the size of the dataset
- D. To reduce the number of data sources
Why: Data processing is essential for converting raw data into structured and meaningful information that can be used for analysis and decision-making.
Q2. Which of the following is a common data processing technique used in big data?
- A. Manual data entry
- B. Data mining ✓
- C. Data visualization
- D. Data encryption
Why: Data mining is a common technique used in big data to extract valuable insights and patterns from large datasets.
Q3. What does ETL stand for in the context of data processing?
- A. Extract, Transfer, Load
- B. Extract, Transform, Load ✓
- C. Encode, Transform, Load
- D. Evaluate, Transform, Load
Why: ETL stands for Extract, Transform, Load, which is a process used to collect data from various sources, transform it into a suitable format, and load it into a target database or data warehouse.
Q4. Which of the following tools is commonly used for data processing in big data environments?
- A. Microsoft Word
- B. Apache Hadoop ✓
- C. Google Docs
- D. Adobe Photoshop
Why: Apache Hadoop is a widely used framework for distributed storage and processing of large datasets in big data environments.
Q5. What is the main advantage of using parallel processing in data processing?
- A. It increases data redundancy
- B. It reduces processing time by dividing tasks across multiple processors ✓
- C. It increases data complexity
- D. It reduces the need for data storage
Why: Parallel processing divides tasks across multiple processors, significantly reducing the time required to process large volumes of data.
Module 4
Module 4: Data Analytics Fundamentals
Data Analytics Fundamentals
Knowledge check
Q1. What is the primary goal of data analytics?
- A. To store data securely
- B. To extract insights and knowledge from data ✓
- C. To design databases
- D. To ensure data privacy
Why: The primary goal of data analytics is to extract insights and knowledge from data to support decision-making.
Q2. Which of the following is a type of data analytics?
- A. Data storage
- B. Descriptive analytics ✓
- C. Data transmission
- D. Data encryption
Why: Descriptive analytics is a type of data analytics that summarizes past data to understand what has happened.
Q3. Which of the following is a common tool used in data analytics?
- A. Word processor
- B. Spreadsheet software ✓
- C. Web browser
- D. Email client
Why: Spreadsheet software, such as Microsoft Excel, is commonly used in data analytics for data manipulation and analysis.
Q4. What does the term 'Big Data' refer to?
- A. A small dataset used for simple analysis
- B. A very large and complex dataset that requires advanced tools for processing ✓
- C. A database used for storing user login information
- D. A type of data visualization technique
Why: Big Data refers to a very large and complex dataset that requires advanced tools for processing and analysis.
Q5. Which of the following is a key characteristic of data analytics?
- A. It is only used for entertainment purposes
- B. It involves interpreting and drawing conclusions from data ✓
- C. It is limited to a single data source
- D. It is not used in business decision-making
Why: A key characteristic of data analytics is that it involves interpreting and drawing conclusions from data to support informed decisions.
Module 5
Module 5: Data Visualization Basics
Data Visualization Basics
Knowledge check
Q1. What is the primary purpose of data visualization?
- A. To store data securely
- B. To communicate information clearly and efficiently ✓
- C. To increase the size of datasets
- D. To replace textual data with images
Why: Data visualization is primarily used to communicate information clearly and efficiently through graphical representations.
Q2. Which of the following is a common type of chart used for showing trends over time?
- A. Pie chart
- B. Bar chart
- C. Line chart ✓
- D. Scatter plot
Why: Line charts are commonly used to show trends over time as they display data points connected by lines.
Q3. Which of the following is a disadvantage of using a pie chart?
- A. It is difficult to compare the sizes of different slices ✓
- B. It can only be used for categorical data
- C. It cannot display percentages
- D. It is not visually appealing
Why: A disadvantage of pie charts is that it is difficult to compare the sizes of different slices, especially when the differences are small.
Q4. What does a scatter plot typically show?
- A. The relationship between two variables ✓
- B. The distribution of a single variable
- C. The frequency of different categories
- D. The hierarchy of data
Why: A scatter plot typically shows the relationship between two variables by plotting points on a two-dimensional graph.
Q5. Which of the following tools is commonly used for data visualization?
- A. Excel ✓
- B. Word
- C. PowerPoint
- D. Notepad
Why: Excel is a commonly used tool for data visualization as it allows users to create various types of charts and graphs.
Module 6
Module 6: Big Data Tools and Technologies
Big Data Tools and Technologies
Knowledge check
Q1. What is Hadoop primarily used for?
- A. Storing small datasets
- B. Processing and storing large datasets ✓
- C. Designing databases
- D. Creating websites
Why: Hadoop is designed to handle large datasets across distributed computing environments.
Q2. Which of the following is a component of Hadoop?
- A. MySQL
- B. HDFS ✓
- C. Oracle
- D. MongoDB
Why: HDFS (Hadoop Distributed File System) is a core component of Hadoop.
Q3. What does MapReduce do?
- A. It stores data in the cloud
- B. It processes data in parallel across a cluster ✓
- C. It creates visualizations
- D. It manages user access
Why: MapReduce is a programming model used for processing large data sets in parallel across a cluster.
Q4. Which of the following is a NoSQL database?
- A. MySQL
- B. MongoDB ✓
- C. PostgreSQL
- D. Oracle
Why: MongoDB is a popular NoSQL database that stores data in a flexible, JSON-like format.
Q5. What is the main purpose of Apache Spark?
- A. To replace Hadoop
- B. To provide real-time data processing ✓
- C. To design web applications
- D. To manage cloud storage
Why: Apache Spark is known for its ability to perform real-time data processing and analytics.
Module 7
Module 7: Ethics in Big Data
Ethics in Big Data
Knowledge check
Q1. What is a primary concern when handling big data ethically?
- A. Data size
- B. Privacy and security ✓
- C. Storage costs
- D. Processing speed
Why: Privacy and security are major ethical concerns when handling big data as they involve protecting individuals' personal information.
Q2. Which of the following is an example of data bias in big data?
- A. Using data from a diverse population
- B. Using data that represents all demographics equally
- C. Using data that is skewed towards a particular group ✓
- D. Using data that is randomly collected
Why: Using data that is skewed towards a particular group can lead to biased outcomes and is an example of data bias.
Q3. Which of the following is a key principle of data ethics?
- A. Data maximization
- B. Data transparency ✓
- C. Data duplication
- D. Data fragmentation
Why: Data transparency is a key principle of data ethics as it ensures that data usage is clear and understandable to all stakeholders.
Q4. What does the term 'data anonymization' refer to?
- A. Making data more accessible to the public
- B. Removing personally identifiable information from data sets ✓
- C. Increasing the size of data sets
- D. Encrypting data for storage
Why: Data anonymization refers to the process of removing personally identifiable information from data sets to protect individual privacy.
Q5. Which of the following is a common ethical issue in big data analytics?
- A. Data compression
- B. Data overuse ✓
- C. Data encryption
- D. Data visualization
Why: Data overuse is a common ethical issue in big data analytics as it can lead to misuse and exploitation of data.