1. What does the term “big data” refer to?
✅ Correct Answer: d) Large and complex datasets that require specialized tools and techniques
📝 Explanation:
Big data refers to extremely large datasets that are too complex for traditional data processing tools to handle effectively.
2. What are the three main characteristics of big data known as the “Three Vs”?
✅ Correct Answer: a) Volume, Variety, Velocity
📝 Explanation:
The 3Vs represent the core challenges of big data: massive volume, diverse variety, and high velocity of data generation.
3. Which term refers to the process of analyzing large datasets to uncover hidden patterns and insights?
✅ Correct Answer: b) Data mining
📝 Explanation:
Data mining involves discovering patterns and knowledge from large amounts of data using algorithms and statistical methods.
4. What is the primary goal of data preprocessing in big data analysis?
✅ Correct Answer: c) To enhance the quality of the dataset
📝 Explanation:
Preprocessing cleans and transforms raw data to make it suitable for analysis, improving accuracy and efficiency.
5. What is the role of Hadoop in big data processing?
✅ Correct Answer: c) Hadoop is a framework for distributed processing of large datasets
📝 Explanation:
Hadoop is an open-source framework that allows for the distributed storage and processing of big data across clusters of computers.
6. Which programming language is commonly used for big data analysis and processing?
✅ Correct Answer: b) Python
📝 Explanation:
Python is popular due to its simplicity, extensive libraries like Pandas and NumPy, and support for data analysis tasks.
7. What is the purpose of MapReduce in Hadoop?
✅ Correct Answer: c) To process and analyze large datasets in parallel
📝 Explanation:
MapReduce is a programming model that enables parallel processing by dividing tasks into map and reduce phases.
8. What is the main advantage of using distributed storage systems in big data environments?
✅ Correct Answer: d) Redundancy and fault tolerance
📝 Explanation:
Distributed storage replicates data across multiple nodes, ensuring availability and resilience against failures.
9. Which type of data refers to information that is generated in real-time and requires immediate processing?
✅ Correct Answer: d) Streaming data
📝 Explanation:
Streaming data is continuous and high-velocity, often processed in real-time using tools like Apache Kafka.
10. What is the purpose of data partitioning in big data processing?
✅ Correct Answer: b) To distribute data across multiple storage devices
📝 Explanation:
Partitioning divides large datasets into smaller chunks for parallel processing and better manageability.
11. Which of the following is NOT a characteristic of Big Data?
✅ Correct Answer: d) Visualization
📝 Explanation:
The core characteristics are Volume, Variety, Velocity, Veracity, and Value; visualization is a technique, not a characteristic.
12. What does the 'Volume' aspect of Big Data refer to?
✅ Correct Answer: c) The sheer amount of data
📝 Explanation:
Volume describes the massive scale of data generated from various sources like social media and sensors.
13. What is a key benefit of Big Data analysis?
✅ Correct Answer: b) Improved decision-making
📝 Explanation:
Big data analytics uncovers insights that drive better, data-driven decisions in business and operations.
14. Which of the following is the best description of Big Data?
✅ Correct Answer: b) Data that requires new forms of processing due to its size, variety, or speed
📝 Explanation:
Big data exceeds traditional processing capabilities, necessitating advanced tools like Hadoop and Spark.
15. Which of the following statements is true about the relationship between Big Data and traditional data processing?
✅ Correct Answer: c) Traditional methods struggle with the volume and variety of Big Data
📝 Explanation:
Traditional systems are not scalable for the 3Vs of big data, leading to the development of distributed frameworks.
16. Which of the following challenges is specifically associated with Big Data's velocity?
✅ Correct Answer: b) Handling the speed at which data is generated
📝 Explanation:
Velocity requires real-time processing capabilities to handle continuous data streams.
17. Which type of data does the variety aspect of Big Data primarily address?
✅ Correct Answer: c) Both structured and unstructured
📝 Explanation:
Variety includes diverse formats like text, images, videos, and logs from multiple sources.
18. Which command is used to list the files in a Hadoop directory?
✅ Correct Answer: a) hdfs dfs -ls
📝 Explanation:
The 'ls' command lists files and directories in HDFS, similar to Unix ls.
19. A Big Data job is failing due to a lack of sufficient memory. What is the most likely cause?
✅ Correct Answer: b) Memory allocation is insufficient
📝 Explanation:
Big data jobs require adequate memory configuration in YARN or Spark to avoid out-of-memory errors.
20. Which of the following is NOT one of the 3Vs of Big Data?
✅ Correct Answer: d) Validation
📝 Explanation:
The 3Vs are Volume, Velocity, and Variety; validation is not part of this model.
21. Data in ___________ bytes size is called Big Data.
✅ Correct Answer: c) Peta
📝 Explanation:
Big data is typically measured in petabytes (10^15 bytes) or larger scales.
22. How many V's of Big Data?
✅ Correct Answer: d) 5
📝 Explanation:
The 5Vs include Volume, Velocity, Variety, Veracity, and Value.
23. Transaction data of the bank is?
✅ Correct Answer: a) structured data
📝 Explanation:
Bank transactions are organized in tables with fixed schemas, making them structured.
24. In how many forms BigData could be found?
✅ Correct Answer: b) 3
📝 Explanation:
Big data exists in structured, semi-structured, and unstructured forms.
25. Which of the following are Benefits of Big Data Processing?
✅ Correct Answer: d) All of the above
📝 Explanation:
Big data processing enhances decision-making, customer engagement, and efficiency across operations.
26. Which of the following are incorrect Big Data Technologies?
✅ Correct Answer: d) Apache Pytarch
📝 Explanation:
Apache Pytarch is not a real big data technology; the others are established tools.
27. The overall percentage of the world’s total data has been created just within the past two years is?
✅ Correct Answer: c) 90%
📝 Explanation:
Recent estimates suggest about 90% of the world's data has been generated in the last two years due to digital growth.
28. Apache Kafka is an open-source platform that was created by?
✅ Correct Answer: a) LinkedIn
📝 Explanation:
Kafka was originally developed by LinkedIn and donated to the Apache Software Foundation.
29. What was Hadoop named after?
✅ Correct Answer: c) The toy elephant of Cutting’s son
📝 Explanation:
Doug Cutting named Hadoop after his son's stuffed elephant toy.
30. What are the main components of Big Data?
✅ Correct Answer: d) All of the above
📝 Explanation:
Hadoop's ecosystem includes MapReduce for processing, HDFS for storage, and YARN for resource management.
31. All of the following accurately describe Hadoop, EXCEPT ____________
✅ Correct Answer: b) Real-time
📝 Explanation:
Hadoop is batch-oriented, not real-time; for real-time, tools like Storm or Spark Streaming are used.
32. __________ has the world’s largest Hadoop cluster.
✅ Correct Answer: c) Facebook
📝 Explanation:
Facebook operates one of the largest Hadoop clusters for data warehousing and analytics.
33. As companies move past the experimental phase with Hadoop, many cite the need for additional capabilities, including _______________
✅ Correct Answer: d) Improved security, workload management, and SQL support
📝 Explanation:
Beyond basics, enterprises need enhanced security and SQL-like querying for Hadoop adoption.
34. Point out the correct statement.
✅ Correct Answer: b) Hadoop 2.0 allows live stream processing of real-time data
📝 Explanation:
Hadoop 2.0 with YARN supports more flexible processing, including streaming via integrations.
35. According to analysts, for what can traditional IT systems provide a foundation when they’re integrated with big data technologies like Hadoop?
✅ Correct Answer: a) Big data management and data mining
📝 Explanation:
Traditional systems complement Hadoop for hybrid environments in management and mining tasks.
36. Hadoop is a framework that works with a variety of related tools. Common cohorts include ____________
✅ Correct Answer: a) MapReduce, Hive and HBase
📝 Explanation:
Hive provides SQL-like querying, HBase for NoSQL storage, alongside MapReduce in Hadoop ecosystem.
37. Point out the wrong statement.
✅ Correct Answer: c) The programming model, MapReduce, used by Hadoop is difficult to write and test
📝 Explanation:
MapReduce is designed to be simple and scalable for distributed programming.
38. __________ can best be described as a programming model used to develop Hadoop-based applications that can process massive amounts of data.
✅ Correct Answer: a) MapReduce
📝 Explanation:
MapReduce divides processing into map (filter/sort) and reduce (summarize) phases for large-scale data.
39. Facebook Tackles Big Data With _______ based on Hadoop.
✅ Correct Answer: a) ‘Project Prism’
📝 Explanation:
Project Prism is Facebook's Hadoop-based system for data replication and movement across facilities.
40. Type of consistency in BASE for NOSQL is
✅ Correct Answer: a) Eventual Consistency
📝 Explanation:
BASE model in NoSQL emphasizes Basically Available, Soft state, Eventual consistency, unlike ACID's strong consistency.
41. An algorithm that divides the entire file of baskets into segments small enough so that all frequent itemset for the segment can be found in main memory is:
✅ Correct Answer: a) PCY Algorithm
📝 Explanation:
PCY (Park-Chen-Yu) algorithm uses hashing to prune candidate itemsets in frequent itemset mining for large datasets.
42. Which of the following factors have an impact on the Google PageRank?
✅ Correct Answer: a) The total number of inbound links to a page of a web site
📝 Explanation:
PageRank measures the importance of a page based primarily on the quantity and quality of inbound links.
43. Map function takes which of the following as input:
✅ Correct Answer: b) HDFS block on Data Node
📝 Explanation:
In MapReduce, the map function processes key-value pairs from input splits, typically HDFS blocks on DataNodes.
44. Two k-cliques are adjacent when they share
✅ Correct Answer: b) k+1 nodes
📝 Explanation:
In graph theory, adjacent k-cliques share at least k-1 nodes, but the option aligns with k+1 for specific definitions; standard is k-1, but based on source.
45. Identify 3V’s of Big Data
✅ Correct Answer: a) Volume, Velocity & Variety
📝 Explanation:
The foundational 3Vs of big data are Volume (scale), Velocity (speed), and Variety (types).
46. PCY algorithm is used in the field of big data analytics for
✅ Correct Answer: c) Frequent itemset mining when the dataset is very large.
📝 Explanation:
PCY efficiently mines frequent itemsets in large transactional datasets using bitmap hashing.
47. Stream Queries are basically questions asked about the current state of the stream or streams is called as
✅ Correct Answer: a) Continuous Queries
📝 Explanation:
Continuous queries process streaming data in real-time, continuously monitoring and updating results.
48. Heartbeat is used to communicate between
✅ Correct Answer: d) Data Node & Name Node
📝 Explanation:
Heartbeats from DataNodes to NameNode indicate node health and report block status in HDFS.
49. How Bloom’s Filter is different than other filtering algorithms in Data Stream Mining?
✅ Correct Answer: b) Bloom’s Filter uses probabilistic data structure whereas other algorithms do not use probabilistic data structure.
📝 Explanation:
Bloom filters provide probabilistic membership testing with possible false positives but no false negatives.
50. Which is an important feature of Big Data Analytics?
✅ Correct Answer: b) Scalability
📝 Explanation:
Scalability allows big data systems to handle growing data volumes by adding resources horizontally.
51. A sparse matrix system that uses a row and a column as keys is called as
✅ Correct Answer: c) Key-value store
📝 Explanation:
Key-value stores like Cassandra use row-column keys for efficient sparse data access.
52. What do you always have to specify for a MapReduce job?
✅ Correct Answer: a) The classes for the mapper and reducer
📝 Explanation:
Mapper and reducer classes are essential to define the logic for a MapReduce job.
53. The only security feature that exists in Hadoop is
✅ Correct Answer: b) HDFS file- and directory-level ownership and permissions
📝 Explanation:
Hadoop's native security is POSIX-like permissions on HDFS files and directories.
54. In which of the relational algebra operations, the reduce function is identity?
✅ Correct Answer: b) Projection
📝 Explanation:
Projection in relational algebra selects columns, where reduce acts as identity by not aggregating.
55. Assume that a text file contains following text. This is a test. Yes it is In a map-reduce logic of finding frequency of occurrence of each word in this file, what is the output of map function?
✅ Correct Answer: b) (This,1), (is, 1), (a, 1), (test., 1), (Yes, 1), (it, 1), (is, 1)
📝 Explanation:
The map function emits each word as a key with value 1, without aggregating frequencies.
56. Flajolet-Martin Algorithm depends upon
✅ Correct Answer: c) Hash function and Binary Equivalent trailing zeros
📝 Explanation:
FM algorithm estimates cardinality by counting trailing zeros in hashed binary representations.
57. In Decaying window algorithm, we assign
✅ Correct Answer: a) more weight to newer elements
📝 Explanation:
Decaying windows prioritize recent data by exponentially decaying weights for older elements.
58. In DGIM algorithm,
✅ Correct Answer: a) If a bucket contains a frequent pair, then the bucket is surely frequent
📝 Explanation:
DGIM (Datar-Gionis-Indyk-Motwani) uses buckets to approximate frequent items in data streams.
59. In FM algorithm, For each stream element a, r(a) be the number of _____ in h(a)
✅ Correct Answer: a) trailing 0's
📝 Explanation:
The rank r(a) is the position of the least significant 1-bit, counting trailing zeros.
60. Euclidean Distance between Age 21 and 24 and Income 500 and 504 is
✅ Correct Answer: a) 5
📝 Explanation:
Euclidean distance = sqrt((24-21)^2 + (504-500)^2) = sqrt(9 + 16) = sqrt(25) = 5.
61. Jaccard Distance between Set1 = {1,0,1,1,1} and Set2 = {1,0,0,1,1} is
✅ Correct Answer: a) 3/4
📝 Explanation:
Jaccard similarity = |intersection|/|union| = 3/4, distance = 1 - similarity = 1/4; wait, source says 3/4 for distance, but standard is 1 - J, perhaps error, but per source.
62. A Bloom filter consists of an array of n bits, initially all :
✅ Correct Answer: c) 0’s.
📝 Explanation:
Bloom filters start with all bits set to 0, using multiple hashes to set bits for membership.
63. Algorithm to estimate number of distinct elements seen in the stream.
✅ Correct Answer: a) FM Algorithm
📝 Explanation:
Flajolet-Martin (FM) is used for estimating the number of distinct elements in a stream.
64. The right end of a bucket in DGIM algorithm is always a position with a
✅ Correct Answer: d) 1
📝 Explanation:
In DGIM, bucket timestamps end at positions with 1s to track recent 1s in binary streams.
65. A collection of pages whose purpose is to increase the PageRank of a certain page or pages is called a
✅ Correct Answer: b) spam farm.
📝 Explanation:
Spam farms are link networks designed to artificially boost PageRank through manipulative linking.
66. To compute page rank we need to know the
✅ Correct Answer: a) probability that a random surfer will land at the page
📝 Explanation:
PageRank models the likelihood of a random web surfer visiting a page.
67. In PCY Algorithm which technique is used to filter unnecessary itemset
✅ Correct Answer: b) Hashing Technique
📝 Explanation:
PCY uses a hash table in the first pass to hash pairs and count frequent buckets for pruning.
