Microsoft.Testkings.70-775.v2019-01-19.by.Brian...A. binary, JSON, Apache Parquet, and ORC B. OXPS,...

https://www.gratisexam.com/

70-775.exam.37q

Number: 70-775Passing Score: 800Time Limit: 120 min


70-775

Perform Data Engineering on Microsoft Azure HDInsight


Exam A

QUESTION 1You have an Azure HDInsight cluster.

You need a build a solution to ingest real-time streaming data into a nonrelational distributed database.

.


What should you use to build the solution?

A. Apache Hive and Apache Kafka

B. Spark and Phoenix

C. Apache Storm and Apache HBase

D. Apache Pig and Apache HCatalog

Correct Answer: CSection: (none)Explanation

Explanation/Reference:Explanation:References:http://storm.apache.org/http://hbase.apache.org/

QUESTION 2You have an Apache Hive table that contains one billion rows.

You plan to use queries that will filter the data by using the WHERE clause. The values of the columns will be known only while the data loads into a Hive table.

You need to decrease the query runtime.

What should you configure?

A. static partitioning


B. bucket sampling

C. parallel execution

D. dynamic partitioning


Explanation/Reference:Explanation:References: https://www.qubole.com/blog/5-tips-for-efficient-hive-queries/

QUESTION 3You plan to copy data from Azure Blob storage to an Azure SQL database by using Azure Data Factory.

Which file formats can you use?

A. binary, JSON, Apache Parquet, and ORC

B. OXPS, binary, text and JSON

C. XML, Apache Avro, text, and ORC

D. text, JSON, Apache Avro, and Apache Parquet

Correct Answer: DSection: (none)Explanation

Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/data-factory/supported-file-formats-and-compression-codecs

QUESTION 4You have an Apache Spark cluster in Azure HDInsight.

You plan to join a large table and a lookup table.

You need to minimize data transfers during the join operation.

What should you do?

A. Use the reduceByKey function.


B. Use a Broadcast variable.

C. Repartition the data.

D. Use the DISK_ONLY storage level.

E. Store the lookup table to a disk.

F. Store the lookup table to Azure Blob storage.

Correct Answer: BSection: (none)Explanation

Explanation/Reference:Explanation:References: https://www.dezyre.com/article/top-50-spark-interview-questions-and-answers-for-2017/208


You execute the following command.

What is the result of running the command?

A. the Hive ORC library is imported to Spark and external tables in ORC format are created

B. the Spark library is imported and the data is loaded to an Apache Hive table

C. the Hive ORC library is imported to Spark and the ORC-formatted data stored in Apache Hive tables becomes accessible

D. the Spark library is imported and Scala functions are executed


Explanation/Reference:Explanation:


QUESTION 6You use YARN to manage the resources for a Spark Thrift Server running on a Linux-based Apache Spark cluster in Azure HDInsight.

You discover that the cluster does not fully utilize the resources. You want to increase resource allocation.

You need to increase the number of executors and the allocation of memory to the Spark Thrift Server driver.

Which two parameters should you modify? Each correct answer presents part of the solution.

NOTE: Each correct selection is worth one point.

A. spark.dynamicAllocation.maxExecutors

B. spark.cores.max

C. spark.executor.memory

D. spark_thrift_cmd_opts

E. spark.executor.instances

Correct Answer: ACSection: (none)Explanation

Explanation/Reference:Explanation:References: https://stackoverflow.com/questions/37871194/how-to-tune-spark-executor-number-cores-and-executor-memory

QUESTION 7You are configuring the Hive views on an Azure HDInsight cluster that is configured to use Kerberos.

You plan to use the YARN logs to troubleshoot a query that runs against Apache Hadoop.

You need to view the method, the service, and the authenticated account used to run the query.

Which method call should you view in the YARN logs?

A. HQL

B. WebHDFS

C. HDFS C* API

D. Ambari RESR API




QUESTION 8You have an Azure HDInsight cluster.

You need to store data in a file format that maximizes compression and increases read performance.

Which type of file format should you use?

A. ORC

B. Apache Parquet

C. Apache Avro

D. Apache Sequence

Correct Answer: ASection: (none)Explanation

Explanation/Reference:Explanation:References: http://www.semantikoz.com/blog/orc-intelligent-big-data-file-format-hadoop-hive/

QUESTION 9You have an Apache Hadoop cluster in Azure HDInsight that has a head node and three data nodes. You have a MapReduce job.

You receive a notification that a data node failed.

You need to identify which component cause the failure.

Which tool should you use?

A. JobTracker

B. TaskTracker

C. ResourceManager

D. ApplicationMaster




QUESTION 10Note: This question is part of a series of questions that use the same or similar answer choices. An answer choice may be correct for more than one question inthe series. Each question is independent of the other questions in this series. Information and details provided in a question apply only to that question.

You are implementing a batch processing solution by using Azure HDInsight.

You have a table that contains sales data.

You plan to implement a query that will return the number of orders by zip code.

You need to minimize the execution time of the queries and to maximize the compression level of the resulting data.

What should you do?


A. Use a shuffle join in an Apache Hive query that stores the data in a JSON format.

B. Use a broadcast join in an Apache Hive query that stores the data in an ORC format.

C. Increase the number of spark.executor.cores in an Apache Spark job that stores the data in a text format.

D. Increase the number of spark.executor.instances in an Apache Spark job that stores the data in a text format.

E. Decrease the level of parallelism in an Apache Spark job that stores the data in a text format.

F. Use an action in an Apache Oozie workflow that stores the data in a text format.

G. Use an Azure Data Factory linked service that stores the data in Azure Data Lake.

H. Use an Azure Data Factory linked service that stores the data in an Azure DocumentDB database.

Correct Answer: BSection: (none)


Explanation




You have data stored in Azure.

You need to ensure that you can access the data by using Azure Active Directory (Azure AD) identities.

What should you do?









Correct Answer: GSection: (none)Explanation

Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/data-factory/concepts-datasets-linked-services




You plan to import 300 TB of data.

You plan to use one job that has many concurrent tasks to import the data in memory.

You need to maximize the amount of concurrent tasks for the job.

What should you do?










Explanation/Reference:Explanation:References: https://blog.cloudera.com/blog/2015/03/how-to-tune-your-apache-spark-jobs-part-2/

QUESTION 13Note: This question is part of a series of questions that use the same scenario. For your convenience, the scenario is repeated in each question. Each questionpresents a different goal and answer choices, but the text of the scenario is exactly the same in each question in this series.

You are planning a big data infrastructure by using an Apache Spark cluster in Azure HDInsight. The cluster has 24 processor cores and 512 GB of memory.

The architecture of the infrastructure is shown in the exhibit. (Click the Exhibit button.)


The architecture will be used by the following users:Support analysts who run applications that will use REST to submit Spark jobs.Business analysts who use JDBC and ODBC client applications from a real-time view. The business analysts run monitoring queries to access aggregateresults for 15 minutes. The results will be referenced by subsequent queries.Data analysts who publish notebooks drawn from batch layer, serving layer, and speed layer queries. All of the notebooks must support native interpreters fordata sources that are batch processed. The serving layer queries are written in Apache Hive and must support multiple sessions. Unique GUIDs are usedacross the data sources, which allow the data analysts to use Spark SQL.

The data sources in the batch layer share a common storage container. The following data sources are used:Hive for sales dataApache HBase for operations dataHBase for logistics data by using a single region server

You need to ensure that the analysts can query the logistics data by using JDBC APIs and SQL APIs.

Which technology should you implement?

A. Apache Phoenix

B. Apache Spark

C. Apache Storm

D. Apache Hive

Correct Answer: A


Section: (none)Explanation

Explanation/Reference:Explanation:References: http://phoenix.apache.org/





The data sources in the batch layer share a common storage container. The following data sources are used:


Hive for sales dataApache HBase for operations dataHBase for logistics data by using a single region server

The business analysts report that they experience performance issues when they run the monitoring queries.

You troubleshoot the performance issues and discover that the intermediate tables generated when the analysts run the queries cause pressure for the Java VirtualMachine (JVM) garbage collection per job.

Which configuration settings should you modify to alleviate the performance issues?

A. spark.sql.inMemoryColumnarStorage.batchSize

B. spark.sql.broadcastTimeout

C. spark.sql.files.openCostInBytes

D. spark.sql.shuffle.partitions



QUESTION 15DRAG DROP

Note: This question is part of a series of questions that use the same scenario. For your convenience, the scenario is repeated in each question. Each questionpresents a different goal and answer choices, but the text of the scenario is exactly the same in each question in this series.






The business analysts require queries to monitor the sales data. The queries must be faster and more interactive than the batch layer queries.

You need to create a new infrastructure to support the queries. The solution must ensure that you can tune the cache policies of the queries.

Which three actions should you perform in sequence? To answer, move the appropriate actions from the list of actions to the answer area and arrange them in thecorrect order.

Select and Place:


Correct Answer:



Explanation/Reference:







You need to ensure that the support analysts can develop embedded analytics applications by using the least amount of development effort.

Which technology should you implement?

A. Zeppelin

B. Jupyter

C. Apache Ambari

D. Livy

Correct Answer: D



Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apache-spark-livy-rest-interface


You need to deploy a NoSQL database to an HDInsight cluster. You will manage the server that host the database by using Remote Desktop. The database mustuse the key/value pair format in a columnar model.

What should you do?

A. Use an Azure PowerShell script to create and configure a premium HDInsight cluster. Specify Apache Hadoop as the cluster type and use Linux as theoperating system.

B. Use the Azure portal to create a standard HDInsight cluster. Specify Apache Spark as the cluster type and use Linux as the operating system.

C. Use an Azure PowerShell script to create a standard HDInsight cluster. Specify Apache HBase as the cluster type and use Windows as the operating system.

D. Use an Azure PowerShell script to create a standard HDInsight cluster. Specify Apache Storm as the cluster type and use Windows as the operating system.

E. Use an Azure PowerShell script to create a premium HDInsight cluster. Specify Apache HBase as the cluster type and use Linux as the operating system.

F. Use an Azure portal to create a standard HDInsight cluster. Specify Apache Interactive Hive as the cluster type and use Linux as the operating system.

G. Use an Azure portal to create a standard HDInsight cluster. Specify Apache HBase as the cluster type and use Linux as the operating system.

Correct Answer: GSection: (none)Explanation

Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hbase-overview


You need to deploy an enterprise data warehouse that will support in-memory analytics. The data warehouse must support connections that use the Microsoft HiveODBC Driver and Beeline. The data warehouse will be managed by using Apache Amrabi only.


What should you do?








Correct Answer: FSection: (none)Explanation

Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-use-interactive-hive


You need to deploy an HDInsight cluster that will provide in-memory processing, interactive queries, and micro-batch stream processing. The cluster has thefollowing requirements:

Uses Azure Data Lake Store as the primary storageCan be used by HDInsight applications

What should you do?










Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-apache-spark-overview


You need to deploy an HDInsight cluster that will have a custom Apache Ambari configuration. The cluster will be joined to a domain and must perform thefollowing:

Fast data analytics and cluster computing by using in-memory processingInteractive queries and micro-batch stream processing

What should you do?









Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-hadoop-introduction

QUESTION 21Note: This question is part of a series of questions that use the same scenario. For your convenience, the scenario is repeated in each question. Eachquestion presents a different goal and answer choices, but the text of the scenario is exactly the same in each question in this series.


You have an initial dataset that contains the crime data from major cities.

You plan to build training models from the training data. You plan to automate the process of adding more data to the training models and to constantly tune themodels by using the additional data, including data that is collected in near real-time. The system will be used to analyze event data gathered from many differentsources, such as Internet of Things (IoT) devices, live video surveillance, and traffic activities, and to generate predictions of an increased crime risk at a particulartime and place.

You have an incoming data stream from Twitter and an incoming data stream from Facebook, which are event-based only, rather than time-based. You also have atime interval stream every 10 seconds.

The data is in a key/value pair format. The value field represents a number that defines how many times a hashtag occurs within a Facebook post, or how manytimes a Tweet that contains a specific hashtag is retweeted.

You must use the appropriate data storage, stream analytics techniques, and Azure HDInsight cluster types for the various tasks associated to the processingpipeline.

You plan to consolidate all of the streams into a single timeline, even though none of the streams report events at the same interval.

You need to aggregate the data from the feeds to alight with the time interval stream. The result must be the sum of all the values for each key within a 10 secondinterval, with the keys being the hashtags.

Which function should you use?

A. countByWindow

B. reduceByWindow

C. reduceByKeyAndWindow

D. countByValueAndWindow

E. updateStateByKey

Correct Answer: ESection: (none)Explanation









You are planning a storage strategy for a large amount of analytic data used for the crime data analytics system. The initial data load involves over 100 billionrecords, and more than two billion records will be added daily.

You already created an Apache Hadoop cluster in HDInsight premium.

You need to implement the storage strategy to meet the following requirements:The storage capacity must support 50 TB.The storage must be optimized for Hadoop.The data must be stored in its native format.Enterprise-level security based on Active Directory must be supported.


What should you create?

A. a virtual machine (VM) by using the Data Science Virtual Machine template for Windows that has premium storage, a G-series size, and uses Microsoft SQLServer 2016 to store the data

B. an Azure Data Lake Analytics service by using Azure PowerShell

C. an Azure Data Lake Store account by using the Azure portal


D. an Azure Blob storage account by using the Azure portal


Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-get-started-portal







You are designing the real-time portion of the input stream processing. The input will be a continuous stream of data and each record will be processed one at atime. The data will come from an Apache Kafka producer.

You need to identify which HDInsight cluster to use for the final processing of the input data. This will be used to generate continuous statistics and real-timeanalytics. The latency to process each record must be less than one millisecond and tasks must be performed in parallel.

Which type of cluster should you identify?

A. Apache Storm

B. Apache Hadoop

C. Apache HBase


D. Apache Spark


Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-storm-overview

QUESTION 24Note: This question is part of a series of questions that present the same scenario. Each question in the series contains a unique solution that mightmeet the stated goals. Some question sets might have more than one correct solution, while others might not have a correct solution.

After you answer a question in this sections, you will NOT be able to return to it. As a result, these questions will not appear in the review screen.

You have an Apache Pig table named Sales in Apache HCatalog.

You need to make the data in the table accessible from Apache Pig.

Solution: You use the following script.

Does this meet the goal?

A. Yes

B. No


Explanation/Reference:Explanation:References: https://hortonworks.com/hadoop-tutorial/how-to-use-hcatalog-basic-pig-hive-commands/

QUESTION 25Note: This question is part of a series of questions that use the same or similar answer choices. An answer choice may be correct for more than one


question in the series. Each question is independent of the other questions in this series. Information and details provided in a question apply only tothat question.


You have two tables. Each table is larger than 250 TB. Both tables have approximately the same number of rows and columns.

You need to match the tables based on a key column. You must minimize the size of the data table that is produced.

What should you do?










Explanation/Reference:Explanation:References: http://www.openkb.info/2014/11/understanding-hive-joins-in-explain.html

QUESTION 26You deploy Apache Kafka to an Azure HDInsight cluster.

You plan to load data into a topic that has a specific schema.

You need to load the data while maintaining the existing schema.

Which file format should you use to receive the data?

A. JSON

B. Kudu


C. Apache Sequence

D. CSV


Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/kafka/apache-kafka-auto-create-topics

QUESTION 27You have an Apache Interactive Hive cluster in Azure HDInsight. The cluster has 12 processors and 96 GB of RAM. The YARN container size is set to 2 GB andthe Tez container size is 3 GB.

You configure one Tez container per processor.

You are performing map joints between a 2-GB dimension table and a 96-GB fact table.

You experience slow performance due to an inadequate utilization of the available resources.

You need to ensure that the map joins are used.

Which two settings should you configure? Each correct answer presents part of the solution.

NOTE: Each correct selection is worth one point.

A. SET hive.tez.container.size=98304

B. SET hive.auto.convert.join.noconditionaltask.size=2048MB

C. SET yarn.scheduler.minimum-allocation-mb=6144MB

D. SET hive.auto.convert.join.noconditionaltask.size=3072MB

E. SET hive.tez.container.size=6144MB


Explanation/Reference:Explanation:References: https://hortonworks.com/blog/how-to-plan-and-configure-yarn-in-hdp-2-0/



Users report that Spark jobs take longer than expected to complete.

You need to reduce the amount of time it takes for the Spark jobs to complete.

What should you do?

A. From HDFS, modify the maximum thread setting.

B. From Spark, modify the spark_thrift_cmd_opts parameter.

C. From YARN, modify the container size setting.

D. From Spark, modify the spark.executor.cores parameter.


Explanation/Reference:Explanation:References: https://rea.tech/how-we-optimize-apache-spark-apps/

QUESTION 29You are configuring an Apache Phoenix operation on top of an Apache HBase server. The operation executes a statement that joins an Apache Hive table and aPhoenix table.

You need to ensure that when the table is dropped, the table files are retained, but the table metadata is removed from the Apache HCatalog.

Which type of table should you use?

A. internal

B. external

C. temp

D. Azure Table Storage



Explanation/Reference:Explanation:References: https://phoenix.apache.org/hive_storage_handler.html







You plan to create a new HBase table to collect the operations data. The workload will be distributed across regional servers. Apache Phoenix will be used on topof HBase for the operations data.

You need to ensure that write operations are distributed across the regional servers.

Which setting should you configure when you create the table?

A. SALT_BUCKETS

B. MAX_FILESIZE

C. UPDATE_CACHE_FREQUENCY

D. BLOCKCACHE


Explanation/Reference:Explanation:References: https://phoenix.apache.org/tuning_guide.html







You need to ensure that the data analysts can use the notebooks.

What should you install?

A. Zeppelin in the batch layer

B. Zeppelin on workstations that access the batch layer

C. Jupyter in the batch layer

D. Jupyter on workstations that access the batch layer

Correct Answer: BSection: (none)


Explanation

Explanation/Reference:Explanation:References: https://dzone.com/articles/data-visualization-using-apache-zeppelin

QUESTION 32You have an Apache Hive cluster in Azure HDInsight.

You plan to ingest on-premises data into Azure Storage.

You need to automate the copying of the data to Azure Storage.


A. Microsoft Azure Storage Explorer

B. Azure Import/Export Service

C. Azure Backup

D. AzCopy


Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/data-factory/tutorial-hybrid-copy-data-tool

QUESTION 33You have an Apache HBase cluster in Azure HDInsight.

You plan to use Apache Pig, Apache Hive, and HBase to access the cluster simultaneously and to process data stored in a single platform.

You need to deliver consistent operations, security, and data governance.

What should you use?

A. Apache Ambari

B. MapReduce

C. Apache Oozie


D. YARN


Explanation/Reference:Explanation:References: https://hortonworks.com/blog/hbase-hive-better-together/

QUESTION 34You have several Linux-based and Windows-based Azure HDInsight clusters. The clusters are indifferent Active Directory domains.

You need to consolidate system logging for all of the clusters into a single location. The solution must provide near real-time analytics of the log data.

What should you use?

A. Apache Ambari

B. YARN

C. Microsoft System Center Operations Manager

D. Microsoft Operations Management Suite (OMS)


Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-log-management

QUESTION 35You have an Apache Spark job.

The performance of the job deteriorates over time.

You plan to debug the job.

You need to gather information that you can use to debug the job.



A. YARN

B. Spark History Server

C. HDInsight Cluster Dashboard

D. Jupyter Notebook


Explanation/Reference:Explanation:https://docs.microsoft.com/en-us/azure/hdinsight/spark/apache-spark-job-debugging

QUESTION 36You create a Linux-based Azure HDInsight cluster by using the Azure portal.

You plan to use Microsoft Power Query for Excel to debug a job failure.

You need to identify all of the components that failed for the head node.

Which component contains the log files?

A. Azure Table Storage

B. a worker node in an Apache Hadoop cluster

C. Azure SQL Database

D. Azure Blob storage


Explanation/Reference:Explanation:References: https://docs.microsoft.com/en-us/azure/hdinsight/hadoop/apache-hadoop-debug-jobs

QUESTION 37Note: This question is part of a series of questions that use the same or similar answer choices. An answer choice may be correct for more than onequestion in the series. Each question is independent of the other questions in this series. Information and details provided in a question apply only tothat question.


You need to deploy an HDInsight cluster to perform real-time event processing. The cluster server must be managed by using Remote Desktop.

What should you do?









Explanation/Reference:Explanation:References: https://github.com/Huachao/azure-content/blob/master/articles/hdinsight/hdinsight-provision-clusters.md


Microsoft.Testkings.70-775.v2019-01-19.by.Brian...A. binary, JSON, Apache Parquet, and ORC B. OXPS,...

Documents

Transcript of Microsoft.Testkings.70-775.v2019-01-19.by.Brian...A. binary, JSON, Apache Parquet, and ORC B. OXPS,...