SQL and HiveQL comparison

-



Komentar

Posting Komentar

Postingan populer dari blog ini

Weaknesses in Traditional Data Platforms

-
Everyone understands that Hadoop brings high performance commercial computing to organizations using relatively low cost commodity storage.   What is accelerating the move to Hadoop are weaknesses in traditional relational and data warehouse platforms in meeting today's business needs.  Some key weaknesses of traditional platforms include: Late binding with schemas greatly increase the latency between receiving new data sources and deriving business value from this data.  The significantly high cost and complexity of SAN storage.  This high cost forces organizations to aggregate and remove a lot of data that contains high business value.  Important details and information are getting thrown out or hidden in aggregated data. The complexity of working with semi-structured and unstructured data. The incredible cost, complexity and ramifications of maintaining database administrators, storage and networking teams in traditional platforms.   There are lo...
Baca selengkapnya

HBase Architecture

-
Gambar
      The HBase Architecture consists of servers in a Master-Slave relationship as shown below. Typically, the HBase cluster has one Master node, called HMaster and multiple Region Servers called HRegionServer. Each Region Server contains multiple Regions – HRegions. Just like in a Relational Database, data in HBase is stored in Tables and these Tables are stored in Regions. When a Table becomes too big, the Table is partitioned into multiple Regions. These Regions are assigned to Region Servers across the cluster. Each Region Server hosts roughly the same number of Regions. The HMaster in the HBase is responsible for Performing Administration Managing and Monitoring the Cluster Assigning Regions to the Region Servers Controlling the Load Balancing and Failover On the other hand, the HRegionServer perform the following work Hosting and managing Regions Splitting the Regions automatically Handling the read/write requests Communicating w...
Baca selengkapnya

Pig Overview

-
Hive Vs Pig Feature Hive Pig Language SQL-like PigLatin Schemas/Types Yes (explicit) Yes (implicit) Partitions Yes No Server Optional (Thrift) No User Defined Functions (UDF) Yes (Java) Yes (Java) Custom Serializer/Deserializer Yes Yes DFS Direct Access Yes (implicit) Yes (explicit) Join/Order/Sort Yes Yes Shell Yes Yes Streaming Yes Yes Web Interface Yes No JDBC/ODBC Yes (limited) No             Apache Pig and Hive are two projects that layer on top of Hadoop, and provide a higher-level language for using Hadoop's MapReduce library. Apache Pig provides a scripting language for...
Baca selengkapnya