Questions tagged [hiveql]

HiveQL is an SQL-like language for data summation, query, and analysis for use with Apache Hive, a data warehouse infrastructure built on top of Hadoop. HiveQL queries are automatically converted into map-reduce jobs.

Filter by
Sorted by
Tagged with
2
votes
1answer
11k views

Regex in Hive QL (RLIKE)

I'm wondering how/if I can improve the regex I'm using in a query. I have a set of identifiers for certain user groups. They can be in two main format: X123 or <...
5
votes
2answers
935 views

Writing a hiveserver2 query result to CSV with Python using pyhs2

I am trying to create a small application that will help me extract data from Hadoop via hiveserver2 by simply writing it to CSV. At the moment, it takes about 40 seconds to pull 10,000 records from a ...
1
vote
0answers
414 views

collect and parallelize in spark performance

the below code is working fine, but as this is new for me, please help to improve performance. as I have not included yet my complex logic but confused over collect and parallelize. Aim is to collect ...
5
votes
1answer
2k views

Change Data Capture using HIVE

Could you please review my code and let me know if there is something wrong? I'm getting the expected results. I'm trying to do change data capture using hive. We already have an existing CDC in ...