Disqus - Latest Comments for ndimiduk

Re: HBase via Hive, Part 2 - Nick Dimiduk

Nick Dimiduk — Tue, 02 Jan 2018 22:10:23 -0000

Please read about HBase index structure. Data is indexed, and thus most quickly accessed in order of data coordinates -- rowkey, column family, column qualifier, &c. This has been written about extensively. I don't know the details of your query or how Hive is building an HBase request from it, but it sounds like you're experiencing a full table scan, or a partial scan that's significantly long. To fetch results faster, include your query constraint in the rowkey!

Hive over sequence files is a question for the hive user list, not these blog comments. You'll get much more qualified answers to Hive questions from there.

Re: HBase via Hive, Part 2 - Nick Dimiduk

Nick Dimiduk — Mon, 14 Nov 2016 00:45:46 -0000

You can define an HBase table as a Hive external table, that's part of what's outlined in this post. For Hive/Phoenix integration, see http://phoenix.apache.org/h...

Re: HBase via Hive, Part 2 - Nick Dimiduk

Nick Dimiduk — Sun, 01 May 2016 15:59:12 -0000

Good question. Used to be I think not, but maybe that's changed more recently. Best to ask on the hive-user mailing list.

Re: HBase via Hive, Part 2 - Nick Dimiduk

Nick Dimiduk — Fri, 18 Sep 2015 14:50:08 -0000

It would be better if this lived in Hive, not in a blog post from N years ago. I believe Hive accepts documentation JIRAs, so please open an issue on https://issues.apache.org/j...

Re: HBase via Hive, Part 2 - Nick Dimiduk

Nick Dimiduk — Wed, 16 Sep 2015 18:08:55 -0000

Sure. (1) create the table in HBase, using HBase shell or similar. (2) define the hive table as EXTERNAL so that Hive does not manage the HBase table's lifecycle (no "two-way bond", as you say). I mentioned EXTERNAL tables in the previous post.

Re: HBase via Hive, Part 2 - Nick Dimiduk

Nick Dimiduk — Fri, 27 Mar 2015 12:19:01 -0000

This example is from an older version of both Hive and HBase. The concepts are the same but the details have surely changed.

Re: BlockCache Showdown - Nick Dimiduk

Nick Dimiduk — Thu, 14 Aug 2014 16:42:30 -0000

You're probably right. There's more work to do here.

Re: HBase via Hive, Part 2 - Nick Dimiduk

Nick Dimiduk — Thu, 14 Aug 2014 16:41:41 -0000

Thanks Michael. Maybe you can try out an Apache Hive release?

Re: Measuring Measures - Measuring Measures - Deploying Clojure Services with Crane

Nick Dimiduk — Mon, 11 Oct 2010 12:55:52 -0000

Amusing. I always thought of this project as Crane [http://bit.ly/bGruYh], not Crane [http://bit.ly/1495u9] :)

Re: The world's leading companies | GDS Publishing

Nick Dimiduk — Wed, 05 May 2010 16:49:17 -0000

Is there an error in the "Software and services" data? The bar appears to not match the values in the table - market value is a smaller value than assets but is rendered as a larger percentage of the bar.

Re: Big+Data+Is+Less+About+Size%2C+And+More+About%26nbsp%3BFreedom

Nick Dimiduk — Wed, 17 Mar 2010 20:29:56 -0000

Alex: I believe there exists a whole class of company which is just barely coming into existence, one much like FlightCaster, in fact. This company needs new kinds of tools for easily dealing with their "medium to big" data. That is exactly what I'm building.

I think you are making an assumption which is false: I believe the size of data is no longer tied directly to the size of the company. Look at all the facebook apps out there who gain millions of users in their first month. Small company, "big" data.

Re: Working with Java Arrays

Nick Dimiduk — Sat, 16 Jan 2010 02:13:06 -0000

How does one specify an array as the parameter to a constructor in a gen-class scenario? I'd like to extend a class which has multiple single-argument constructors, some of which are of type Class[]. What would that look like in clojure?

Re: Heroku | Commercial Launch

Nick Dimiduk — Mon, 27 Apr 2009 11:48:35 -0000

Congratulations on your launch! I look forward to doing business with you guys :D

Re: Heroku | The Future of Deployment

Nick Dimiduk — Fri, 06 Feb 2009 21:16:12 -0000

You have a really compelling argument here: I don't want to be an admin, I want to write my apps and build a community. I'll have my cake and eat it too, thank you very much!

Now tell me, how are you planning to manage IP? My Heroku apps, are they mine?

Re: Goodbye, Bank of America. Hello, ______?

Nick Dimiduk — Mon, 29 Jan 2007 18:22:07 -0000

I'm a little surprised USAA won't take you. Their policies on potential member eligibility is much more lenient than it once was. If you haven't actually called them and asked, I would not count them out. I'm quite happy with USAA and would recommend them over any lending institution I've ever dealt with and/or heard about. Give them a call.