Disqus - Latest Comments for mojodna

Re: Querying OpenStreetMap with Amazon Athena

Seth Fitzsimmons — Wed, 30 Mar 2022 14:52:56 -0000

The upstream source hasn't been able to produce exports for the last couple weeks and the public dataset tracks and mirrors those weekly exports.

More information:
https://twitter.com/OSM_Tec...

Re: Resolved: GDAL on AWS GPU Instances :: Drive-by Digressions

Seth Fitzsimmons — Sun, 26 Aug 2018 20:07:46 -0000

GPU instances are GPU-enabled EC2 instances (there are a few different flavors).

Re: Querying OpenStreetMap with Amazon Athena

Seth Fitzsimmons — Tue, 03 Apr 2018 16:31:43 -0000

Not at present. https://aws.amazon.com/blog... shows how to create a rendering pipeline using other AWS services.

Re: Querying OpenStreetMap with Amazon Athena

Seth Fitzsimmons — Wed, 03 May 2017 15:10:28 -0000

For the most recent planet, the OSM PBF is 37.94GB, the ORC version is 47.61, and 54GB for bzip2-compressed XML. Planet history is 61.48GB as OSM PBF, 79.08GB as ORC, and 86GB for compressed XML.

Re: Querying OpenStreetMap with Amazon Athena

Seth Fitzsimmons — Thu, 20 Apr 2017 14:33:49 -0000

Gotcha, querying for relations with this schema is _very_ difficult and we're likely to miss some mapped features. That seemed acceptable for first order analysis, especially in areas where buildings are typically traced from aerial imagery and tend not to be particularly complex.

I'd love to be able to provide an alternate schema that includes geometries and facilitates spatial queries, but that's dependent on the presence of something like the Esri Spatial UDFs.

Re: Querying OpenStreetMap with Amazon Athena

Seth Fitzsimmons — Mon, 17 Apr 2017 14:46:58 -0000

Can you elaborate? They should include points (if mapped as nodes) or center points (if mapped as ways), both as lat/lon pairs.

For those familiar with the OSM PBF format, the ORC schema is intended to be functionally equivalent to that (but queryable out of the box and using partial reads with non-OSM tools), and intended as an alternate building block for the creation of derivatives like tables w/ reconstructed geometry, inverted indices, etc.

Re: Binary Streaming with Hadoop (and Node.js)

Seth Fitzsimmons — Wed, 01 Jan 2014 21:13:04 -0000

Fixed. Thanks!!

Re: The OS X Spatial Stack :: Drive-by Digressions

Seth Fitzsimmons — Fri, 18 Nov 2011 00:51:37 -0000

I haven't had the opportunity to try yet.

Re: Writing an API client with test, staging, and production in mind

Seth Fitzsimmons — Thu, 15 Sep 2011 15:42:39 -0000

I'm a fan of stubbing out the service externally (or providing a fake version if you're the service provider) in something like Sinatra. That way you get predictable responses for specific inputs (including error conditions) *and* can use them to test other API clients with the same stub. Using HTTP and spinning up an actual server also means that you can ensure that client features like caching and gzip-compression are working properly.

Re: http://chipotle.tumblr.com/post/5207966724

Seth Fitzsimmons — Thu, 05 May 2011 15:33:03 -0000

Save on blur:

" save on losing focus
au FocusLost * :wa

Re: Exploring OAuth-Protected APIs :: Drive-by Digressions

Seth Fitzsimmons — Tue, 25 Jan 2011 17:27:41 -0000

Not sure, really. If you're able to install Twisted and oauth-proxy and you have a twistd binary, you can run `twistd -n oauth_proxy ...` instead of the wrapper script. If you figure it out, please leave a note!

Re: Exploring OAuth-Protected APIs :: Drive-by Digressions

Seth Fitzsimmons — Thu, 20 Jan 2011 17:30:52 -0000

No clue, sorry. Packaging a Twisted plugin is a total mystery, so I'm always surprised that it works as often as it does ;-)

Re: Exploring OAuth-Protected APIs :: Drive-by Digressions

Seth Fitzsimmons — Thu, 20 Jan 2011 17:30:07 -0000

The path that pip wrote the package into (specifically the oauth_proxy command) probably isn't in your $PATH.

Re: My (work) Git Workflow :: Content Goes Here

Seth Fitzsimmons — Fri, 31 Dec 2010 16:10:45 -0000

Thanks! I've updated the gist with the version from Nabble.

Re: Exploring OAuth-Protected APIs :: Drive-by Digressions

Seth Fitzsimmons — Sun, 14 Nov 2010 22:47:21 -0000

Actually, looks like the header problem still exists upstream (though I'm curious if the rest works as it should). Mind following up with Leah?

thanks.
seth

Re: Exploring OAuth-Protected APIs :: Drive-by Digressions

Seth Fitzsimmons — Sun, 14 Nov 2010 22:45:41 -0000

A couple weeks ago I did a bit of cleanup that likely fixes this problem; rather than bundling a rather old version of one of the Python OAuth libraries, it's now an external dependency. Newer versions of `oauth` have had some bug fixes applied, and I'm guessing that a variation on your patch was included. (The repo *should* be here: https://github.com/leah/pyt...

The up-side is that oauth-proxy is now installable via PyPI and is more straightforward to run (the instructions in the post ^^^ have been updated accordingly).

If you have a chance, give it another spin and follow up here.

Re: Exploring OAuth-Protected APIs :: Drive-by Digressions

Seth Fitzsimmons — Sun, 14 Nov 2010 22:40:55 -0000

You'll need the OAuth RubyGem installed in order to have the `oauth` command available.

Sorry for the confusion.

Re: My (work) Git Workflow :: Content Goes Here

Seth Fitzsimmons — Fri, 22 Oct 2010 14:11:19 -0000

Totally, that's awesome.

Re: switchboard : XMPP :: curl : HTTP :: Drive-by Digressions

Seth Fitzsimmons — Fri, 12 Mar 2010 11:30:22 -0000

You can't out of the box, but you can add `host` and `port` arguments to the `#connect` call on line 56 of `lib/switchboard/client.rb` (http://github.com/mojodna/s...

Re: Updating Ruby Consumers and Providers to OAuth 1.0a :: Drive-by Digressions

Seth Fitzsimmons — Mon, 08 Mar 2010 17:43:21 -0000

Oops. Try http://github.com/oauth/oau... instead.

Re: The OS X Spatial Stack :: Drive-by Digressions

Seth Fitzsimmons — Wed, 27 Jan 2010 01:13:07 -0000

The Mapnik installers are awesome (and seriously simplify installation of the whole stack). I'm finally experiencing the awesomeness that is Quantumnik (though I think I have a few quirks I need to file bugs on...next time I futz with it).

I also updated the article with better instructions on building Postgres extensions.

Re: The OS X Spatial Stack :: Drive-by Digressions

Seth Fitzsimmons — Fri, 11 Dec 2009 10:21:28 -0000

I figured that it could probably be simplified more; thanks for the tips! (Updated above.)

When the Mapnik installer is released, I'll update the docs. I may keep the compilation instructions for people who want to be bleeding edge.

Re: Notes on Collecta XMPP API - Bloggitation

Seth Fitzsimmons — Wed, 04 Nov 2009 23:12:46 -0000

Hiya.

I'm sitting here at the XMPP Meetup / Hack Session and just committed SASL Anonymous support to Switchboard:
http://github.com/mojodna/s...

Your jack is sweet, but it might be well-complemented by a `collecta` command (so you can support custom command-line args). With SASL Anonymous supported, I hope you'll consider playing around with Switchboard a bit more.

seth

Re: Exploring OAuth-Protected APIs :: Drive-by Digressions

Seth Fitzsimmons — Sun, 01 Nov 2009 14:31:05 -0000

oauth_proxy/oauth_proxy.py:63 is the line in question. Have a look at http://github.com/mojodna/o... for a version that converts to an int (removed due to incompatibility with Python 2.5.1).

Re: Exploring OAuth-Protected APIs :: Drive-by Digressions

Seth Fitzsimmons — Sun, 01 Nov 2009 14:26:32 -0000

Thanks, fixed!