Disqus - Latest Comments for sam

Re: Agile database schema migration tool for Java

sam — Sun, 09 Sep 2007 17:41:48 -0000

If anyone knows of a DDL abstraction layer for Java that would be an awesome addition to the framework.

Re: Agile database schema migration tool for Java

sam — Wed, 12 Sep 2007 03:44:38 -0000

Checkout Liquibase: http://www.liquibase.org/

“LiquiBase is an open source (LGPL), DBMS-independent library for tracking, managing and applying database changes. “

I like the backend of this library. Not too fond of creating XML to do the changes though. Though one of the uses I see for this is adding migrations to Grails. Then creating a builder that has a nice DSL and generates the XML configuration files might not be that bad. I'll check it out, thanks for the link!

Re: Agile database schema migration tool for Java

sam — Sat, 15 Sep 2007 23:45:08 -0000

Sam - I’m trying to your dbmigrate package from the Google code site. I’ve tried running Migrate from cmd line with little success - I’m guess the args I’m passing are not correct. Can you email me a sample of running it from cmd line? I looked through your test cases and couldn’t fine one. Thanks - James.

Hi James,

I've updated the source with a test for the command line along with actually printing out the usage message when you try and run it on the command line and it fails. I would definitely appreciate any feedback you have about the library.

Sam

Re: Agile database schema migration tool for Java

sam — Tue, 25 Sep 2007 18:21:35 -0000

Thanks for the feedback! My responses to your excellent suggestions:

1) I like this idea.
2) Seems reasonable. That might make it easier to read and understand what would get executed.
3) Now that I have integration with Grails I might add the ability to specify the environment even in the Java version.
4) Actually as of subversion version 40 or so I support Groovy scripts (named like the sql scripts), Java classes (camelCased), and SQL scripts.

Sam

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Wed, 10 Oct 2007 21:18:10 -0000

CP Staley: Parallels or VMWare should work great in that case.

Covas: For serious AutoCAD work (3D, etc) I can't recommend anything except Bootcamp.

Re: Agile database schema migration tool for Java

sam — Sat, 13 Oct 2007 00:42:43 -0000

Hi Sam,

Just been looking at dbmigrate to handle our database migration issues during development. Looks like a very promising product.

Thanks, I am obviously still working on it but its working well in its current implementation.

One area that has me scratching my head a bit is the processing of the scripts. It’s a bit out of sync with the doco, so I’ve been running some tests to see how it works and looking through the source code. I’d like some feedback on the reasoning behind the mirgratefrom- and migrateto- seperating of the classes/scripts. The code says that it looks for the first file from the list and runs just that one. The search order being (ignoring database specific ones which are the same):

(Class)from(version)

(Sql)from(Version)

(Groovy)from(version)

(Class)to(version+1)

(Sql)to(Version+1)

(Groovy)to(version+1)

I found this a bit confusing and wondered what the logic behind this is. I also found that if I create a from1, from2, and from3, dbmigrate only runs 1 and 2 when I specify version 3. I tried changing from3 to to3, but because of the from2 script it would not run that either.

It appears that the logic is that from scripts update from the prior version to the next number, I.e. from2 should contain updates from version 2 to version 3 of the database and the to scripts work in the opposite. But that you must code either from or to scripts, but not both. In which case I’m thinking why not just stick with what the doco says.

It appears that the best way to code things is to create to1, to2, and to3 as most programmer think in terms of the version number of a file matching the version number in the database.

So here is the deal. The original one had the semantics of 'migratefromN' which is what I need in order to skip versions for when you go GA and you want to update the database in one fell swoop from the previously released version to the latest development version. The problem is that if you keep track of the version you are going to you have this problem that you must assume that you are coming from the most immediate previous version. For all those people out there that want the version of the file to match up with the version of the database you can use 'migratetoN' scripts/classes. I should really update the documentation but this was after feedback like yours where you want the script version to match the database version it is setting rather than the version it finds in the database.

Regards,

Derek

P.S. What’s the status of the code in terms of contributions from other programmers ? How would we go about it ? and how much time do you expect to put into this project ?

Right now it is just myself and a couple of others that have worked on before. If you or someone from your team wants to contribute we can discuss it. Send me email (sam at sampullara dot com). In terms of time I am going to put into the project -- I would like to limit the scope of it so that in its current form it is almost done and if there is more to it, perhaps make another system that sits on top of it.

Re: Agile database schema migration tool for Java

sam — Sat, 13 Oct 2007 00:47:50 -0000

Sounds very similar to autopatch (http://autopatch.sourceforge.net), which i’ve been using for a couple of months on a java web project. It’s more web app focused, with some nice features like a startup servlet to trigger the migration when you deploy a new version of your app, and a locking table to prevent multiple nodes in a cluster from trying to update simultaneously. So far the biggest annoyance of autopatch has been that the migrations are one way. I like the fact that rake migrate lets you downgrade your database so you can re-run the upgrade as you test your app before checking in.

Autopatch actually looks like a really cool generic solution to this problem. If it had been easy to find perhaps I would not have built this though its probably a bit too generic for most people (but not me). I've never had an application setup so that I would need to downgrade, instead I always use original data in the tests and have it get upgraded up to current. That makes it a waste to write all that downgrade code, especially when a true downgrade may be impossible (loss of information during migration).

Re: Generate JPA (or GORM) classes from your database for Java and Grails

sam — Mon, 15 Oct 2007 10:26:26 -0000

Hi Stephen,

The Grails support is tested with the Grail-1.0-RC1 nightly build, not the currently stable release, because there are a number of new features that I needed to leverage. I also just use the built-in Hibernate support rather than trying to call out to the EntityManager myself -- I'm still using GORM, just with my JPA based annotation classes rather than Groovy based GORM classes. The one thing I forgot to note here though is that you have to tell GORM about the annotations:

import org.codehaus.groovy.grails.orm.hibernate.cfg.GrailsAnnotationConfiguration
dataSource {
configClass = GrailsAnnotationConfiguration.class

Otherwise GORM won't see the domain classes. As for using real JPA APIs I haven't tested it. I will try it later and see what I find.

Sam

Re: Generate JPA (or GORM) classes from your database for Java and Grails

sam — Mon, 15 Oct 2007 11:15:12 -0000

I tried it with Oracle, got an “ORA-00942 Table or View does not exist”. Any Ideas ?

java -classpath .;ojdbc5.jar;dbmap-r12.jar com.moonspider.dbmap.Generator -url jdbc:oracle:thin:@192.168.1.220:1521:mydb -user myuser -password mypass -driver oracle.jdbc.driver.OracleDriver -d mydb

Error: java.sql.SQLException: ORA-00942: Tabelle oder View nicht vorhanden

Usage: com.moonspider.dbmap.GenerateConfig

…

Hi Parker,

I've added an issue to the tracker on the site: http://code.google.com/p/dbmapper/issues/detail... . Can you rerun the command line with -Ddebug=true and post the stacktrace to the issue that I've opened?

Thanks,
Sam

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Tue, 22 Jan 2008 21:29:20 -0000

Based on the unusual hardware requirements I would try it out on the test drives of both Parallels and VMWare and see which one gives you better results. I wouldn't bother with Crossover Office for this type of application. You'll only need to install XP once because you can import your images between the environments.

IE will run well on either of those and I think most Webex stuff works on the Mac natively as long as you are viewing and not broadcasting.

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Wed, 13 Feb 2008 20:47:28 -0000

I have tried it and it doesn't work that well. Bootcamp would be your only real option for running Netflix until they port it natively to the Mac.

Re: Agile database schema migration tool for Java

sam — Thu, 14 Feb 2008 12:51:36 -0000

The code is maintained at Google Code. Codehaus only has the code for the plugin because thats the way you distribute plugins using grails -- they are uploaded to the codehaus SVN server. Anyone who is serious about working on the project only need contact myself and I will add them to the project with their first good patch.

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Mon, 10 Mar 2008 12:35:57 -0000

Actually the Mac comes with software that will let you dynamically change the partition map so you will be able to later get rid of the Bootcamp partition without reformatting the Mac side of things and reclaim the space.

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Thu, 20 Mar 2008 22:39:27 -0000

Because you list a device I would recommend that you confirm that it works with Crossover Office first. My gut reaction is that you should probably use Parallels or VMWare in order to ensure that your device is supported and older software like Wordperfect 12 works well since that is not likely to be extensively tested by Codeweavers. The Mac version of Office is sufficient for every purpose except hardcore Excel users -- plus the new version of Mac Office runs just about the same speed as the old one even under emulation. Entourage isn't really the same as Outlook but its still usable.

Good luck!

Sam

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Sun, 23 Mar 2008 21:40:06 -0000

Your USB thumb drive will work with all of them. With VMWare and Parallels you can either share the mounted thumb drive from the Mac side to the Windows side or you can give control of the device completely over to Windows. Crossover Office uses the same devices as the Mac has available.

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Mon, 24 Mar 2008 15:14:14 -0000

If that is what you are using Quicken for I would sign up for Wesabe or Mint which both do a fantastic job of tracking credit and bank accounts without a lot of fuss.

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Sat, 29 Mar 2008 19:05:14 -0000

I don't have any experience with the trial version and Bootcamp. My guess is that it is supposed to work though. In the past, I have gotten great help from the VMWare forums for their other products so I suggest that you post your question there.

Re: Using Google App Engine to Extend Yahoo! Pipes

sam — Sun, 20 Apr 2008 17:46:52 -0000

Nice article.

By the way, can’t you include simplejson using

“from django.utils import simplejson”?

You sure can. I didn't know that was in there. Thanks!

Re: Better Javadoc results using SearchMonkey

sam — Wed, 21 May 2008 16:05:46 -0000

Good idea. I'm looking at things to put in the Infobar and those make a lot of sense.

Re: Yahoo! BOSS is easy — meet Yuil

sam — Wed, 30 Jul 2008 12:16:24 -0000

Nice one. Very clever. I guess you could do a url specific BOSS image search per result link in order to get images as well. However, this could take time so you’d need to do it in async mode. On server side I am not sure how you’d do it in Python on AppEngine and on the client side you’d run into concurrent requests from the same domain problem. It would be cool though if it was a 1-1 copy of the interface.

It would be hard to make it a complete 1-for-1 copy because I have no idea where they come up with their images. What I would like is to grab an image from the page that I'm linking to. It would be better if I was doing my own crawl for that...

I have hear that the categories will be coming in the next versions of BOSS. Sam to my knowledge BOSS does not support search suggestions.

I'm using the regular Yahoo! Search Suggest API.

BTW you should use the ClickURL (as per TOS) for the links in the results when using BOSS.

Strangely, they are the same for the searches that I am doing. I expected the redirects. This might have something to do with the changes that were recently rolled out on Yahoo! SERPs that don't requite it.

Thanks,
Sam

Re: Yuil is dead! 4hoursearch is now online.

sam — Fri, 01 Aug 2008 20:28:34 -0000

“The requested URL /src/4hoursearch-src.zip was not found on this server.”

<img src="http://www.javarants.com/wp-includes/images/smilies/icon_smile.gif" alt=":-)" class="wp-smiley"> </img>

-Russ

Ugh. Bad push, just saw it in the log, fixed.

Re: Yuil is dead! 4hoursearch is now online.

sam — Fri, 01 Aug 2008 20:35:39 -0000

Just wondering. What’s up with the image next to the first returned result? The image next to the first search for my name is from some random other site and has no connection to the listing.

Sorry it didn't work well for you. The image is the #1 image search result for the same query. If you click on the image rather than the search result it will go through to the site that it was found on.

Re: Yuil is dead! 4hoursearch is now online.

sam — Sun, 03 Aug 2008 12:51:30 -0000

Yeah, I suck at python. If anyone knows a better call to use than 'quote_plus' that works with UNICODE, I'm all ears.

Re: Yuil is dead! 4hoursearch is now online.

sam — Tue, 05 Aug 2008 15:26:03 -0000

The functions django.utils.http.urlquote() and django.utils.http.urlquote_plus() are versions of Pythonâs standard urllib.quote() and urllib.quote_plus() that work with non-ASCII characters. (The data is converted to UTF-8 prior to encoding.)

That fails in the same way as it is a wrapper on quote_plus.

Re: Yuil is dead! 4hoursearch is now online.

sam — Wed, 06 Aug 2008 00:18:22 -0000

For IRIs to URIs in Python (like http://www.4hoursearch.com/search?q=mémoires) see:

http://code.djangoproject.com/browser/django/trunk/django/utils/encoding.py

This isn't included in Google App Engine -- it has an older version of Django -- but I ported it over and it works great! Please test out the unicode support now.

Re: Yuil is dead! 4hoursearch is now online.

sam — Wed, 06 Aug 2008 14:54:31 -0000

It’s now working fine (: what was causing the error btw?

http://www.4hoursearch.com/search?q=mp3+download

resulted an error:

Traceback (most recent call last):

File “/base/python_lib/versions/1/google/appengine/ext/webapp/__init__.py”, line 499, in __call__

handler.get(*groups)

File “/base/data/home/apps/yoolsearch/1.216/search.py”, line 52, in get

template_values['image'] = image_response['resultset_images'][0]

KeyError: ‘resultset_images’

An underlying BOSS web service regressed temporarily, it has been corrected.

Re: Yuil is dead! 4hoursearch is now online.

sam — Thu, 07 Aug 2008 16:06:52 -0000

Hey the pagination seems to not be working. It forgets the query string and doesn’t have a page as a parameter.

Other than that, good work!

Hi Jim, I wasn't able to reproduce this. It may be that there aren't enough results -- I am not handling that case well. Can you give me an example query where it doesn't work for you?

Re: Yuil is dead! 4hoursearch is now online.

sam — Thu, 07 Aug 2008 17:26:08 -0000

Searched for ‘porn’, clicked on page 10, bam, it breaks

http://www.4hoursearch.com/search?q=porn&p=10

Traceback (most recent call last):

File “/base/python_lib/versions/1/google/appengine/ext/webapp/__init__.py”, line 499, in __call__

handler.get(*groups)

File “/base/data/home/apps/yoolsearch/1.232/search.py”, line 40, in get

ysr = result['ysearchresponse']

TypeError: ‘NoneType’ object is unsubscriptable

My error checking is not "robust". That looks like I didn't get a response back from the urlfetch. Could have been Google App Engine or BOSS. I should check for that and put up the fail whale.

Re: 2008 Olympic Medal Counts by Population

sam — Sun, 24 Aug 2008 16:02:42 -0000

As I mention in the blog, I agree that this is biased against countries that are either uninterested or unable to compete. Here is the original spreadsheet if you want to mess around with it:

http://sheet.zoho.com/public/spullara/olympic-m...

Ah, should have done a quick search before bothering. Fun exercise anyway:

http://www.stubbornmule.net/2008/08/olympics-by...

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Tue, 07 Oct 2008 23:48:35 -0000

Your best bet would be one of the real windows environments. Presuming you don't want to reboot to do it that leaves you with Parallels or VMWare. For this application either would work great though Parallels has somewhat better desktop integration so would likely work best. You would still need a Windows install.

Re: Parallels vs VMWare vs Bootcamp vs Codeweavers Crossover Office revisited

sam — Fri, 31 Oct 2008 13:10:54 -0000

It sounds to me like you need a pretty extensive solution for all the integration between the various Windows programs that you are using. For something like this where it isn't just a single program in isolation I would recommend VMWare/Parallels over Crossover. With any of these solutions it is possible to directly share files between the two systems.

Re: Time Machine vs. ZFS + rsync

sam — Fri, 31 Oct 2008 13:15:00 -0000

@Mark: I am backing up to ZFS running on my Mac OS X box using the latest bits from http://zfs.macosforge.org/trac/wiki/ along with the Mac version of rsync on both sides. Additionally, I am only backing up things in my Users directory -- no system files, do I still need the additional flags?

@ssp: I actually think it would be quite system to use this tool http://www.osxbook.com/software/fslogger/ to track filesystem changes which would allow the rsync solution to be just that much better. Looks like I'll need to put a nice UI on it as well.

Re: Time Machine vs. ZFS + rsync

sam — Fri, 31 Oct 2008 20:06:32 -0000

@Cristian: 1) Didn't mean to imply that they were new, but they are new to the Mac. 2) That is ideal for a ZFS only environment -- hoping we can do just that in Snow Leopard. Right now though I'm still on Leopard and using HFS+ as my main filesystem.

Re: Agile database schema migration tool for Java

sam — Wed, 26 Nov 2008 01:57:45 -0000

Hi Miguel,

I'm pretty sure that MySQL doesn't support DDL + transactions like PostgreSQL does. If it does, I will fix it but that is my understanding.

Sam

Re: Track Subversion (SVN) changes with an RSS feed

sam — Mon, 08 Dec 2008 12:35:28 -0000

Indeed it was down. I need to put some monitoring in place. It should be up again now.

Thanks,
Sam

Re: Yuil is dead! 4hoursearch is now online.

sam — Mon, 15 Dec 2008 17:11:41 -0000

I have seen this error from time to time when Yahoo! BOSS takes too long to respond back to Google App Engine. Are you asking for a lot of results?

Sam

Re: Time Machine vs. ZFS + rsync

sam — Mon, 15 Dec 2008 17:16:07 -0000

I haven't done any more work on it but I am running it 24/7 on 2 of my machines (a MacPro and a Macbook Air) and the overhead seems to be very low. As for incremental deletes I basically decided that I would just run the full backup periodically rather than add the functionality. Full volume backups I believe are possible as I just recently used rsync to move my bootdisk. You need some additional parameters to make it work: rsync -xrlptgoEv did all that it needed to make a full backup.

Sam

Reference: http://rna.urmc.rochester.edu/john/public/pages...

Re: Using JAX-RS with Protocol Buffers for high-performance REST APIs

sam — Sun, 28 Dec 2008 12:49:28 -0000

Specifically, I didn't find an actual distribution of it on the Apache incubator[1] and most typical developers aren't going to depend[2] on something that they have to build from snapshots or by checking out the source code. That said, I could probably get it working in its current state with the current feature set. More documentation + tutorials couldn't hurt either :)

Sam

[1] http://incubator.apache.org/thrift/download/
[2] http://mvnrepository.com/search.html?query=thrift

Re: Using JAX-RS with Protocol Buffers for high-performance REST APIs

sam — Wed, 31 Dec 2008 01:52:08 -0000

If you also wanted a client that only understood JSON or XML to access your web service you could also write a provider that could translate to and from JSON to Protocol Buffer objects. Then in each method you would add those as supported media types and it would map it for you based on the Accept header.

Sam

Re: Using JAX-RS with Protocol Buffers for high-performance REST APIs

sam — Thu, 01 Jan 2009 16:32:38 -0000

Actually I think his point is that it is even less useful since the protocol isn't self describing like XML or JSON. There is no way to read it at all without knowing the format of the protocol buffer. As an optimization or in isolation though, I think that is ok.