Disqus - Latest Comments for schapht

Re: Servers for Hackers

Mat Schaffer — Wed, 30 Nov 2016 03:38:12 -0000

https://calculator.s3.amazo... says about $0.06/mo but feel free to fiddle with the variables and come up with your own estimate. Cost calculator is a handy tool.

Re: Platform Update on September 27th

Mat Schaffer — Wed, 28 Sep 2016 22:12:05 -0000

I moved back to Ubuntu 14.04 LTS v1609 platform and our elasticbeanstalk CLI deploys seems to be working again.

Thanks for the fix!

Re: Platform Update on September 27th

Mat Schaffer — Tue, 27 Sep 2016 21:28:10 -0000

I get the feeling this release may have broken the elasticbeanstalk cli:


Traceback (most recent call last):
  File "/usr/local/bin/eb", line 6, in <module>
    from pkg_resources import load_entry_point
  File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2985, in <module>
    @_call_aside
  File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2971, in _call_aside
    f(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 2998, in _initialize_master_working_set
    working_set = WorkingSet._build_master()
  File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 662, in _build_master
    return cls._build_from_requirements(__requires__)
  File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 675, in _build_from_requirements
    dists = ws.resolve(reqs, Environment())
  File "/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py", line 854, in resolve
    raise DistributionNotFound(req, requirers)
pkg_resources.DistributionNotFound: The 'requests<=2.9.1,>=2.6.1' distribution was not found and is required by awsebcli

Re: Servers for Hackers

Mat Schaffer — Thu, 18 Aug 2016 21:07:26 -0000

In the video he calls

bash /home/ubuntu/backup/backup.sh

which should only require read access (chmod +r backup.sh, likely already permitted since you created the file).

But if you want to invoke it directly make sure you use chmod +x backup.sh to set the execute permission.

Re: Unlocking New Features in Moz Pro with a Database-Free Architecture

Mat Schaffer — Sun, 24 Apr 2016 22:43:38 -0000

Sorry if this is in the article and I'm just missing it, but what's the size of the production data set?

Is it being distributed across the memory of multiple machines and Elixir (or perhaps something deeper in the erlang vm) is coordinating the access?

Or is it small enough to fit in memory on each machine and the multiple VMs are there for availability?

Re: Servers for Hackers

Mat Schaffer — Thu, 10 Mar 2016 09:40:05 -0000

If the host you're running the backup from isn't on EC2, this is the way to go.

But if you're pushing from EC2 to S3 you should definitely use an instance profile instead: http://docs.aws.amazon.com/...

As a bonus the aws-cli will detect and use instance profiles automatically, saving you the configuration step.

Re: First, Second Derivative, Convolution and Quadratic Fitting and all that via MCMC

Mat Schaffer — Thu, 26 Nov 2015 08:01:43 -0000

Thanks for this! Gave me a really nice base to start exploring options for fitting lines to operational data (e.g., disk allocation) from an ipython notebook.

Re: Etch Glass Like The Masters

Mat Schaffer — Tue, 10 Nov 2015 07:58:42 -0000

Nice work! Thanks for the post. First I'd heard about Nippon Quest and it looks really fun!

Re: The Remote Manifesto

Mat Schaffer — Wed, 04 Nov 2015 02:59:39 -0000

I've been working for US orgs with EU employees from Japan since I got here. Seems like the best time slot so far is ~1pm PST (4pm EST, 6am JST, 9pm UTC).

So far I've been doing one of those per week, plus daily standup via chat. I could see doing this configuration of "face-to-face" 2-3x a week if needed without too much life interruption.

Re: Ansible Vault and SSH Key Distribution

Mat Schaffer — Tue, 15 Sep 2015 23:39:01 -0000

Thought I should mention that the SSH components of this post basically changed my life.

Double so once I realized ProxyCommand could just as easily be a local shell script.

Can you say "automagic ssh across multiple bastions & hostname/ip schemes"? I think ya can.

Re: Creating Native Packages the Lazy Way

Mat Schaffer — Fri, 20 Mar 2015 01:36:10 -0000

Neat approach. Though I'm not _quite_ sure what ansible is buying you here over say, bash.

Does it stem from love of ansible or was there some part of this that would have been particularly nasty in a shell script?

Re: Compare U.S. & International Wire Transfer Fees

Mat Schaffer — Wed, 11 Mar 2015 10:00:30 -0000

Word from my sources (and some commenters below) is that Citi charges now but didn't used to. Might want to double check before switching banks :)

Re: Compare U.S. & International Wire Transfer Fees

Mat Schaffer — Wed, 11 Mar 2015 09:56:44 -0000

For US domestic, I have BillPay mail a paper check. Which they can usually photo deposit for free. Antiquated, but cheap.

For international Charles Schwab has fairly low wire fees ($25 international) and no fees on international ATM withdraws. So if you can find a Plus network no fee ATM in another country (e.g., Japan Post ATMs) you can move money between personal accounts for free up to your daily ATM limit.

So far Japan Post domestic transfers seem to be between ¥200-¥800 which isn't expensive enough to warrant a big search for cheaper means yet.

Re: Aimai: A Dynamic Intertwined in Japanese Culture and Language

Mat Schaffer — Sun, 01 Feb 2015 01:33:11 -0000

Cool post! Do you typically hear "KY" used to describe "空気を読む"? I tend to hear it used to abbreviate the opposite "空気を読めない" (can't read the air).

For example "あの人ちょうKYです" to describe a person who has little sense of the situation.

Re: Migrating from Perforce to Subversion

Mat Schaffer — Tue, 20 Jan 2015 13:28:15 -0000

Hi Jagtar, that line was commented out since it will fail if you've already done it (e.g., if you're already using git p4).

Looks like "svn: E205009: Local, non-commit operations do not take a log message or revision properties" is the first error. Try taking the -m option off the svn mkdir command. This script is > 5 years old so entirely possible some of the args have changed but I suspect the process is still usable.

Re: Time for sysadmins to learn data science

Mat Schaffer — Sun, 11 Jan 2015 19:13:05 -0000

For what it's worth, static threshold alerts are not broken/useless. But you do have to be careful about how you use them. Over the last couple of years I've gotten a lot of mileage out of both static alerts and double-exponential-smoothing-based alerts. https://github.com/Netflix/... has some details and I look forward to more of the tooling being open-sourced in the coming months.

Re: The !!! operator - The Pug Automatic

Mat Schaffer — Fri, 09 Jan 2015 18:25:31 -0000

+1 for "tri-not"

Re: Japan Year-End Tax Adjustments

Mat Schaffer — Sun, 21 Dec 2014 21:48:02 -0000

Great info. Thanks for the post! Any recommendations on finding an expat-friendly Japanese accountant?

Re: Migrating from Perforce to Subversion

Mat Schaffer — Fri, 17 Oct 2014 11:13:53 -0000

Fantastic! I'm surprised it still works after all these years. Enjoy!

Re: Rethinking My Kanban Board

Mat Schaffer — Fri, 27 Jun 2014 19:49:59 -0000

We haven't had to go as far as archiving yet, but I could see doing that once we finish our Rev1 and we want "pop the stack" as it were. The done column is handy since you can easily move tickets back if you realize there's a reason it's not quite done yet.

As for the color choice, it worked out that way because I picked the first one on the list as "In progress" and then decided easy/hard should be separate so I started at the end of the list. Not a lot of deep thought there :)

Estimate in the summary could work too, though the colors help make it very easy to get an idea of how much work you're looking at a glance. I worry that text wouldn't be as quickly parsable. Now, emoji on the other hand.... if only Trello would support that on summaries.

Re: Rethinking My Kanban Board

Mat Schaffer — Thu, 26 Jun 2014 01:25:08 -0000

Absolutely! I'll shoot you an email.

Re: Migrating from Perforce to Subversion

Mat Schaffer — Tue, 25 Mar 2014 10:28:21 -0000

The choice is about the team not the tool. This particular case was a team with a lot of context and infrastructure around subversion (this article was from 2009, btw. Pretty sure they're on git now). We picked up a project from a company that used perforce and this did the trick to pull it into the ecosystem.

Re: Rebooting

Mat Schaffer — Fri, 31 Jan 2014 04:18:46 -0000

Thanks! I should do some more blogging. Between work and devopscasts.com I've been pretty busy though. Working on a service-discovery-shootout episode now. Should be fun.

Re: Thoughts on Scalability

Mat Schaffer — Sat, 26 Oct 2013 01:30:30 -0000

Thanks, Mike! Yeah, seems that the only constant is change. :)

Re: Rebooting

Mat Schaffer — Mon, 09 Sep 2013 00:38:34 -0000

Thanks!

-Mat

about.me/matschaffer