The Launch Festival is a creation of Jason Calacanis. Formerly one of New York’s own, he started Silicon Alley Reporter way back in the dot-com era v1.0. Remember that? After some huge successes here, he moved on to become a huge figure in the Silicon Valley scene & the bay area.
Past events have included folks like Paul Graham & Mark Cuban & this years event is shaping up to fill Fort Mason Center to capacity again.
Reserve consolidates restaurant discovery, reservations, and payment all in one smartphone app. What’s more you can use it at restaurants in a few big cities, like our own New York, LA, SF, Philadelphia, Boston & DC. Not bad!
I’ve been spending some time trying to get answers out of AWS support, and let me tell you it’s no fun. Yes all this stuff is new technology, and nobody has expertise in it in the way say you might in Linux or Oracle or another technology that’s been around for a decade.
Still you’d hope the techs would have some clue. In the end it was a slog dealing with support, and I think I was the one teaching them!
This is a very tricky one. I mean after all you just spent all this time building your deployment package specifically for lambda, so what gives??
"Unable to import module 'lambda_function': No module named MySQLdb"
Turns out when you use a virtualenv, files will be installed into proj/lib/python2.7/site-packages/ or lib64. However Lambda wants them in the root proj/ directory! So move them there. I know I know. Weird, but that’s what they want.
After all the errors above were resolved, it’s not clear to me that the supported AMI’s are truly required. However if you’re hitting intractable problems building a properly lambda deploy, you might wanna look at building one of these boxes.
Now let’s roll it all together. Here’s are all the steps to build your deploy package.
- SSH to the instance
- mkdir test
- virtualenv test
- source proj/bin/activate
- sudo yum groupinstall 'Development Tools'
- sudo yum install mysql
- sudo yum install mysql-devel
- pip install MySQL-python
- cd test
- emacs -nw lamdba_function.py
- add your code to that file
- save the lambda_function.py
- mv proj/lib/python2.7/site-packages/* proj/
- mv proj/lib64/python2.7/site-packages/* proj/
- rm -rf proj/lib (don't need dist-packages in the deploy pkg)
- rm -rf proj/lib64 (don't need dist-packages
- zip -r proj.zip *
Luckily I got to cut my teeth on Redshift about a year ago. I was senior database engineer managing Amazon & MySQL RDS, and they wanted to build a data warehouse. Bingo!
Here’s the big takeaway from my discussion today. Recruiters have their fingers on the pulse!
1. We need an Amazon expert
Here’s what else I’m hearing everywhere. “We’re migrating to AWS, can you help?” Complexity & confusion around the new virtual networking, moving into the cloud, and tuning applications & components to get the same performance as before. All of these are real & present needs for firms.
Amazon bought Par Accel, a bleedingly fast warehouse. It uses SQL. It looks like Postgres, and handles petabytes. You read that petabytes! It’s so good in fact that it seems a lot of folks are now dumping Hadoop.
Incredible as that sounds, Redshift is delivering *that* kind of speed on that kind of big data. Wow! What’s more you skip the whole Hadoop cycle of write, test, debug, schedule job, fix bugs, and stir. With SQL you bring back the iterative agile process!
“I was surprised & a little shocked that you suggested we meet for coffee. Most developers are hard to get out to have a conversation with.”
Good communicators are as in-demand as ever! Being able to and happy to talk with people who aren’t deeply technical, and distill complex technical jargon into plain english. And do that with a smile too & enjoy it?
The president points out that it’s not just at trendy startups & silicon valley that you see code anymore. Car mechanics, nurses & everyone in the new economy touches code. It isn’t an optional skill anymore but rather a basic one.