Building a Python 3 REST application that scales “good enough”

Often developers get caught up in discussions about scaling their applications – usually before one line of code has even been written. Of course its helpful to keep the scalability of an application in mind, it however shouldn’t be a primary focus – at least initially on (most) new applications. I say this simply because the vast majority of applications out there will run just fine under most scenarios with minimal horsepower behind them. Most of us are not building Reddit, Twitter, or Amazon. In fact, you’d be surprised at how even some large projects like Twitter started out and eventually scaled. Suffice to say no at Twitter originally probably could’ve prefigured out how to have scaled Twitter to the levels its at now. Many times you’ll find that handling a few hundred requests per second will handle many corporate (or otherwise) workloads and you’ll never need to go beyond that.

Continue reading

Posted in Open Source, Python | Leave a comment

Python Multiprocessing: A Second Look

A while back I blogged about Python’s multiprocessing. I was talking with a friend the other day and was looking over his team’s Github repos and came across an interesting use of the multiprocessing package. I broke the original code down into a very small and easy to use example that you can use to power your own creations. Its not really anything somebody couldn’t figure out on their own, but my blog has always been popular with people new to programming so I think this could help new Python developers out.

Continue reading

Posted in Open Source, Python | Leave a comment

Clustering Graphite – The Easy Way

Graphite is used extensively by many companies. Right now, I’m working on a large Cloud based project that collects metering/billing data from several sources like EMC ViPR, OpenStack, etc. In order to quickly generate reports we cache some of the metering data inside Graphite. Today, I’ll go over how to setup a simple Graphite cluster and test it using Vagrant.

Continue reading

Posted in Open Source, OpenStack, Python, Ubuntu | Leave a comment

The two minute guide to using Viper – configuration management with Go (golang)

A per the website “Viper is a complete configuration solution. Designed to work within an application to handle file based configuration and seamlessly marry that with command line flags which can also be used to control application behavior”. You can load configuration files in: YAML, TOML or JSON. Viper allows you to easily add configuration management to your Go (golang) based projects.

Continue reading

Posted in Go, Open Source | Leave a comment

Getting started with etcd and Python

In a nutshell etcd is an open-source distributed key value store and is written in Go. You can run a single instance but it really shines when you set it up in a cluster and it will gracefully handle master election during network partitions and the loss of the current master. Today we are going to install etcd, use the CLI tool it ships with, and then do some simple Python scripts to interact with etcd.

Continue reading

Posted in Docker, Open Source, Python, Ubuntu | 1 Comment

Isolating your Ruby gems to a local project folder with a sample Sinatra app

In my previous blog post I wrote about installing rbenv on OS X 10.9 (Mavericks) to manage multiple Ruby installations easily. Today, I’m going to go over how I setup an initial Sinatra application while keeping the installed gems in the Ruby project and not going into the default system’s gem repository. I work a lot with Python so I tend to like how the separation of installed dependencies are handled using virtualenv and kept in the local project’s isolated instance. For more information on that see my blog post here.

Continue reading

Posted in Open Source, Ruby | Leave a comment

Installing rbenv on OS X 10.9 (Mavericks) to manage multiple Ruby installations easily

I’m a big fan of pyenv so rbenv was a natural fit for the style of how I like to setup my development environments (on numerous computers). This allows me to easily switch between versions of Ruby depending on which project at work I’m working on.

Continue reading

Posted in Open Source, Ruby | Leave a comment

The 10 Minute Guide to the Observer Pattern in Python

Today I want to cover the Observer Pattern in Python. I’ll be using Python 3 but this should work equally well with Python 2.6.x and newer.

According to Wikipedia the Observer Pattern is: A software design pattern in which an object, called the subject, maintains a list of its dependents, called observers, and notifies them automatically of any state changes, usually by calling one of their methods. It is mainly used to implement distributed event handling systems.

Continue reading

Posted in Design Patterns, Open Source, Python | 1 Comment

Review: Developing Responsive Web Applications with AJAX and jQuery

On a recent business trip I read the recently published book “Developing Responsive Web Applications with AJAX and jQuery” by Packtpub and authored by Sandeep Kumar Patel. Today I’m going to do a quick review on the book.

Continue reading

Posted in Apache Tomcat, HTML5, Java, Mobile, Reviews | Leave a comment

How I configure my envrionment for Python development

Everyone has their own way of setting up their development environments and I’m no exception. In this article I’m going to go over the steps I take to setup a new Python development environment on OS X and with a couple minor modifications this should work on Ubuntu as well.

Continue reading

Posted in Open Source, Python | 3 Comments