BBC feature – Has mobile working come of age?
Interesting feature on the BBC site discussing mobile working:-
Rick Hurst Full-Stack Developer in Bristol, UK
MenuInteresting feature on the BBC site discussing mobile working:-
I love having this blog to remind me where I was at and what I was thinking a few years back. Just under four years ago I announced I was going freelance, and I checked in again about a month later, and then a year later, but haven’t spoken much about it on this blog since. It’s been an interesting ride to say the least so I thought it might be time to write down a few words about the highs and lows.
To put you firmly in the picture of the freelance web developer mindset i’m writing this while I should be working – this causes me anxiety for two reasons: firstly, a task I am supposed to be working on, already overdue, will become more overdue. Secondly, any time spent on this blog post is time spent not earning money. Another way of looking at it is that while i’m blogging i’m working on marketing, so maybe that negates the second point somewhat, but not the first.
Highs
Lows
The things I miss about permanent
Some of these points will vary depending on the employer, but one of the things I miss is the investment and support that an employer can bring – paying for me to attend conferences and time to learn new skills, the camaraderie with co-workers and the skills you pick up from co-workers. Then there’s the regular pay-cheque, which brings me to..
Money
The other big consideration with freelance is the regularity of pay – you might be set to receive a big payment, but what if it doesn’t turn up for six months? Another consideration is how much you expect to earn. People are always shy to talk about what they earn, and that includes me. Whenever a client asks me to quote day rates I can picture the cogs turning in their minds as they come up with an ad-hoc calculation of what they think I am earning. The truth is that it doesn’t always work out like you would imagine.
Much of the time I put in way more time than was originally quoted for, and natural gaps between productive work, meetings, holiday, illness, pitching for projects, unpaid maintenance, support, bookkeeping, procrastination etc. all conspire to even out what could be lucrative earnings into very average earnings. I never really know what i’m earning until after the year has passed and I do the calculations for tax returns. The carrot on the stick for a freelancer is always those potential earnings though – whereas with a permanent job your salary is capped (but guaranteed), there is always potential to earn more with freelance. However, my goal with freelance was always to earn a modest salary but take more time off. I’m still working on the second bit.
So would I ever consider a permanent role?
I’ve thought about this and have come to the conclusion that i’m probably unemployable. That last sentence isn’t going to sound too good on a CV is it! The reason I say this is that what I strive for in my freelance life I would also be looking for in a permanent role, and when I summarise what i’m looking for it sounds like a list of demands from a petulant celebrity:-
I think one thing that would clinch it though is the opportunity to work somewhere exciting, maybe abroad in the future – (mountain view sounds fun!), or working as part of a specialist team that would allow me to take things to the next level professionally.
The other thing that would possibly convince me to go permanent would be the opportunity to get my foot in the door of a company or organisation that would lead me back to my first choice of career in environmental science/ renewable energy – that’s another blog post though!
It would be rubbish to stop a tradition after only two years, so following on from my posts in 2009 and 2010, here is a retrospective for 2010 and my plans for 2011. I’m changing the format this time, by dividing into “achieved”, “carried over”, “ditched” and “new”.
Achieved
Carried Over
Ditched
New
If you ask any of my family or friends what it is that I do for a living, you will most likely get, at worst, a blank look, or, at best, maybe “web designer?”, “computer programmer?”, or maybe just “something to do with computers?”. It doesn’t help that my linked in profile has me claiming to be doing at least three different jobs at a time, and that I seemed to be involved with a number of different companies. I think possibly even those that work with me aren’t entirely sure what it is that I do most of the time! I thought i’d clarify what i’m up to at the moment, and how things have evolved over the last few years.
I am a freelance web developer
Primarily I make my living as a freelance web developer. This means that I spend most of my time building websites. By “building” a website I mean taking it from an idea to a finished website – planning, designing, templating, coding and uploading to a web server so that it is live on the internet. As well as web “sites”, I build web “applications”. These are computer programs that people interact with through a web browser. A web browser is the computer program that you use to look at websites e.g. internet explorer (the blue E), firefox (the fox wrapped around the world) or maybe safari (the compass). As well as looking at websites on the internet, you may be using a web browser to use web applications in your workplace.
But am I a designer?
I occasionally design websites, but it isn’t my specialism. If budget allows I prefer to hire a really good designer to come up with the design concepts. I know lots of good designers. I take their design concepts and run with it to put all the technical stuff in place to take it from an idea to an actual website. When I work for a design agency, I am hired always for my technical skills, never for my design skills – let’s face facts, I think there’s a reason for that! Most of the work on my “portfolio” wasn’t designed by me – I usually just did the technical bits.
Do I do any computer programming that isn’t related to web sites or web applications?
Increasingly more. I seem to be doing more and more data crunching these days, involving writing scripts that move files around on servers and extracting data from different places and putting things in databases. I would call that programming. Most of this type of programming is actually using skills I learned while building web sites and web applications, but some of the things i’ve built aren’t web sites or web applications at all.
So am I actually freelance, or do I work for a company?
By freelance, I mean that I work for myself, but companies and organisations employ me on a freelance basis. Therefore sometimes I may appear to be working for several companies at once. Sometimes I work directly for my own clients, other times transparently as an additional resource for a design or digital media agency. Either way, I invoice for the work I do on either a fixed price or a “time and materials” basis, and this is how I make a living.
What is Olivewood then?
In 2007 I co-formed a company called Olivewood Data Technologies Ltd, and all my freelance work is invoiced through Olivewood. Olivewood is co-owned by a client and friend, and we set it up primarily as a vehicle for consulting and development services, but also as a legal entity to own the IP for a number of niche eCommerce web applications that we plan to sell to other companies. At one point we thought Olivewood might be a digital media agency, but now we are pretty sure it is a software consultancy. [Update 2014 – Olivewood is now a supplier of high power LED lighting specialising in lighting for cold storage warehouses – how things change!]
And what about Foundry?
In May 2010 I sat on the watershed balcony with fellow freelancers Dan Fairs and Dan Hilton and talked about teaming up to be able to take on and pitch for projects bigger than we could handle as individual freelancers. We came up with the name Foundry, and shortly after collaborated on a successful project together. We all still work as freelancers, but hope to spend more time working together under the Foundry banner in 2011 and beyond. The challenge is moving the focus from looking after our own interests and incomes to working together, and to do that we need a big project that would keep us all too busy to take on other freelance work.
Will I fix your computer?
No I flippin’ wont! Have you tried switching it off and on again?
A couple of years ago I created a website for Kudos Business technologies. The site has been fairly dormant for a few years, but as I am now “involved” with Kudos (more on that at a later date), recently I decided to redesign it and rebuild with wordpress 3, as the bespoke CMS I put in place before using using cake PHP wasn’t nearly as user friendly as the tried and tested wordpress. I’m really pleased with the result, both from a technical and aesthetic point of view.
I’m looking forward to expanding this site – the products database on the Kudos site is now quite out of date, and there is a much larger range of (mostly LED lighting) products over at the Kudos retail site. The Lightplanet store is hosted on a 3rd Party system which doesn’t have a decent product export api, so I’ve actually written a screen scraper to extract data from the lightplanet site to use in our own database. This will allow us to collate more technical data for the products, which can be used on the kudos site. Phase II is to create a comprehensive Products information site from this data, including an API to allow us to integrate with 3rd parties.
[update 2014 – links removed as these sites no longer exist]
Some notes and thoughts from day of plone conference 2010. These are mostly in note form, but wanted to get these online anyway, while they are fresh in my mind.
What happens when something breaks, and a simple google search doesn’t offer any results?
First, warn people (so they don’t bother you while you fix it, and they don’t panic).
Work out how quickly can you access your backups? I think this is very important – personally for smaller sites i’m doing individual site backups as packages mainly to make it convenient to restore them in a local dev environment, but I know some people are relying on whole server backups on tape. This would be laborious to restore in an emergency.
Isolation by elimination -> network, hardware, software, data
map out your system!
Eliminate things by switching them off – write your code so that it can handle dependencies being switched off.
Set up a system so that you have an isolated instance (so you can look at logs of only your own activity, rather than mixed with everyone elses)
Create a dashboard (maintenance page)
Monitoring
Write Test case’s to diagnose faults
Start writing a “help” email, but don’t send it. This is apparently known as “rubber ducking”. I do this all the time, I often spot my mistake when I past in a traceback to an email message to send to someone!
“horizon of intervention” – At what point do you need external help?
Get to know people with specialisms and buy them a beer! Participate in the plone community (I really need to do more of that).
Create tickets and close them as you go
Document your processes.
cachefu – useful tool, but as far as “internet time” goes, this is a little long in the tooth now (started 2006). End of life – critical bugfixes only
plone.app.caching – will be in future plone releases, but available now
load testing with funkload (not accurate regarding CSS/ image discovery)
load testing with multi-mechanize
BrowserMob – not free
This was extremely interesting – Eric is the project manage for Plomino – a plone add-on that provides application development toolkit for creating database applications within plone – i.e. the types of database applications that non-technical people might create on there own machines with Lotus Domino, Filemaker or Access. The data is still stored in the ZODB, but models and forms can views can be created through the web. Formulas are done in python.
I can see this being really useful – all too often I end up building custom applications based on complex access database or excel spreadsheets i’ve been provided, but if I can persuade clients to use Plomino, then not only will it help get that data in a format suiteble for building a web application, but data can be collaborated on across teams, rather then emailing around (and inevitably forking spreadsheets and databases). There were some nice examples of data visualisation – a great quote “almost useless, but very nice”” – you need these to impress your boss.
I wrote some notes on this yesterday, connected to Nates Deliverance talk, so won’t go into this here, other than to quote Laurence: “we write XSLT, so you don’t have to”
Amberjack is a Javascript library for creating a site tour/ tutorial. Collective amberjack wraps this up as an add-on for plone. Interactive tutrials can be created.
An example was given using the windmill testing framework (windmill in itself looks nice alternative to selenium).
Most of this was over my head, but one important note I made from this is about urlib (which I use in a django screen scraper app i’m developing) can have two possible error responses – URLError and HTTPError – two possible error responses.
There seems to be a bit of a theme going here – an acknowledgement that Plone works out best long term if you use it as a “black box” CMS, and don’t try to do everything with it. The upgrade path is easier if you don’t add on your own customisations – “clean plone”. The current plone ecommerce offerings are not as good as external systems, so it is better to integrate with an external system, which is also then kept clean to allow easier upgrades.
In the python world there are some Django Ecommerce stores LFS and Satchmo, but the store doesn’t have to be Python – other proven systems such as magento can also be integrated with Plone.
To integrate with plone you need to integrate search, linking, thumbnailing. Valentine achieved search compatibility by creating objects in plone via an RSS import – see valentine.rssobjects. A latecomer to the talk asked “but which plone ecommerce product would you use if you had to?”. Answer “we wouldn’t”.
manage online transcoding
http://plone.org/products/collective.transcode.star – looks interesting, and may bring plone back into the picture for a project i’m doing.
osx style finder widget for navigating/ organising content in plone – looks great!
Just back home after day one of Plone Conference 2010, with my mind buzzing so thought it would be a good time to write up some of my thoughts and notes. It was really difficult to choose between the talks on offer on the three different different tracks, but here are some thoughts on the ones I attended.
Two main themes here – ubiquity/availaibility and designer friendliness.
To make Plone more mainstream it needs to be available to non-technical end users through the same means that other systems are already available – namely being able to deploy easily on cheap hosting, specifically the one-click installers on shared hosting in cPanel and similar. This would allow users to easily evaluate Plone for their needs in the same ay that they can already with wordpress, drupal and joomla – apparently there is a new joomla instance created about every two minutes. I must stop Alan Runyan and see if he has thought about microsoft web platform installer – nowadays this includes the option to install wordpress, drupal, modX, and load of other systems, including downloading and installing dependencies. It would be great if Plone was in that list.
One of the aims of Plone 5 is to make it more designer friendly. I think this is really important – even though since the release of plone 4 i’ve started using plone again for intranets and extranets (mainly straight out of the box with a few minor cosmetic tweaks), I currently still use something like wordpress, or a home-rolled CMS for website builds. That is now going to change – the theming story is being completely re-written by the introduction of Deliverance/XDV/Diazo (already available – more on that later), and Deco (TTW layout and content editing). The aim is to make Plone appeal to designers as something that helps, not hinders them.
Quote of the talk has to be from Limi – “Plone doesn’t suck, because the developers don’t hate the core technology” (or something like that) – in reference to the revelation that many drupal/wordpress/joomla developers admit they actually hate PHP, whereas Plone developers love python.
The next talk I attended was Rob Gietema’s demo of Deco. This is looking really good, although i’m a little bit skeptical of drag and drop and in-place editing (I like front-end based editing, but prefer lightboxed modal editing to in-place), mainly because i’ve seem layouts explode and page elements disappear, or refuse to drop in the correct place on similar systems in the past. However, I haven’t actually tried this one yet, maybe i’m just clumsy! I think in general designers and content editors are going to love it.
I attended Clayton Parker’s talk on LDAP and active directory integration – can’t say I absorbed much, but i’m sure i’ll be asked to do this one day, so it’s good to know that this is tried and tested and the tools are already there.
Nate Aune gave us an overview of Deliverance. I’ve known about Deliverance for ages, but the penny dropped for me today about how useful this is. The basic principle is this – deliverance acts as a proxy to transparently take HTML output from a website and merge it with HTML from a theme, according to a simple set of rules. In the case of plone, this means you can create a theme in static HTML and have content from a default theme Plone site displayed wrapped up in the static HTML. Simple rules can be applied e.g. “take the news portlet from the plone site, drop the header and footer and all the images and display in the element with and id of “recent-news” from my HTML theme. magic!
Nate quoted one example where the HTML theme is stored in a dropbox folder which the client has access to to make tweaks and changes. I can see front end developers and designers loving this.
There was much discussion at the end over which technology should be used for this – XDV is a fork of an earlier version of Deliverance, which has slightly different functionality. XDV, which is to be renamed Diazo, will be the theming engine for Plone 5. With that in mind, i’ll concentrate my efforts on Diazo. I’m excited by this for non-plone reasons – a majority of my works seems to involve integrating technologies that don’t belong together – this will really help.
Martin Aspelli gave a talk on dexterity – the (eventual) replacement for archetypes. This is already available, but not mature yet. The talk was mainly conceptual rather than code-led, focussing on best practice for designing your site or application – when it is suitable to create a content type, and when you might be better off creating a form, or using a relational database. Best quote “code is like a plastic bag” (reduce, reuse, recycle). Write less code.
Another talk from Clayton Parker – transmogrifier is a system to package up migrations of content from other systems. My thoughts on this were that it looked like hard work for a one off import (usually i’d write a one-off python script for something like this), but creating packages would benefit the plone community e.g. if there were packages available covering migrations from a standard wordpress, drupal or joomla, this would benefit plone. I suppose this could also be used to import content from older instances of Plone, where the upgrade path is broken.
Sasha Vincic talkd about strategies and gotchas for multilingual site builds. Even though Plone has tools for this, there are common scenarios, such as the “missing page” scenario where a translation of a site may not have the same number of pages as the base translation. He also covered common issues such as escaped HTML being translated by third parties and being delivered content where HTML attributes have been translated, therefore breaking the HTML.
This was an inspirational treat for the end of day one – Richard Noble is a fantastic speaker, and after a day of CMS talk it was great to hear his story of the challenges of his past world land speed record record achievements, and the current one – the Bloodhound SSC project. As well as building insane rocket powered cars (the current one has an F1 engine onboard just to drive the fuel pump!), his goal is to inspire children and young people to become engineers, as there is an impending massive shortage of engineers in training. I was also interest to hear that there will be no patents on the technology developed for the new car – the advancements will be made avaiolable for anyone in the engineering industry to build on – sound familiar?
Mike 2010-10-27 21:29:18
Maurits van Rees 2010-10-27 21:42:13
Rick 2010-10-27 21:58:26
I agree with you re: transmogrifier which is (partially) why I wrote http://pypi.python.org/pypi/parse2plone
Keep the blogs coming 🙂
Alex Clark 2010-10-28 00:50:01
I’m having to write this blog post as a brain dump – those annoying boffins at apple have got my brain in a recursive loop because they’ve released an 11 inch macbook air. I’ve always loved the idea of a very portable workstation, i’m happy to compromise on a bit of power for something small and light that I can work on anywhere.
By work, I mean web development – switching between highly visual work on the appearance of web sites, including using the very bloated and power hungry photoshop, to writing code and administrating databases. Although most of the time I work at a desk, with my laptop attached to an external full size monitor and keyboard, I also often work on site for design agencies, with or without an external monitor and I like to work from cafe’s or wherever I happen to be.Therefore my brain is looping around like this:-
I used to have a 12 inch powerbook, it was great – it was small, looked good, had decent battery life (for 5 years ago) but was a little bit underpowered and if I was to do a full days work on it without an external monitor to hook it up to it got tedious, as it only had a resolution of 1024 x 768
When I replaced it with a 2006 plastic macbook, that little bit of extra screen estate was enough to make it a viable machine to work on all day if I couldn’t hook up to a monitor. I bought another one a couple of years later – the original one would only take 2GB’s of RAM, so struggled with Virtual Machines, I got the second one second-hand and I now therefore have a spare, which is mostly used by my wife. They have been great and i’ll hopefully get another year or two out of them.
I have bought two netbooks in the past – a 9 inch acer aspire (which I sold to a friend while drunk), and then just before my road trip this year I bought a ten inch dell inspiron. Although capable, neither of them are pleasant to work on at all. They make good “emergency” machines, but the keyboard feels cramped, and the trackpads have both been virtually unusable. The vertical screen estate is just too small, so using forms on websites and web applications is fiddly, so even blogging with wordpress isn’t pleasant. The dell has really good battery life however, and it is small and it was less that 200 quid, so it still makes a great second emergency laptop.
Whatever I buy needs to be able to run my full development toolkit- apache webserver, mysql and postgres databases, photoshop, code editor, virtual machines. That rules out an iPad, which doesn’t run osx (or windows/linux for that matter).
So onto the macbook air – the first thing is that it looks gorgeous – like a slimmed down 12 inch powerbook – ridiculously thin and light. It seems very futuristic, but functional. at £849 in VAT for the base model it is therefore the cheapest macbook available – same price as the base model plastic macbook. I said cheapest not “cheap”, by the way!
The 11 inch macbook air has a full size keyboard and a decent trackpad, therefore it should be ok to type on, and navigate intricate interfaces. It has a native resolution of 1366 by 768 so it has more horizontal pixels than my macbook, but slightly less vertical pixels. Only slightly though – I guess i’ll be going to the apple store to see how that feels in use.
It has “up to five hours” of battery life – I think this will mean a couple of hours in reality, with the type of work I do – not brilliant. I think the efficiency and lower capacity battery means that I might have more success charging or powering it with my solar/ battery gadgets though.
The base model only has a 64GB “disk” – that would be pretty easy to fill, even if I have my music/ videos/ vm’s on an external disk. I guess an external disk would be key to this – it couldn’t be my “main machine”, but I would want it to be the machine I pick up and take with me most of the time, so i’d need to adopt a way of working that means I could quickly pick up where I leave off when I switch machines. The price starts to creep up if I choose the upgraded options – more ram, higher capacity disk etc.
By the way, i’ve only mentioned the 11 inch version. There is also a 13 inch version which is higher spec, but also higher price and if I wasn’t going to have the really small one, i’d rather get a high spec 13 inch macbook pro, for that budget. At least i’ve managed to rule that one out.. I think.
So the conclusion is that it would be a stupidly expensive indulgence for something that couldn’t be my main machine. I should be ashamed of myself – i’m not an apple fanboy (honest!). I’ve never queued inside an apple store for anything, let alone outside. I just don’t need one. It would be stupid to spend my hard earned cash on something so unnecessary.
I tell myself all of this each time I get to this point of the thought loop… but then I look at the pictures and video, tell myself that £849 minus VAT (I can reclaim through my limited company) isn’t *that* much for such an amazing gadget.. and i’m back to the start. I wonder if it’s possible to put a restraining order on myself preventing myself from going within 200 metres of the apple store…
The second phase of swoop travel has gone live – working again as part of Foundry, this django powered site got some new features and a bit of a makeover (by yours truly – i’m almost in danger of calling myself a web designer after this one!).
Earlier on this year I was fortunate enough to be asked to help the Aardman Digital team out on the companion website for the Tate Movie Project . This was one of the most fun and technically challenging website builds i’ve worked on. Working as part of the team, along with several other Bristol freelancers, I helped integrate the cakePHP site with wordpress and vanilla Forums. This was also one of the largest site builds i’ve worked on – multiple flash developers, PHP developers, designers, animators, front end developers and producers, all coordinated by subversion, unfuddle and the biggest wall of printed out screen grabs i’ve ever seen!
http://www.ldexterldesign.co.uk/2010/07/part-1-how-to-freelance-successfully/
Best,
ldexterldesign 2011-03-04 04:34:22