Sleep statistics for 30 – 31 Jan
Went to bed / woke up: 01:18 / 08:27 | Total time: 7h 08m

Sleep statistics for 31 – 01 Feb
Went to bed / woke up: 23:21 / 06:30 | Total time: 7h 08m

Can you guess when I woke to tend to our son? Now I *know* when I woke at night…

We are a small development team, at Harvest Digital, handling multiple tasks throughout the day, across different environments and projects. It makes for an exciting challenge. Our roles/ skills are clearly defined and our small size means we can react quickly to change, with little margin for communication errors and so on (see Getting Real and Less is more: Jumpstarting Productivity with Small Teams). But, when it comes to deploying to a staging or production server, I am ashamed to admit that we had often introduced a huge potential for human error by doing much of the work manually. Each project is different and so there is no consistent deployment process across the board.

Deployment is often the last step in the process to get any attention and it is one that can be unnecessarily tedious and prone to error. With more agile development projects, where deployments may be required several times a day, we obviously cannot afford the time nor the potential mistakes that may be made by manually deploying a project.

At its simplest level, deployment may just involve making sure that the target server (i.e. staging or production) has the latest revision of files from the project’s source control repository (we use SVN). But factor in tests and database migration and you can see how easily things can go wrong. Especially if you are deploying several times a day. You need to automate as many steps in the process as possible, thereby eliminating any manual tasks that introduce potential error and duplication.

Whenever we reach a point in a project where the code can be considered stable, we should tag it in SVN as a release. This gives you the ability to deploy a particular release based on its tag, instead of just the latest revision in the repository. By convention you never create revisions in the tag folder – tags are simply named snapshots of the source repository. We typically use version numbers as tags with some scheme based on feature-set or milestone and release date that can be ordered alpha-numerically e.g. “rel_belfast_2.04″. This allows us to say with certainty what is deployed at any one time, without having to scan logs etc. Tags give context to a release name (you can easily associate the release with project milestones) that revision numbers and timestamps do not. Tags are usually kept in a ‘tags’ subfolder, in the top level of the repository.

For a while now at Harvest, we’ve been working with symfony – an excellent PHP framework – that includes a few tools to help simplify the deployment process (such as Pake). These tools allow for remote syncronisation of files with rsync (the benefits of synchronisation over standard FTP are much touted elsewhere) via SSH (with the shell command: e.g. symfony sync staging) and semi-automate the build process (including database schema changes, data dumps etc: e.g. symfony propel-build-all myApp) by using Pake on the target machine.

But there is still a lot of room for improvement, particularly when it comes to database migrations and SVN integration. Plus, symfony is not our only set-up. We need an automated deployment process that can be applied across all our projects. This is where I’ve previously seen shell scripts being used but Phing can do much of this heavy lifting work for us, as it has many standard deployment tasks built-in to it. According to the Phing blurb:

Features include file transformations (e.g. token replacement, XSLT transformation, Smarty template transformations), file system operations, interactive build support, SQL execution, CVS operations, tools for creating PEAR packages, and much more.

Phing (PHing Is Not GNU make) is a project build system based on Apache Ant and is available through the PEAR installer. If you use --alldeps on Phing, it’ll grab, funnily enough, all the dependencies. But most are good packages (e.g. PHPUnit, PHPdoc and VersionControl_SVN). It can be used in a multitude of ways, including unit testing, creating docs, running SQL – which allows us to keep database schema changes in version control. The beauty of Phing is everything can be configured easily through the build.xml file (and then further with properties files) – so that the project’s deployment configuration can be kept in version control too.

In short, we love this thing called Phing!

For more detail on advanced tasks such as database migration take a look at these posts from Federico Cargnelutti and Dave Marshall.

Jet Set Willy (1984: ZX Spectrum), Sonic the Hedgehog (1991: Sega Megadrive), Monkey Island (1990: PC), Doom (1993: PC), Worms (1995: PC), Abe’s Oddysee (1997: PS1), Grand Theft Auto (1997: PC), Rainbow Six (1998: PC) and many more; they all chart a certain personal view of the evolution of console and computer gaming. And it’s incredible to think how things have changed.

I can mark eras of my life in the same way you might signpost your autobiographical memory with where you were living. Sad but true. It tends to be just the one game as I don’t devote masses of time to gaming – when I find a game that I like, I stick with it.

Recently, I persuaded my wife that a PS3 would be a great addition to our family because “a PS3 is so much more than just a games console – you can use it to view all those digital photos and videos of our son”. And I’m glad I did as I think I’ve found the game to mark the next era - LittleBigPlanet. This game is incredible. It has brought the traditional platform game into the future with a fun, creative and collaborative online world that is constantly changing and ever evolving. Irrespective of what it represents in terms of amazing media and technological innovation, it also represents a return to pure and simple platform based game-play, with a few twists. And, possibly most importantly, it is impossible not to feel happy playing this game. It looks like we’re going to have some fun with this one…

1) Open source paves the way for the odd utopian dream:

Sir Thomas More’s description of Utopia as a place where “nobody owns anything, but everyone is rich” is not a bad way to describe the open source movement in which people around the world collaborate with each other to produce services that anyone can use – or improve on – for nothing.

2) Open source is recession proof:

One of the interesting things about the collaborative movement is that it is probably recession-proof, though you won’t see it in economic statistics because it mostly does not involve cash transactions.

3) Open source is robust and well-trusted by large successful organisations:

Big corporations, such as IBM, Google and Amazon, are devourers of open source software because they find it cheap, efficient, low-maintenance and reliable. But UK government departments, including health and the foreign office, have proved risk-averse with hardly any open source in their infrastructure.

4) Open source is socialism (well, social collaboration at least):

…open source combines the cooperative spirit that was at the heart of the Labour party in the past with the entrepreneurial skills needed today.

And with nothing more to add to that summary, I’m off to join the revolution (well, okay, I’m off down the pub to carry on ranting to anyone who’s too polite to stop me).

Whatever you say about Twitter, I was enjoying the ability it gave me to receive updates via SMS. In fact, it was this feature that won me over to using it and helped demonstrate what it was all about to mates. I figured that the initial free SMS alerts that appeared in my Twitter account would run out one day and then I’d have to pay for more credits – easy business model. I’d happily have paid too. So why pull it? Maybe its all part of some ploy by Twitter to gather a crowd reaction – so that when they announce payment plans for SMS alerts, they already have the crowds’ support. Yeah – okay, that may be a tad cynical but I do hope they listen to their UK users (and, in fact, anyone who used the UK based SMS alerts). The reaction is already gathering pace – with comments and tweets a plenty – and now a Facebook group. SMS is huge here and it seems to be a glaringly obvious way to actually turn Twitter into a revenue making business, in the UK at the very least.

And with this promise of an enhanced search presence will come the marketing need for publishers to create content that capitalises on this. Just as SEO emerged as an industry all of its own, I expect Semantic Web Optimisation to emerge as an industry all of its own in the very near future.

[Before submitting this post, I quickly searched on the topic (yes - I appreciate the irony of having used Google!) and came across this article - essentially saying the same thing as me above. But please can we not fall into the trap of applying version numbers after "Web" for every evolution in web technology that occurs!]

Scary or exciting?

• Dynamic webserving
• Persistent storage
• Automatic scaling and load balancing
• APIs for authenticating users and sending email
• Fully featured local development environment

Python is the only language supported at the moment but they say more languages will be supported in the future. With the weight of Google behind it, this service looks set to provide an excellent all-in-one route to rapid web-app development. So long as you are happy using Python and all of Google’s Web services.

Yet another critical web app has a brief spell offline…

Again – while annoying – I do find a slight comfort in the fact that even the big boys have bad days.

37signals System Status, originally uploaded by markrocky.

One reason why you shouldn’t rely on all this fancy web 2.0 stuff for your business…

Although I do get a certain reassurance from seeing that even people like 37signals can have bad days (sorry 37signals)!

Lately there’s been a spate of negative blog entries and articles slating Facebook – and the furore surrounding Mr Scoble’s recent quarrel with Facebook pushed things even further. [Although some may argue that this simply served as an excellent PR pre-cursor to last week's announcement that Facebook (along with Google) were to join the Data Portability initiative.]

Is this the beginning of Facebook fatigue? In 2008, will Facebook go the way that Second Life went in 2007? Or is this simply the natural media/ public reaction to “hype”, as described in Gartner’s Hype Cycle, and we’re now in the “Trough of Disillusionment“? I have to admit that the tedious slew of unanswered invites in my inbox from zombies, pirates and vampires has sent me sliding down my own trough of Facebook disillusionment. Although, rather lazily, I do find it handy to have friends’ details in one place on the web – I use Facebook to arrange meeting after work or even to message someone, for example, as it is easier than digging around for their contact details. Will I still be doing this in 12 months? I certainly wasn’t a year ago, so who knows? Maybe Gartner does.

Please note that this is your final notification of the withdrawal of the Zimki service, which will occur on the 24/12/2007.

All user applications and data remaining on the Zimki service will be deleted and the servers decommissioned shortly after this date.

It certainly highlights the importance of building your fancy-pants web 2.0 application on solid and reputable services.

Tim Berners-Lee stated in a post yesterday that

…we have the technology — it is Semantic Web technology…

In other words, the connections and relationships made possible by the semantic web (or social graph – use interchangeably from hereon). He goes on:

Now, people are making another mental move. There is realization now, “It’s not the documents, it is the things they are about which are important”. Obvious, really.

and on opening up this data:

It is about getting excited about connections, rather than nervous.

So, yes – I am excited but how are we going to do this? Think data feeds, microformats and openID – things that would tend to be met with blank stares if I were to suggest them to clients. But show a client how you could remove barriers (such as log-in/ sign-up) to that all important “conversion” (with openID or microformats – here’s an excellent microformat implementation doing just that) and show how this person would be able to instantly tell all their friends about it (via their social graph) and then they’ll be interested.

Prism (formerly, Webrunner) lets users “split web applications out of their browser and run them directly on their desktop”. In this web-as-platform era, it might initially sound counter intuitive to break out of the browser but many online applications are increasingly seeing new life as desktop apps. And, squaring up against Adobe AIR, this prototype from Mozilla is definitely one to watch. I’m not suggesting they are the same (the prototype Prism simply looks like an elaborate bookmarking thingy right now) but they do both all present a significant step in a certain direction – particularly when you consider the possibilities that Prism coupled with Google gears might offer within Mozilla (a.k.a. Firefox 3?).

Joel Spolsky wrote an interesting article suggesting that “as bandwidth increases, a compelling SDK should emerge that will provide developers with a standard interface for online apps”. While his case is one for a Javascript development framework or SDK for online apps and he doesn’t mention AIR, Gears or Prism, it seems to me that these desktop runtimes are the beginning of a new wave in the world of Javascript based web applications, hefty frameworks and their migration to desktop apps…

Anyway – I’ve have been having a bit of a play and it looks rather nice indeed. Not that I’ll be watching TV all day – it’s all purely in the name of research, of course!

I’ve also got a bunch of beta invites for anyone who wants to check it out for themselves – just let me know your email that you want to use for your Joost account…

In my mind, this represents an interesting step forward in the cross-overs between web 2.0 apps and 3d browsing. It also raises interesting questions about where Microsoft might be headed in the 3d browsing space (aka “3pointD”). Particularly considering the rumours around Google’s developments in this field – where Google Earth and SketchUp could be brought together to create a “Google Planet” – a virtual-real-world Second Life, if you will. As has been suggested – maybe, in the not-to-distant future, “every Google Account [will] include a plot of land on Google Planet?”

If anyone has any “web3.d” ideas, you can catch me down the Red Lion this afternoon to discuss further. That’s the Red Lion in Second Life, of course.

I’m sure we’ll see many other organisations doing the same thing in the near future as people turn to bookmarking sites like del.icio.us as their first port of call for search – where “page rank” is effectively determined by the users themselves and you can be guaranteed better results. I can even see a niche emerging for optimisation services for these sites, just like SEO became a niche industry around Google page ranks.

The advent of broadband has made delivery of video and other digital media possible via the internet but viewing via your desktop or laptop computer screen is not always practical. Equally, browsing and searching the web from your sofa via the TV is not exactly an easy or sociable thing to do. Surely the best solution is one where you would search on your PC then sit back and view on your TV? I know this is exactly what many people are already doing but it often means situating the PC near the TV so that you can run a cable from the PC’s AV output into the TV. What I want to do, and I’m sure a solution must exist (please tell me if it does – otherwise I hereby patent this idea!), is utilise my Wi-Fi network to stream content to the TV. Maybe via a SCART device that doubles as a Wi-Fi antennae, receiving data streams via the local network? Surely such a simple single device must exist? It’s all I need – not some “media hub” or “home entertainment centre”. It seems to completely bridge that gap between the different tasks of searching/ interacting (i.e. “lean forward” tasks) and watching (i.e. “sit back” tasks). Please – somebody help!

On a similar note, I wonder what BT will use to deliver their video streams? It would be quite fitting if they used BitTorrent (BT – geddit?) really. Although, it looks like NTL are one step ahead on that one.

why buck a trend at a geek fest?
everyone else is blogging here, so here’s my quick notes to self:

• the event
• the speakers
  • self referential blogospheric egos
  • yahoo is everywhere
  • motivation? hippies need cash too
  • tag.alicio.us
  • iam(certainlynot)cal.com
  • does every ruby need a rail?
  • flex your flash (or the adobe ajax)
  • that mint bloke needs more slides/ help
  • dropsend should have been dropbox
  • the vc is dead (reminded me of Chris Anderson’s article in this month’s wired magazine)
  • (maybe i could launch ***.com from my bedroom after all)
  • wow. where did they get that german google guy?
  • bingo!
• the inevitable resulting photos, tags and even some slightly sensible notes.

So, step aside clunky satellite interactive TV and make room for TV delivered via a fast broadband connection. The real interactive TV experience is when you don’t even notice you are “interacting” – where viewing is no longer passive but your involvement (like choosing what to watch, whether live or achived) is very much part of the TV experience. Whether you call it internet TV, broadband TV, IPTV or Video On Demand, the underlying concepts are essentially the same. And Homechoice is already there.

As mentioned before I’m keen to see how the areas of TV content, broadband and search technologies eventually come together. I’m sure it won’t be a clean race.

With last week’s news that Sky will be using Microsoft’s Windows Media Center to deliver its forthcoming Sky By Broadband service and Google announcing a new video store, some interesting areas in technology and media are finally starting to come together. It looks like the big players are jostling for starting positions in the race to realise the much heralded interplay of TV content, broadband and search technologies in the UK.

So – who’s next?

Hmm. Forgive me but haven’t we all been using applications “online and on demand” for a while now? To unashamedly use a meme that’s been bashed about for the last year or so – it’s all about this “Web 2.0” stuff, innit?

Web services like Flickr, Writely, inetWord and even MSExchange all offer feature rich applications as “online and on demand” software. And with broadband use becoming increasingly prolific, the thin-client model is now a feasible direction for certain applications. I can see that embedded advertising within these applications is a way to make money – particularly for the likes of Microsoft. But I guarantee the developer community will quickly find a way to outrun the displaying of these embedded adverts.

Either way – is this the beginning of the end for CD installed software? Maybe one day even our operating systems will be online…

EDIT: more here

oh – and my new usb pen drive rocks. i really am turning into a geek now.

and the code it spits out – ergh! it is such a shame – server side controls and the idea of coding behind pages are the best ideas to come out of .net and are on the path of enlightenment to separating logic from presentation (in much the same way as jakarta’s mvc framework that i’ve gotten so used to in struts). but the html code that things like asp:form tags spew out is ridiculous. microsoft sits on the w3c standards board and built .net from scratch but still can’t develop these controls to output valid html (let alone xhtml)! i guess this same company can’t build a compliant web page on their own site either so at least they’re consistent.

it looks like i’m going to have to spend a lot of unnecessary time overriding all server side controls using customized Render() methods to output what i want. not ideal. with any luck microsoft will listen to the development community and change this annoying “feature”.