May 2005 Archives

chromatic

AddThis Social Bookmark Button

Related link: http://code.google.com/summerofcode.html

Google wants more open source developers in the world. So do organizations such as The Perl Foundation, The Python Software Foundation, and The Apache Foundation. Today, Google has announced the Summer of Code, a program to encourage students to produce open source software. I spoke with Chris DiBona about the project.

The structure is simple. Google has set aside money to fund a few hundred projects. Google has also identified several open source organizations to identify potential projects, to evaluate and accept project proposals, and to mentor the new developers to complete the projects.

For example, the Perl Foundation has asked a few community members for project ideas that a college student could complete in a couple of months. Interested students can contact TPF for that list and should submit applications. TPF will then accept several applications.

From there, Google will send $500 for each participant to the sponsoring organization and $500 to each participant. The students have the summer to complete the project to the organization’s satisfaction (with the organization’s guidance) . If the student completes the project, Google will send him or her another check for $4000.

The organization is very fluid and organic, by design. Though Google has put up the money, it’s up to the various organizations to decide how to handle things. (Google is a participating organization as well, but Chris told me that they plan to oversee their participants as if they were any other organization.)

This is good for Google, in that it’s a nice way to encourage more open source, as well as a good way to donate to the community. This is good for organizations, as they receive some attention, some money, and the opportunity to recruit new developers to attack some necessary projects. This is also good for students, as it’s a chance to earn money actually writing code instead of waiting tables, running kiosks in the mall, or mowing lawns.

There are some risks. Even with the promise of financial remuneration, some projects will go uncompleted. Further, it’s up to the organizations to ensure that the project quality meets their guidelines. Fortunately, part of the rules require that the code fall under an OSI-approved license, with hosting on a site such as SourceForge. The sponsoring organization receives the $500 no matter what happens though.

What if your organization isn’t on the site? You still have a week or so to contact Google and sign up. The more, the merrier. (Where’s the Ruby foundation, for example?)

This is a great idea and it can be good for everyone involved. If you’re a student and developer looking for a project to tackle, a community to help, and a chance to earn some money (and I do mean earn), consider applying. (If you’re a Perl hacker who knows a little C and XS — or wants to learn — and who wants to make installing XS libraries obsolete, let me know. I have a project that you might really like.)

Where was this when I was in school?

AddThis Social Bookmark Button

This Month in BSD.

Sam Smith <s@msmith.net>

Another “this month in BSD” - The first to be an O’Reilly blog (Hi!). Previous roundups are
available
. It’s been a relatively quiet month in BSD land; except for OpenBSDville which has had one of its busiest periods in the last year.

Misc

Worth Reading

Misc reading

(lots this month)

BBC Backstage

“Build what you want using BBC content” (formal launch at Open Tech 2005)

Books from O’Reilly

(an expensive month)

BSDCan roundup

Dell - “Software Support or Extortion”

Worth attending

Apple

Tiger - a month on

CoreData Tutorials

OpenBSD

c2k5

Summary of the OpenBSD Hackathon

(by Jeremy at Kerneltrap)

3.7 released

Zaurus port

(Very cool; fully fledged OpenBSD, built natively)

Hackathon photos

OpenBSD Hackathon - more details

“saving the world through disruptive proactivity”

Misc

Other BSD

FreeBSD 5.4

HyperThreading Considered Harmful

NetBSD

DragonFlyBSD

Please feel free to add important stuff I missed below:

Harold Davis

AddThis Social Bookmark Button

Related link: http://dmoz.org

The ODP (Open Directory Project) is in trouble. A leading source of taxonomic information on the Web, the ODP relies on volunteer human editors to vet web sites for inclusion in the directory. Google, Yahoo, and others use ODP information (Google’s use of the ODP as the basis for the Google Directory is explained in Chapter 7 of my Building Research Tools book). Inclusion in the ODP essentially means indexing status and traffic.

The ODP is run by Time-Warner’s AOL’s Netscape division in accordance with the Debian Social Contract. Part of the thought behind ODP is that “humans do it best”: automated systems and understaffed editors at commercial search companies cannot keep up with constant change on the web.

Neither, as it turns out, can a volunteer system. Hundreds, or thousands, of categories are currently without editors. For those of us who want to get our sites into the ODP, there’s an increasing feeling of lack of dynamism - and delay. When I told an editor that it could take 4-6 months to get into the ODP, and one needed to come back and keep trying if not listed the first time, the response was incredulity and bemusement. Bemusement that so static and clogged an institution should gate-keep the dynamic information model of the Web.

Now it turns out that worse may be afoot. Supposedly, ODP listings are being sold like a commodity - which (in a sense) they are - they beat buying an AdSense ad for effectiveness in getting indexed. And editors supposedly join the ODP to trash their competition.

For more on the troubles at ODP, see this article in SiteProNews, and the (incredibly entertaining if saddening) blog Corrupt Dmoz Editor by an ODP editor operating under the nom de blog “Ana Thema.” Ms. Thema makes the ODP sound like the mob in posts like How to Bribe an DMOZ Editor. Some quotes from the blog, which may or may not be totally for real: “Links are a commodity. Links from DMOZ are a hot commodity. Everything in this world is a commodity: everything. If you disbelieve that someone would be so corrupt as to sell submissions into the ODP, then Dorothy, this is your wake up call.”

And: “AOL/TimeWarner own DMOZ and they treat it like the dollar chasing b***h it really is. And you should, too. Sabotaging your competitors is not simply about deleting their sites from the categories, but a more subtle and ongoing process of destroying their relevance for important keyword phrases.”

Of course, you may wish to read the post just to learn how to go about bribing the editors to get that all-important listing. Just kidding!

Go figure! I thought ODP was sluggish but idealistic. (I’ve been listed without paying a bribe, so the claim in the blog that a bribe is mandatory is false in at least some cases). It turns out it may be a cesspool. How bad is it? The Web community should find out, and take steps to get this vital institution back on the high road.

AddThis Social Bookmark Button

Related link: http://www.ukuug.org/events/opentech2005

The call for participation for the backstage.bbc.co.uk Open Tech 2005 event is now open. Taking place in London, UK on 23rd July 2005 and sponsored by backstage.bbc.co.uk, Open Tech 2005 is an informal one-day conference about technologies that anyone can have a go at, from “Open Source”-style ways of working to repurposing everyday electronics hardware. It also includes the official launch of the backstage.bbc.co.uk developer network and whatever you offer.

Last year had excellent talks, great weather, beer and some wifi; and this year promises to be of the same high quality and beer (we’re currently unsure about the weather and wifi). If you want to talk about your project, we’re taking submissions until June 25th.

See you there.

brian d foy

AddThis Social Bookmark Button

Several months ago I opened a bank account at the new Washington Mutual branch that opened around the corner. I like their service, except that their (old) website did not work with Firefox. I had to fire up Safari to do my banking.

Today I noticed a new look to their site, so I figured they may have fixed up the Javascript or whatever else may have annoyed Firefox. I tried it in Firefox and so far everything looks like it works.

This reminds me that I wish banks would publish a browser compatibility chart along with their new account disclosures.

Harold Davis

AddThis Social Bookmark Button

Google’s consumer initiatives have been getting a great deal of play lately - for example, mapping and the new customizable portal, er, start page. In the long run, Google’s efforts aimed at the enterprise may be more interesting - and have more impact on the fate of Google the company than these consumer moves.

Google as a business and institution is now like a shark: it must proceed forward or die. There’s too much critical mass created by the mile-high stock price and all the way-smart hirees at Google for things to just bumble along. This is the line of thought that inevitably leads to an assault on that IT Everest - the enterprise. You can see the process at work in a long, slow fashion at Microsoft. From its hobby operating system roots, the company is now a beaurocratic octopus engaged with the IT enterprise, pushing .Net and Longorn, having forsaken its Mom and Pop developer roots.

In a recent eWeek article, Matt Glotzbach, Google’s Enterprise product manager describes the new, and free, Google Enterprise Desktop Search for the Enterprise as a unified way to search information sources including email, and instant messaging. But this product lacks the ability to index network drives, and therefore is supposedly not competitive with Google’s enterprise search appliances.

These applicances range from the Google Mini, which sells for $3,000 to the Google Search Appliance, which is a $30,000 black box. (Here’s some recent coverage in Information Week.) The key indexing logic in these appliances is a closely guarded secret, hence my use of the term “black box.”

True, the Google enterprise appliances seem easy to deploy. In some cases, if companies want an easy way to enable search of generic kinds of documents - either for customers or employees - they may just slap in one of the Google widgets.

But wearing my enterprise consultant hat, I know there’s some pretty tough competition in enterprise information analysis and data retrieval software from companies like Autonomy, IBM, Microsoft, and Verity. Specialized information areas - for example, medical and legal, have their own highly technical semantic requirements for retrieval, and the Google appliances can’t even begin to touch them. So these Google enterprise appliances are actually kind of mid-market: they don’t touch the functionality of the higher-end (and more expensive) solutions, and they don’t understand the semantic rules and requirements of areas requiring subject-matter expertise. Compared to systems that do take a stab at solving these problems, they are cheap to buy and easy to deploy. But a lot more expensive than the free Enterprise Desktop Search product that I described at the beginning of this piece.

How much market is there in the enterprise for this mid-ground? I’m guessing not enough to support the shark in its forward motion. To achieve critical mass in enterprise search, Google will have to develop expertise, tools, and techniques to master the syntax and semantics of specific domains - and do it better than anyone else.

Andy Lester

AddThis Social Bookmark Button

What’s the worst bug you’ve ever written? Or if you’re a sysadmin, what’s the worst system problem you’ve allowed to happen?


It sounds like a starting point for war stories over beers at OSCON, but it can tell you a lot about yourself. Analyzing mistakes is a crucial skill for everyone, but especially for programmers, where mistakes can be so devastating, and are so easily fixed in the future.


I ask this question of every programmer I interview (and I’m still looking for programmers, by the way) to get an idea of the candidate’s self-awareness, and to get a feel for her background. If she can’t think of one, then I know she hasn’t been around very much.


For me, it was an Exchange conversion project…

I had just started at a new company and was eager to show my chops. My department was in charge of the company mail servers, and they were upgrading from one version of Exchange to another. For some reason, the conversion process would not bring over mailboxes from the old version of Exchange to the new one. Dozens of users had hundreds of mailboxes each, containing correspondence with customers.


Hotshot Andy spent a day or two with using one of the Perl Win32 modules, calling Outlook OLE objects to read in data from one Exchange instance and write them to the new instance. My program would log in, suck up the mailboxes, log in on the new system, and create new mailboxes. The messages converted fine, and I had many safeguards to make sure that message counts before and after were the same. It worked beautifully.


We spent a weekend migrating over the data, as well as all Outlook clients, and Monday morning brought no complaints. We were all pleased with how well it all went. Around Thursday, well after the point of no return, the complaints hit.


It turns out that these mailboxes were organized into folders, and my program hadn’t taken that into account. All user mailboxes were in the top level of the hierarchy. All organization was lost. Worse, they couldn’t get back to the old instance of Exchange to see how things had been organized. We couldn’t even do the grunt work of recreating the hierarchy because we weren’t familiar with the data.


Then, after the candidate tells me the story of the terrible bug, I ask the crucial follow-up: “What did you learn? What did you change about yourself?” The reaction is often telling, and I can easily see how self-aware she is. If the answer is “We fixed the bug and had to do some cleanup,” then I know nothing’s been learned. If she comes back with a “I’ll tell you one thing: I made sure that my X always….”, I know that she’s a self-optimizing person.


In my case…

The crucial error was making assumptions about the data. I had created my own dummy mailboxes, with my own dummy data in it, rather than using real live data. If I’d looked at live data, rather than assuming that I knew what it would look like, the hierarchy would have been immediately clear. “Always look at real data early in the project” is a long-standing maxim from me.

Think about it over the next few days. What’s your biggest mistake programming? Did you change anything? Or maybe you find you’ve over-compensated, and are overly cautious? How do you optimize yourself?

What’s your worst bug? What did you change? How do you make sure you’re improving?

AddThis Social Bookmark Button

Related link: http://www.yankeegroup.com/public/products/decision_note.jsp?ID=13113

Love ‘em or hate ‘em, analyst groups are good at some things, including getting businesses (especially big businesses) to talk about what technology they are using and why.

A recent press release from the Yankee group states that businesses use a mixture of operating systems (no surprise there) and the prevalent mix is Windows and Linux. Windows is already everywhere, and Linux is increasingly paired with Windows in corporate computing environments.

But the Yankee groups warns that getting these two operating systems (and some would say different philosophies) to work together is not always easy. O’Reilly understands that, which is why we published a book on exactly this subject a few months ago. It’s called Linux in a Windows World.

This book is about many of the points where Linux can be strategically placed into your network. Do you need centralized authentication for Windows and Linux machines but don’t want to use Windows? This book shows you how. Do you need your Linux machines to authenticate against an Active Directory server? Not a problem? Centralized print services running on a reliable Linux machine? CUPS is your answer. Want a gateway email server to do spam and virus filtering before you email gets to your MS Exchange groupware server? Linux in a Windows World covers that too.

If you’re a Windows or Linux system admin and you need advice and HOWTO steps for integrating the two operating systems, I strongly suggest you take a look at this book.

brian d foy

AddThis Social Bookmark Button

Vanity searches or looking for other people’s names in a web search engine isn’t new, but Mark Millhone writes about his own experience with it in a non-techy magazine. (”Hunting Your Great Lost Love”, US Edition, June 2005, p 106).

It’s really too bad the Men’s Health web site is too stoopid for me to have anything to link too. I think it’s sort of cute when the rest of the world figures out something “new” like this. :)

Jono Bacon

AddThis Social Bookmark Button

With most things in life, the journey is often more important than the destination you reach. As someone who has got to a point in their life where technology plays an essential role each and every day, I sometimes reminisce about the journey travelled so far. Primitive recollections with early computers such as the Commodore 64, through to my first PC (an earth shattering 8086 beige monster), then on to my more recent introduction to Linux, the founding of Linux UK, joining the KDE project and onwards to professional Open Source advocacy and LUGRadio lunacy, all strike a smile when they enter my imagination. Each of these experiences has played a critical role in how I focus on technology and the views I have about a range of subjects pertaining to the industry and many of the philosophical issues surrounding it.

This article is the first of a series of articles that will document this journey. Before I begin, I should make my intentions for this series clear. My aim is not to present a biographical story; I certainly don’t feel my life has been interesting or different enough to justify this, but I do have two specific aims for this series. Firstly, I want to document all of this for myself. I myself have a shockingly bad memory; one criticised by my other half daily due to such offences as forgetting the milk from the shop, and this series will be useful to remember these experiences and know they are written somewhere safe on the Internet. Secondly, although I am no Steve Wozniak or Kevin Mitnick, I have had a number interesting, fun and wacky experiences as I spiralled into computers, and then onto Linux just before it started kicking off. Maybe some of these words can raise a smile on some of your faces, and inspire similar recollections from your own lives.

A northern boy

Back in September 1979, my mother squeezed me out into the world. Born in Northallerton, North Yorkshire, my hometown was fairly typical of a North Yorkshire town. A small and run-of-the-mill population, most people knew most people, and everyone certainly knew my father. As a man who struggled through his own childhood, he went on to achieve a number of notable experiences in his own world. One of the most notable was when he started a strike at a factory, one triggered by safety issues inside the trailer construction company. Although reviled by his employers, he went on to become mayor of Northallerton and defended his townspeople at every step. To this day, my father is still reviled by some and hailed by many as a working class hero. Irrespective of the onlooker, he has always rigidly stuck to his morals and beliefs, and his and my mothers inspiration has fuelled my own determination to ‘do the right thing’.

As a kid, I was fairly normal. I did not have the quiet, sheltered, nervous existence many geeks recall from their school days. Having two brothers much older than me, life was always interesting. Martin was the more hands on of the two who enjoyed such pranks as making circles of petrol in the garage and asking me to stand in the circle as he lit it. As someone with a bit of a fixation with fire, petrol and other dangerous entities, Martin took a great pleasure out of building and destroying things. Although not a computer guy, Martin exhibits many of the traits of a hacker, and he could always be found making something out of nothing out in the garage. Give him a spanner, bin liner, old pram, piece of wood and a belt, and he would erupt out of the garage on his own concocted vehicle - he really did watch way too much A-Team…

My other brother Simon was a different kettle of fish. As someone who demonstrated an appreciation of appalling haircuts and large boots, Simon had a love for The Cure and he showed it. Aside from his angst ridden appearance, Simon was also getting into computers when not staring at his shoes. One day I wandered into his bedroom when he still lived at home in North Yorkshire, and there was this cool looking grey thing with a cassette tape deck built in. I asked him what it was and he told me it was a Spectrum computer and you could play games on it. As we chatted, I heard his TV squawking away as he loaded a game in which you played a tiny white blob saving other tiny white blobs that he assured me were soldiers from a German WWII castle (no idea what game it was). Simon had a penchant for this unknown game and another curious tape in which he fought a competitor and then an odd looking dude came out and kicked the losers head out of the arena. Nice.

This computer thing looked cool. Sure, I had seen computers in films such as D.A.R.Y.L and when Dr Who was on, but I didn’t realise Simon had one. After this first encounter with the computer, Simon was rigorously against me playing on it unless he was there. This was understandable - the last thing he would have wanted was his little brother screwing it up. As such, I waited patiently for him to come home to get my fix on the grey box.

Hail the Commodore

After spending some time playing around with Simon’s computer, my parents decided to get one. The choice was a Commodore 16; a computer that few seem to have owned, but one that continued my interest in computers at that early age. Although I did not have free reign on it, I spent quite some time playing some early games on the machine, and I was fascinated by the graphics and technology that went into the machine. As time rumbled on and the Commodore 16 became outdated, my parents bought me my very first computer of my own - a Commodore 64. This ground breaking machine is where it kicked off for me.

When I got the C64, I wanted to learn more about how games worked; I wanted to create games. As soon as the machine booted, you were instantly thrust into a BASIC interpreter, and the C64 manual boasted the great things you could do with BASIC. I sat down with the thick blue book and its white ring binding, and typed in some introductory programs. They worked, but won no prizes for amazement. I wanted explosions, fire, death and destruction; all the things a young northern kid wanted. As I continued through the book patiently, the most interesting example seemed to be a hot air balloon that you could animate the move across the screen. When I got home from school on the hot summer evenings, I would sit in the dining room typing out the balloon program and trying to make it work. After a repeated affliction of failure, the gods smiled and the planets aligned and the damn thing finally worked. Although so incredibly primitive, it was just so cool, and I was truly psyched. I needed more. Although I didn’t know it, this was my first hack.

When I was a kid, people in Yorkshire were not exactly tech savvy. Although my parents took me into computer shops in Newcastle to get games such as Out Run, Green Beret and NARC, in Northallerton there was one computer shop; an emporium run by a guy who looked like an ugly Mick Hucknall (yes, I know, it was quite a sight; this guy need a public health warning stamped on his forehead). Whenever we went into town at weekends, I would spend my £2 pocket money each week and buy a game. Within the shop, it was like something from a cold war movie. Inside, there were five cordoned off areas segregating the different platforms, and you only looked at your own shelves. The people from the other shelves didn’t speak to you, and you didn’t speak to them. There were good reasons not to speak to them though. The Spectrum owners were a strange bunch, the Amiga owners were rich, the Atari people were old farts, and the SEGA/Nintendo people were the cool kids. While perusing the Commodore section and avoiding eye contact with the monocle wearing, horse riding Amiga owners, I noticed some Commodore books stuffed at the side of the shelves. One such book stood out a mile - a book on writing Commodore games. Wow, I could write games and be really cool. In retrospect, the book was actually pretty appalling. It simply contained listings of pre-written games, but this was good enough - I just wanted to see and run more code. I certainly got that; the listings went into tens of pages. My mum helped patiently type in the code, and she also mastered the strange multi-fingered keyboard combinations to get these odd C64 symbols to appear. My suspicion is that Emacs users spent far too much time with the same book…

Around this time, my parents decided to move to the south of England. My dad had gone for a new position in Leighton Buzzard in East Anglia and we all moved South where I started a new school in Bedfordshire. This was interesting in itself. All of these southern kids with their very slight cockney accents suddenly had this kid with a bowl haircut join their school who no-one could understand. My thick northern accent amused many of the kids, and I reacted with good humour and developed some good pals. At around the same time, my brother was moving up in the world too. Simon had been working in computers (I never knew what he did at the time, but he administered UNIX systems), and he had just bought a snazzy new computer which left him with an old orphaned PC that he offered to me. This was a big deal. No, this was a huge deal for me. As someone who was just getting into computers, the geekery was further bolstered by watching WarGames over and over again; a film in which Matthew Broderick does all kinds of amazing things with a computer. Inside my pea-brain, the computers in WarGames were PCs, and Simon’s old computer was going to open me up to all that. Would you like to play a game?

Bring forth ‘ye PC

Shortly after moving to the South, Simon was going to deliver my new computer while visiting us for the first time at our new home. The new house was pretty crazy. Built by a guy who won a bucket of money on the dogs, the house was decked out in full-on seventies glam. At the time, we were renting the house while my parents looked to buy a place, and this rented dwelling was a superb home for the amount of rent each month. It included a swimming pool, games room, sauna and as a bonus, was horrifically haunted. At the time, my parents never told me the stories of the unusual things that happened in that house, but later in life they filled me in on the rocking chair moving my itself, figures on the stairs and other weird occurrences. When I look back, I do remember hearing footsteps when my parents were out. Ugh.

On the big day, Simon came in and dumped the beast on the floor. Emblazoned in beige, the chunky base unit and green screen monitor were augmented by a huge keyboard, complete with dust and the likely-hood of a pube. With no regard for my generous brother, I snapped the machine up, and eagerly hulked the machine upstairs to plug it in. As the machine booted, I heard the 40MB hard drive whir, and the machine booted into MSDOS. Scribed on a piece of paper, my brother had also written instructions on how to start GEM; an usual but at the time, gripping graphical user interface. With no mouse, GEM needed to be controlled by the cursor keys. I didn’t care though; I had a PC and it rocked good and hard.

That PC brought great things to my experiences with computers. For some reason, there were about four BASIC environments installed, and one of them allowed me to convert my program into a program you could run without the BASIC environment. This was a big stepping stone, as I could write software anyone could run. I would spend endless amounts of time fiddling with BASIC and writing fairly pointless, but interesting programs. When not writing programs, at school I would draw flow charts, write scraps of code on my books and imagine the wonderful things I could create on that fantastic green CGA screen. Most of these primitive experiments included basic concepts such as data input, menus, tables and more, but they were so cool, and anyone could run them. It was just a shame no one else had a PC; they only had those stupid Commodore 64s (I never looked back, such a snob). As I played with it further, I realised that programming was something that gave me so much control. I could write a program and make the computer do things that I wanted to do. As I listened to Iron Maiden’s Somewhere In Time album one evening, I realised that I wanted to run a software company, and there was no better time than to do it right now…while I was…er…13.

So, I went to school, met up with some of my pals and proudly announced TECH; my own software company. The idea was to create a game called Splat The Rat, and I had even mustered my horrific drawing skills to draw the ambivalent rat. With my comrades in tow, each playtime was spent talking about how we would create this platform game called Splat The Rat and how cool it would be. Sure, none of us knew how to make it, and many of my friends had never coded, but that didn’t matter - we were gonna do it anyway. As the motivation continued to flow, I read up on creating computer games by visiting the village library and ordering in stacks of books on anything that sounded vaguely related.

When my books arrived in at the library, there was a distinctive problem. Each one of them talked about this language called C, and the code listings looked complex and cryptic. This successfully killed off the doomed TECH, but I was still keen on furthering my own learning. I remembered reading in SEGA Format that most of the SEGA games were written in C, and this mystery language had me intrigued. As I read through the book I discovered that I needed something called a C compiler, and having checked my PC, there wasnt one installed. I gave Simon a call and he assured he could sort me out with a compiler. That weekend I was going to stay with him and he showed me this box containing something called Turbo C++. We spent a few hours trying to install it (my floppy drive was playing up), but we finally got it installed, and I was excited. This new tool looked incredible. It had all kinds of complex commands, menus and more. It also had a huge manual, but Simon could not lend me it. I sat on his living room floor with a small ring-bound notepad and pen, and copied vast chunks of the manual while he watched TV.

Although C was an exciting proposition, it turned out to be an impossible proposition. Sure, I could do some coding in it, and I had a good grasp of the core principles like functions, commands and input/output, but I was not really getting anywhere very quickly. While chatting with my dad, he suggested I looked into going to college to learn C. Although I was only 14 and still at school, I was excited by the idea of getting some formal training in C. My mum took me to Bedford College and signed me up for a City and Guilds Programming in C Level II night-school course. Once a week, I would go to study my course between 6pm and 9pm, and I successfully got my certificate.

At this point, I started fiddling around with graphics in C. Creating simple animations and doing some basic 3D animation were the activities that took part in my bedroom when I got in from school. Life was simple, and I did two things, I played guitar in a band and I hacked on C when I got home. Although there were plenty of people to talk about guitars too, there was no-one to talk about hacking to. Anyone who was into computers was busy running Logo at the time. I found this utterly uninteresting and I was more interested in writing programs to give to my friends.

BBSs take control

The Christmas after my 14th birthday, my parents decided to upgrade my PC after constant whining from my good self, and I was treated to a 386. At the time my dad was running a project that was creating the first interactive multimedia kiosks for selling cars. This was quite a cutting edge project back then, and you would be forgiven for thinking my dad is some kind of technical genius. Not quite. My dad is a genius when it comes to ideas and innovation, and he managed to run a project in which he could drive the direction and leave the techies to actually carry out this vision he had. As part of his work, he managed to get a cheap 386 from Olivetti that he gave me for Christmas.

As someone keen on IT, I always loved to find out about how my dad’s project was going. He would come home and tell me what he was doing, and I was always fascinated by the software and people who worked in it. He even took me to a few meetings, one of which was a technical development meeting, and I met for the first time some professional programmers. Although COBOL and VB developers, it was fascinating to get a view of the industry I would hope to get involved with. I wonder what those people must have thought about the director of the project bringing in his pimply faced son with a pathetic bowl of a haircut to meetings. You may have noticed a recurring theme with the ‘cut - I am not going to deny that I had unforgivably stupid hair when I was a kid.

One day at school we were informed that we could go on two days work placement. I had a chat to my dad and he said he would take me into work to work on the project. On my first morning, I put on my shirt and Flintstones tie and he drove us into work. As we sat in his office, he gave me my first task. My job was to get the company on the Internet.

At the time, the Internet was not something people had really heard of. Companies were just starting to come out and offer net access, but the computer magazines were mainly riddled with ads for BBSs. As I read some magazines, I discovered that I needed to get a modem. We went and bought a 28.8k external modem for over £250 (they had recently come out), and I started dialling up BBSs. This was amazing. I could talk to people over the other side of the country, or even the other side of the world. BBSs contained files and online rooms, and it again acted out one of the many dreams from a film such as WarGames. Hooking your computer to another one was incredibly cool, and my dad gave me permission to do this for a full two days on work experience. I did some more research into TCP/IP, addressing and the World Wide Web and eventually suggested he used a certain company to dial up. His company had now been put on the Internet by a 14 year old kid…with a bowl haircut.

After the two days, my dad must have been feeling flush and as a reward, he bought me the same modem to use at home. I was now set to get on the net at home, and this could potentially open me up to a world of different things. It certainly did…

To be continued…

Any thoughts on the story so far? Share them here…

brian d foy

AddThis Social Bookmark Button

I’m looking forward to using Tiger, but I normally wait for the bleeding-edge people to stop bleeding before I do anything about it. Usually I have one new-enough work computer that can actually run the latest OS without crawling too slowly and I don’t want to lose everything switching to a new OS. I’m not worried about missing data, but wrangling new versions of apache, perl, mysql, and whatever else may be updated.

I haven’t heard huge outcries about Tiger being all that bad, but I have heard about a problem downloading untrusted Dashboard items, various problems compiling things with gcc4.0 (although the fix was often very easy in most cases), and the usual old-app new-OS problems.

Fortunately I have a new work machine on the way that I can sacrifice, so I’ll be able to install it without risking an interruption of my daily work.

Still, I’m curious how people (other than the techies I talk to personally) are making out with Tiger. If you haven’t had problems, which feature do you like the most?

Harold Davis

AddThis Social Bookmark Button

I always knew Google would lead the way with revolutionary breakthroughs…but I thought it might be the cure for cancer, or a plan for world peace. I never realized that Google would finally prove the existence of UFOs, as in this Google Maps image of suburban Florida.

Now that UFOs have been found, what is Google’s next great thing?

Harold Davis

AddThis Social Bookmark Button

Related link: http://www.google.com/ig

You can now customize your Google home page (the program is in Google “beta” within the Google Labs).

I like what you can do, but this is still only portal-lite. Features are more or less limited: you can add headlines from Google News, Slashdot, the New York Times, and the BBC, add links to your Gmail account, and move these things around on your custom page in a whiz-bang fashion. (I should also mention stock quotes, local weather which is not yet operable, movie reviews, and more.) The whole thing can be toggled on and off - the off position is referred to as “Classic Google”!

As I said, I think the ability to customize your Google home page is pretty cool. Why not be able to use all that white space on the Google search page to provide some quick info? It lets me learn some things that are important to me at a glance everytime I open my Google home page (which obviously I do quite a bit).

The new interface is minimalist in the Google UI spirit. But the mainstream media, such as the New York Times (Google Moves to Challenge Web Portals), are portraying the move as a step towards the portalization of Google, and a salvo in the “war” with Yahoo! and MSN.

I see things a bit differently. I already use Google as a kind of portal, meaning that it is my home page (and the Google Toolbar sits always ready for use where ever I surf). I like Google’s laser-focused functionality and uncluttered look, and I’m not particularly eager to have Google start offering a la Yahoo everything from soup to nuts to hot dates.

The new customizations strike me as an OK but minor tweak to the interface rather than a paradigm shift toward portal-dom. Where I think it is going is that undoubtedly Google will be adding multiple syndication feeds as viewing options to this page. What a great way to generate more AdSense revenue! Now I understand why Google is putting ads in RSS and Atom feeds.

What do you think of the new Google custom home page? What features would you like to see? Do you prefer Classic Google?

Harold Davis

AddThis Social Bookmark Button

Related link: http://www.chicagocrime.org/

Adrian Holovaty and Wilson Miner have put togther an application that visually shows crime incidents in Chicago using Google maps.

Check it out. It’s notable for a number of reasons:

It “munges” together application logic and data from a number of sources (e.g., Google Maps, and a Chicago Police Department database).

By allowing users to visually see the geographic place different “incidents” took place, it presents information usefully in a new and useful way. For example, you can visually see what blocks arson, rape, or armed robbery takes place in (good for avoiding these areas?).

The application allows the information it presents to be sliced and diced using syndication: RSS feeds are available that show crimes for each police beat, and each city block.

Way cool!

What other “munging” applications are cool?

brian d foy

AddThis Social Bookmark Button

Related link: http://digitalmedia.oreilly.com/2005/05/18/timelapse.html

My friend Scott Forst made a time lapse movie of a drive from LA to Monterey, and I helped him tell the story for O’Reilly Digital Media Center.

Although neither of us had experience with that sort of thing before we started, we came out with something decent because the technology did all of the work for us. Consumer electronics just get better and better.

Harold Davis

AddThis Social Bookmark Button

Reader beware: this is a tale of buzzwords, so if buzzwords bug you, you might want to pass. In fact, it is a long tale of two buzzwords. They are the best of buzzwords, and the worst of buzzwords. And so it begins…

The buzzword, or phrase, that’s my primary topic is “The Long Tail.” “The Long Tail” is a meme—meaning a phrase used to denote a topic of general community discussion. According to various definitions, a meme is (1) an idea that can replicate and evolve, and (2) a basic unit of cultural information subject to mutation, crossover, and adaptation. The use of the term “meme” is credited to evolutionary biologist Richard Dawkins (he used it in his 1976 book The Selfish Gene). Dawkins is the author of many fine books besides The Selfish Gene, including notably The Blind Watchmaker: Why the Evidence of Evolution Reveals a Universe without Design (1986).

“Meme” is, of course, a meme itself, and as such has become a meta-meme. The genetic metaphor is interesting, but from a common sense viewpoint my first, simplest definition (that a meme is a buzzword that is the focus of community discussion) isn’t far off. But I digress. Digression is one of the problems with memes.

To digress further, I like the phrase “the long tail.” It’s evocative. It makes me think of good luck dragons, the greatest story ever told, fur hats, beavers, and particularly Mr. and Mrs. Beaver in C.S. Lewis’s The Lion, the Witch, and the Wardrobe. If you can’t follow this train of associations, don’t worry: it’s my personal weirdness. I also have a racier association, but let’s not even go there.

To statisticians, economists, and econometricians “the long tail” has been a fairly arcane bit of professional slang meaning the long downward slope of many distribution curves, such as the Pareto distribution named after the Italian economist, Marxist, and social theorist Vilfredo Pareto.

Pareto illustrated his distribution curve with his “80-20 rule” regarding wealth in society: 20% of the people own 80% of the wealth. The long tail is (as seen on a graph) the lower and lower probability of a given person having much wealth.

Pareto distribution curves have been found, with the long tail intact, in a wide variety of things including the frequency of words in a text, file size distribution of TCP/IP traffic (few large files, many smaller ones), and the value of oil reserves in oil fields (a few very valuable fields, many less valuable ones), and so on.

Incidentally, I’ve focused on Pareto distribution here because I am so fond of Pareto the historical character who was not only a brilliant thinker, but also stood up for social justice, was an aristocrat (though he disdained the use of his title) who married for love, and a crack practitioner of the arts of dueling. But Pareto distributions are not unique in having long tails. A variety of other probability distributions have long tails, including, for example, exponential distribution.

The concept is pretty intuitively simple: the long tail refers to the long downward slope as probabilities lessen over time. Most distributed phenomena have long tails. For example, a hot product may sell zillions of units for several months. Several years later, it is still selling a few units per month on the long downward slope of its unit sales distribution tail.

Here’s where my tale moves from the long tail (note lower case usage) to the meme “The Long Tail.” The initial capital letters The Long Tail meme was coined by Chris Anderson in a 2004 Wired Magazine article.

As Anderson originally used the phrase, The Long Tail refers to a new reality of the Web in which inventory and distribution costs are low. His article mostly referred to media: “Forget squeezing millions from a few megahits at the top of the charts. The future of entertainment is in the millions of niche markets at the shallow end of the bitstream.”

The implication is that low volume “products,” which sit somewhere down the long tail’s slope, can sell profitably to niche markets. Without The Long Tail, to be successful a product needs high-volume appeal. According to Anderson, and he’s probably right about this, The Long Tail accounts for the success of a variety of Internet business models from Amazon and Netflix (low inventory and distribution costs in stocking even low volume items) to eBay (the ultimate aggregation of niche markets) and beyond.

Anderson is now working on The Long Tail the book (to be published by Hyperion in 2006), and presents his ideas on The Long Tail the Website (“a public diary on the way to a book”).

I think that Anderson and some others are stretching things a bit to apply The Long Tail as a general business principle of our changing times, and I’d hate to see Anderson’s book end up as another vapid business chicken soul for the pocket book.

But what’s quite interesting to me is that the concept of The Long Tail is being applied (I think quite usefully) to the subject of information delivery on the Web. No longer do we have information dissemination via prime time television (the short head). Instead, information is being broken down into thousands of niches, blogs, and feeds (the long tail).

People can reassemble this stuff to find what they need in their own way and on their own time using mechanisms like search, RSS aggregation, and so on. As Eric Schmidt, Google’s CEO, put it at a recent Google shareholder meeting, Google does a good job of serving mid-size businesses who advertise. But Google is looking hard at serving The Long Tail (Schmidt’s words)—individuals and small businesses for which self-help tools like AdWords are ideal. (Google is also working on the Fortune 500 short head 80-20 rule side of things, but that’s another story.)

As The Long Tail meme goes around the Web community it cross-pollinates with another meme, Web 2.0 (for example, see this New Media Musings blog entry). Web 2.0 is shorthand for a set of attitudes, practices, technologies, and design disciplines. Stay tuned to this Long Tail channel for my thoughts on the interaction of Web 2.0 and The Long Tail.

brian d foy

AddThis Social Bookmark Button

I got two claim forms from the “Apple Adapter Settlement Claims Administrator” (my wife got one, so three between us). It says Apple owes us $35 each for the faulty power adapters that came with various iBooks and Powerbooks we have.

I vaguely remember getting a replacement adapter for free from Apple, but that was way back in 2002. I think this is the same case because it keeps talking about the black brick adapter. That must have been the one that came with my Pismo Powerbook.

Now it’s 2005 and the Claims Administrator wants to know all about which Powerbook I have, when I bought it, which adapter I had with it, if I purchased a new one, and so on. I really don’t know the answers to any of these questions. My Pismo, for instance, surely is from the late 1990s sometime.

I don’t really mind not getting 3 times $35, but the thought of some lawyer keeping it because I didn’t claim it is a bit annoying.

brian d foy

AddThis Social Bookmark Button

Related link: http://www.theperlreview.com/Interviews/simon-app2-20050512.html?ora

The Perl Review inteviews Simon Cozens about his upcoming book, Advanced Perl Programming, 2nd Edition.

Read about Simon’s thoughts on the Perl rights of passage, the evolution of the Perl expert, and writing about Perl!

Harold Davis

AddThis Social Bookmark Button

Related link: http://www.digitalfieldguide.com

My new digital photography site is up and running! Check it out: Digital Photography: Digital Field Guide. Also, a companion blog, Photoblog 2.0.

Officially, Digital Photography: Digital Field Guide is the companion Website for a book soon to be published (with the eponymous title). However, the site has taken on a life of its own.

It’s great to have an attractive venue to display my digital photographs. I’ve also enjoyed the technical aspects of putting together the site. I decided to use a Flickr account to manage my photographs. Flickr does a great job of organizing the photos, tagging them, and creating a digital photo community. (You do need to purchase a Flickr Pro account for about $25 a year to get the most out of it.)

The privacy settings make it easy for me to have public pictures, which appear on Digital Photography: Digital Field Guide, and also to maintain private photo galleries for friends and family.

The Flickr site is built around syndication, and every set of photographs you can imagine can be syndicated. Flickr does a less good job of archival management for me: the format is limited to JPEG so I can’t store the original RAW format “negatives” using Flickr.

A really cool Flickr feature: you can blog a photo right from Flickr! This makes it easy for me to upload new pictures straight from my camera and blog them with one pass.

Flickr supplies “badges” either in HTML or Flash that one can post on one’s own site (either of one’s one pictures, or of public Flickr photos generally). These badges are cool, but a little limited from a formatting perspective (and likely you’ll want to fool with the code a little to match your site graphics). I used these to some degree on my site, but where I really had fun was with the Flickr API, which expose a great deal of flickr’s functionality.

Since my site is written in PHP, I used (and modified) OberKampf, a PHP wrapper library for the API written in PHP. A great deal of fun, shows my photographs off to great advantage, and makes many photo management chores very easy for me.

Flickr is the cat’s pajamas, but I do have a wishlist: ability to archive RAW formats, “primitive” functions that allow image effects such as rollovers, fades, dissolves — both as part of “badges” and in the Flickr API.

Kevin Shockey

AddThis Social Bookmark Button

Recently I attended the funeral services for one of my best friend’s son. He was killed in action while serving in Iraq. I was reminded by many of his fellow soldiers that “Freedom is not Free!” I, like many others, have had a different opinion about why our troops are in Iraq and what they were fighting for. However, after this experience I was convinced, that no matter what your politics when you are in combat it is about only one thing, freedom. Over here we can debate and attempt to make sense of what is happening, but when you are in harms way it is about staying alive, staying sane, and going back home. For if you say that these men and women are serving their country so someone else doesn’t have to, then I say it is clear that they are defending freedom. As a disabled veteran myself, and a third generation veteran at that, I should have never forgotten this point. The men and women in our Armed Forces are serving for a multitude of reasons, but one thing you learn in the service is that you serve out of tradition, you serve out of respect, ultimately you serve out of integrity and honor. And one of the proudest traditions in our Armed Forces is that by serving in the U.S. Military you are protecting freedom.

So these thoughts were fresh in my mind when I heard Lawrence Lessig’s speech at the Open Source Business Conference. Professor Lessig’s general premise was that whether you share the perception (sound familiar?), we are currently in a war. A war against technology innovation, where our foe has many names, but the bigger foe is apathy. For what if we do nothing, and we lose this war? What will our future look like then?

In the conclusion of his speech, Professor Lessig requested one simple thing of the audience. If you care about this war and about the future of technology innovation, support the organizations that are actively fighting this war. He encouraged everyone to support them with as much money as we spend on monopolist companies. In an effort to help fulfill his request, I have compiled the following list of companies that I believe are helping to defend the freedoms we enjoy today. It is by no means a comprehensive list, so if you do not see your favorite defender of technology innovation, seek them out and locate their donation page. I hope you’ll know what to do when you find it.

I myself have some catching up to do. I bought a new laptop a couple of years ago and it came pre-installed with Microsoft Windows XP; I’ve got three daughters so we’ve compiled an extensive library of videos and DVD’s; so I know that I’m big time negative in balancing out my support of this war. I have donated to Sourceforge for their support of the SNAP Platform, but I’ve got a long way to go. How about you? Where are you sending your support?

Know of any other organizations worthy of our support that I missed?

Harold Davis

AddThis Social Bookmark Button

Related link: http://www.wordpress.org

I’m installing WordPress to manage my digital photography blog. (Details about my photography site and blog coming soon!)

Why WordPress? Well, not change for the sake of change. My Googleplex Blog (and my wife’s blog) are powered by a MovableType Blog content management system. I’m pretty happy with MT, the templates are all finally working, and conservative enough from a sysadmin perspective that I haven’t even upgraded from version 2.6 (on the if it ain’t broken don’t fix it theory of IT, even though MT is up to version 3.16 by now!).

But the digital photography site and blog are looking to be a very Web 2.0 kind of thing, running on Flickr, the Flickr APIs, and PHP. WordPress fits in with this: it’s written in PHP, with templates easily modifiable by someone who can hack a bit of PHP, truly open source, and truly free. Also the WordPress tag “Code is Poetry” hooked me for obvious reasons: Code is poetry!

Unlike MT, which is moving inch by inch towards becoming an enterprise software company. I can’t quite tell if technically I’d need to buy an MT license for a new install. Are my blogs a commercial enterprise, which is the issue? Probably I would need a license, even though it’s not very expensive, but I just prefer the home spun community of WordPress. As I say, it’s very Web 2.0. Will I switch the Googleplex blog away from MovableType? Probably not anytime soon…

Anyhow, back to the topic of installing WordPress. I’d like to comment on WordPress’s Famous 5-Minute Install. For me, five hours was closer to the mark. I’m documenting my two major problems here in the hope that this might benefit someone coming after me.

First, downloading the installation files, unpacking them, copying them to my server, and running the installation script didn’t take a whole lot longer than five minutes. That’s where my troubles began, however.

Everytime I tried to publish a blog entry, instead of my test item I got a 404 not found error. If you are thinking database problem, you are ahead of me - and correct. The docs say that 99% likely “hostname” in the config file should be set to “localhost” and that “if you don’t know what this value should be, check with your system administrator. If you are the system administrator, figure out what this value should be.” Well, I finally got wise and plugged in the right address for my dbms server (not localhost), and this worked fine.

Next, the permalink for each entry was broken. I opened the WordPress control panel, went to Options >Permalink > Edit Permalink Structure. I figured that I’d need a new structure, anyhow. Well, I followed the directions and it gave me a bunch of code to add to my .htaccess file, along with the statement that if permissions were set so the file could be written, it would have done so for me. Obviously, I have no problem changing file permissions, but this had me scratching my head for a while because I couldn’t find an .htaccess file anywhere in the installation tree. (A red herring, this is a hidden file, so I had to figure out how to get my FTP client to show hidden files.)

Turns out, I simply didn’t have a .htaccess file. Creating one from scratch, and copying the suggested code into it, then uploading to the directory in the install tree above where I wanted virtual permalinks worked fine. (But time I could have spent better if this had just been in the docs…)

A tough birth, but I think I’m going to like WordPress when all is said and done…

Ming Chow

AddThis Social Bookmark Button

  • To start really fresh, secure erase (or “shred”) your hard drive. To do this, pop in the Mac OS X Tiger DVD, run the installer, and your machine will reboot. Then, run the Disk Utility before you install Mac OS X Tiger. In Disk Utility, go to the “Erase” tab. Click on the “Options” button, and you will be presented with three erase options: standard (simple, not necessarily secure), 7-pass (very secure), and 35-pass (uber-secure). The 7-pass secure erase took approximately 4 hours on (my) 30 GB hard drive. The 35-pass secure erase took approximately 18 hours on my 30 GB hard drive. Yes, I used both options (don’t ask)! Be sure to have plans or something to do during the time while the hard drive is being erased. After the hard drive has been wiped clean, perform install of Mac OS X Tiger.
  • Turn on firewall via Sharing control panel. No, it is not automatically turned on after a fresh install!
  • If not necessary, turn off file sharing.
  • Turn on FileVault to encrypt your home directory.
  • Whenever you use Safari, enable “Privacy Browsing” via the Safari menu. Your history, downloads, searches will not be saved. The problem is, you have to enable this each time you open Safari.
  • Disable AutoFill in Safari –period.
  • For the terminal users, enable “Secure Keyboard Entry” via File menu.
  • For the administrators and the paranoid, enable firewall logging, block UDP traffic, and enable stealth mode via “Advanced” options after you enable firewall.

Anything I missed?

chromatic