When Holmes meets Bayes

Please read him as him/her. ‘Man’ refers to mankind/humanity in general.

Like many people, in the past 2 weeks I too am disturbed when I think about what could have happened to the missing Malaysian flight MH370. On Saturday the 15th of March, Malaysia Prime Minister communicated that evidence is consistent with someone acting deliberately from inside the plane and I could not help notice the shift in direction since then. The focus is now high on its pilots, crewmembers and passengers. The dearth of a solid meaningful clue has understandably made the search difficult and if it stays, I’m worried Sherlock Holmes might get to solve this with help from Thomas Bayes.

Bayesian inference in is a useful tool in statistics to help manage uncertainties. Mathematically, Bayes’ theorem gives the relationship between the probabilities of event A and B, P(A) and P(B), and the conditional probabilities of A given B and B given A, P(A|B) and P(B|A). In its most common form, it is:


However, in real life, Bayesian inference could get ‘belief shattering’ when Holmes begins to use the same. In an investigation involving uncertainties and humans (like the missing MH370), without Holmes in the picture, the Bayesian way of solving it would be to find the probability of the underlying event occurring, given that the men involved are innocent. The premise or the prior knowledge held is simple i.e. the involved men are innocent to start with.

However, the Bayesian inference by Holmes is different. Holmes believes when one has excluded the impossible, whatever remains however improbable has to be the truth. Holmes tries to solve the problem by attempting to calculate the probability of one’s innocence given all the evidence. The premise or the prior knowledge that Holmes focuses on is the probability of getting such an evidence itself out of earlier such occurrences involving innocent men.

With the search entering the 11th day, I’m trying hard to believe in a miracle. I hope the entire episode gets explained through facts very soon. I hope Holmes does not have to go far into theorizing this mystery.


If Money: Swiss Bank then Data: ?

While my last blog on Internet privacy was a satisfying effort, the groundwork got me exposed to some disturbing details around data collection and the contracts that I have signed up for. With Google’s unified privacy policy, nowadays I either access Google or Gmail from a particular device. I have this feeling, whatever I type and click (be it a MS Word document, PowerPoint) might appear in my friend’s news feed and I think Amazon knows what coffee I’m going to buy tomorrow. If ‘information is wealth’ and when data like crash information of my computer can be of interest to someone, maybe ‘data is money’ too. In my experience, every online vendor has wanted some part of my identity i.e. some data to do business with. In the last few weeks, I was looking for a vendor in the Internet, who simply does business and doesn’t give a damn for one’s identity. Someone who can allow me experience privacy in its literal sense, maybe the way a ‘swiss bank’ treats it? Much to my surprise, I did find one such vendor and it is understandably controversial too.

Switzerland has inspired me through its armed neutrality policy. By staying neutral during both the world wars, Switzerland in a way has earned the world’s trust. Switzerland is also famed for is its banking secrecy (Singapore is a close contender these days). Switzerland’s banking laws are built on the premise that ‘privacy’ is one’s fundamental right and it is a criminal offence to reveal one’s private data. Historically especially in the recent past, Switzerland has been challenged for its banking secrecy and has yielded to international pressure on certain occasions too. Still, most of its banking secrecy laws still persist. By weathering many such storms, Swiss banks have definitely earned the customer’s trust in keeping their information private. Maybe a reason why a third of world’s offshore funds are estimated to be present in Swiss banks.

If I imagine Internet as a medium to express, I would map ‘swiss bank’ experience to the ability to stay totally anonymous in the web. To allow such levels of anonymity, like privacy in Switzerland, ‘freedom of speech’ should be recognized and honored as a fundamental right. Sweden strongly believes in this. Sweden is a pioneer in officially abolishing censorship and more importantly Sweden constitution gives the right for total anonymity in expressing one’s views unless it is perceived as a hate speech. While it is understandably difficult to draw the line, Sweden continues to strive to draw (or not draw) this line. Interestingly Sweden has many parallels with Switzerland. Like Switzerland, Sweden is also famed for its armed Neutrality. Sweden too stayed neutral in both the world wars. Sweden also offers high quality life and was ranked second (next to Switzerland) most competitive nation in the 2010 World Economic forum.

Sweden’s belief in ‘freedom of speech’ makes it less difficult for companies like Wikileaks to host their websites there. I think Freedom of Speech along with Sweden’s location (close to the Artic) makes an attractive choice for green data centers of the future (and present) as well. One specific vendor caught my attention and that is PRQ. PRQ is a web hosting company. PRQ claims to have a spotless track record in hosting some of the controversial websites in this world. Looks like PRQ needs no details about the customer and all what they need is a valid email address to receive an invoice. The disclaimer in their website is simply mind-blowing.

I think if Money: Swiss Bank then Data: Swedish Data Center.

Free Software: When man ignores a walled garden for a forest

Please read him as him/her. Man refers here to mankind/humanity in general and includes everyone in this planet.

In 2008, when most of the world was excited about cloud computing, he called it worse than stupidity. When almost the entire world mourned the death of Steve Jobs in 2011, he said he was glad that he is gone. Although a computer programmer and a techie himself, he advocates paper voting to machine voting. He does not recommend mobile phones. He is against Software Patents and Digital Rights Management, prompting Microsoft CEO Steve Ballmer to call the license he authored ‘a cancer that attaches itself in an intellectual property sense to everything it touches’. He is Richard M Stallman (rms going forward), founder of Free Software Foundation and the author of the GNU public license. I have perceived rms to a stubborn personality and one whose views (when implemented) could cause a lot of inconvenience to the majority. This blog is my curious attempt to get into his mind and imagine his point of view.

‘I prefer the tumult of liberty to the quiet of servitude’ – Thomas Jefferson

Man likes to indulge and more importantly exert his capabilities. Products and services emerge to enable him achieve both of these with minimal effort. Man doesn’t really care about the ‘how’ part in these as long as they don’t infringe in his very ability to exert. When these products and services get prevalent/rigid and when man begins to feel constrained by his lack of choice, a force does emerge to remind mankind of his fundamental rights and basic freedom. Free software is one such force in the field of computing. The motivation for free software arose in a similar context during the seventies, when there was a considerable rise in proprietary software in the form of companies releasing software in binary/executable formats making it impossible for the end user to change or modify them on their computers. In the year 1980, copyright was extended to software programs. In 1983, rms announced his frustration and the GNU project was born. The goal of the GNU project was to develop a sufficient body of free software to get along without any software that is not free.

At the heart of Free Software is the GNU General public license (GNU GPL) authored by rms and we will focus on that. In the most fundamental sense, free software was and is never about money. As rms explains, it is about liberty and not price. The word ‘free’ should be thought of as in ‘free speech’ and not ‘free beer’. A software program that qualifies on this paradigm offers 4 essential freedoms to its users.

  • The freedom to run the program, for any purpose (freedom 0).
  • The freedom to study how the program works, and change it so it does your computing as you wish (freedom 1). Access to the source code is a precondition for this.
  • The freedom to redistribute copies so you can help your neighbor (freedom 2).
  • The freedom to distribute copies of your modified versions to others (freedom 3). By doing this you can give the whole community a chance to benefit from your changes. Access to the source code is a precondition for this.

I consider a river to be a good metaphor to understand the philosophy of free software. The follow of a river symbolizes freedom. The source of a river is analogous to the software written from scratch by a programmer who believes in the above 4 freedoms and opts to distribute it (free of cost or fee) under GNU GPL. Now anyone who is interested in this water can consume it at his own risk i.e. under GNU GPL, he can receive a copy of the software in full and do anything with it. This includes using the software for a commercial purpose, either using it as such or by modifying or tinkering the same to suit his purpose. The risk is analogous to the lack of warranty on the received software. GNU GPL offers no warranty on the received software. The consumer is not obliged to share the software with anyone even if he has received it free of cost. It is only when the consumer decides to become part of the river i.e. when he opts to distribute the software further (as such or the modified version), the license expects him to distribute again in full. This is called ‘copyleft’ a very powerful license strategy to ensure the freedom does not get diluted downstream. There can be no further restrictions added to this software that is in violation with the GNU GPL license. The license is built around this very important paradigm and this is where some of its challenges are. If there is a conflict of any sort, the license expects the consumer to not distribute the software at all. It is either all or none and there is no half-truth whatsoever.

So how does free software differ from open source? I’m sure many of us (including me) think they are synonymous whereas it is not. A well thought out article on this topic is written by rms himself that can be accessed here. As it might be evident from this article, the philosophy of GPL and free software is very fundamental. It is not just about keeping the source code in a software open. While that sure has the practical benefits, the philosophy is much deeper. In a way, it is about asserting what is important for humanity (which is freedom) as well. Any movement that asserts something righteous and fundamental is most likely to be one that inconveniences the most. There is a possibility that the very people who were the intended beneficiaries could reject such a movement. I imagine Open Source to be an initiative (splintered off from Free software in 1998) that intended to address this problem. Open source attempts to get the practical benefits out to the user first before educating him on what is right to him in the first place. While free software is a social movement aimed to respect (and even remind him of) user freedom, Open source is a development methodology that asserts the philosophy that the only way software could be made better is by keeping it open and accessible. Interestingly rms calls them ‘free software activists’ and ‘open source enthusiast’ in his article.

Now I will cite some very specific contexts that have challenged GPL in the past and how GPL has evolved. I believe in all these contexts, rms has stood firm without compromising on the core philosophy. The first context – What if one has a restriction imposed that prevent him from distributing GPL-covered software in a way that respects other users’ freedom (for example, if a legal ruling states that he or she can only distribute the software in binary form). In such a setting, rms asserts the software not be distributed at all. This is the most important change as part of version 2 of GPL in 1991. Rms calls it ‘liberty or death’.

What if the software is open but the underlying hardware is restrictive?  As part of GPL V3, this got addressed (tivoization) and GPL does not permit GPL covered software be installed on such a restrictive hardware.  Again Free software considers laws around DRM (Digital Rights Management or Digital Restrictions Management) as restrictive. Here again rms has stood firm while some prominent open source proponents (like Linus Torvalds) have a differing point of view. Linus’s view is that software licenses should control only software.

What about Patents? GPL addressed this in version 3 as well. Free software philosophy does not encourage patents that too for software on general-purpose computers. If someone has a patent claim on software that is covered under GPL, which he wishes to distribute, GPL prohibits him from imposing a license fee, royalty, or other charge (specific to the patent claim) for exercise of rights granted under this License.

While rms’s views (on software) may not align with the vast majority and could also be inconvenient, when listened to, the philosophy cannot be proved incorrect. The problem with pure indulgence in general is that it blinds one momentarily of his judgment. Like any other thought, freedom along with one’s basic rights need to be remembered and exercised else they might just go away. In line with the famous quote – ‘the price of freedom is eternal vigilance’, in every aspect of GPL revision I do see vigilance. I think free software is a very important force and rms needs to be more than listened to.