Skip to main content

Amazon's A-B Testing and Government Applications

One of the benefits of scientific research is that by being empirical or experimentally driven it avoids circular and endless discussions on what works or should work. You can just check it. You test to see what works. Jeff Bezos described in a Stanford lecture how Amazon utilizes this testing in it's site live to verify improvements. The ability to test which option is best increases efficiency as it cuts down not only on inefficient options but also on the time that would have been spent discussing the pros and cons of each approach. At Amazon this approach is called A-B testing. Where one option "A" is tested against option "B" and the results are seen immediately. This data-driven approach is what makes science edge out over other disciplines, and it's one that seems sorely lacking on the social sciences, where argument rather than data still reigns king. It doesn't matter that "trickle down economics" didn't have it's intended effect if the data is analyzed, what matters is that the argument sounds right and wins out over it's opposition.

I think it's high time that this data-driven approach be brought to our public institutions like government. In Amazon's elegant A-B testing approach (possibly with the addition of a C control) would be fantastic to test approaches with real data as opposed to talking heads on congress or the media. Think about simple things such as tax laws. Imagine if instead of it being driven by mere legislators it was goal driven and experimentally tested. Many laws fail in its intended purpose because debate or rationally doesn't drive human behavior. We are emotional creatures and not driven by cool dispassionate reason. Society's glorification of reason is a offspring of the Enlightenment the period that saw the birth of the nation of the United States. The Enlightenment which held reason above the then wide authority of the church, found liberty and practicality in its look at rationality. But now we're hitting the limits of such view. We are seeing the failure of reason. We need to use experimentation more. Forget about what "should" work and see what actually does work. What's great is that this is being used by businesses now. We don't have to invent it. Amazon does it with it's A-B testing and gets real time results. Can't we do it with laws too? How much easier would it be to vote on which tax law to approve or which ballot initiative if the data was already in? It may be hard to convince someone that changing something can be beneficial without this data but far more dangerous are things that sound rationally right but experimentally fail to accomplish their set goals, like the supposed "benefit" of trickle down economics.

Comments

Popular posts from this blog

How to configure Ubuntu's keyboard to work like a Mac's

Typing accents on a PC is a complicated Alt + three numbered code affair. One feels like a sorcerer casting a spell. "I summon thee accented é! I press the weird magical key Alt, and with 0191 get the flipped question mark!" For a bilingual person this meant that writing on the computer was a start-and-stop process. With Mac's it a whole lot easier, just Alt + e and the letter you wanted for accents and alt + ? for the question mark. No need to leave the keyboard for the number pad and no need to remember arcane number combinations or have a paper cheat sheet next to the keyboard, as I've seen in virtually every secretaries computer in Puerto Rico.

Linux has a interesting approach to foreign language characters: using a compose key. You hit this key which I typically map to Caps Lock and ' and the letter you want and voilá you get the accent. Kinda makes sense: single quotation mark is an accent, double gets you the ümalaut, works pretty well. Except for the ñ, wh…

Contrasting Styles of Writing: English vs. Spanish

There is interestingly enough a big difference between what's considered good writing in Spanish and English. V.S. Naipul winner of the 2001 Nobel prize for literature publish an article on writing. In it he emphasizes the use of short clear sentences and encourages the lack of adjectives and adverbs. Essentially he pushes the writer to abandon florid language and master spartan communication. This is a desired feature of English prose, where short clipped sentences are the norm and seamlessly flow into a paragraph. In English prose the paragraph is the unit the writer cares about the most.

This is not the case in Spanish where whole short stories (I'm thinking this was Gabriel Garcia Marquez but maybe it was Cortázar) are written in one sentence. Something so difficult to do in English that the expert translator could best manage to encapsulate the tale in two sentences. The florid language is what is considered good writing in Spanish but unfortunately this has lead to what …

Fixing Autocomplete in Github's Atom Text Editor for Ruby

I really like Github's Atom Text Editor. I really like that it's multi-platform allowing me to master one set of skills that is transferable to all platforms and all machines. 

On thing that just burns me of the default set-up in Atom is the Autocomplete feature that seems to change my words as a type them. Because Ruby uses the end of line as a terminus for a statement you usually finish a word with pressing the return button and you get really annoying changes to your finished typed word a la MS Word. I find myself yelling "No that's not what I wrote!" at the screen in busy coffee shops.

I disabled autocomplete for a while but it is a very useful function. Then I found out they changed the package that gave the autocomplete to a new one called "Autocomplete Plus" that gives you more options. All that I needed to change to make autocomplete sane again:

1. Open Atom's Preferences
2. Search the bundled packages for "Autocomplete Plus"

3. Go to t…