Monday, 13 October 2014

Tracking tweets from #OccupySLU protest

Map above gives real time level of tweeting activity around #OccupySLU protest, tweets below show what people are talking about.
For perspective look how much lower it is in downtown Saint Louis.

Monday, 29 September 2014

Another Twitter Protest Case Study: Hong Kong

The current protests in Hong Kong are giving us another case study to see how twitter mobile usage and retweeting are becoming tools of modern protest.  Above is a map of the levels of tweeting from 1 KM radius of the site, and below you see the actual tweets coming fem the area.

One of the things that make this interesting in Hong Kong is that users are well informed about security, and though twitter is active we see not as much tweeting as at a Taxim Square, reports say users are opting for Firechat to hide their identity from Chinese authorities.  If true the days of using Twitter to spy on protests in much of the world may be numbered.

Thursday, 11 September 2014

Tweeting History

The app bellows measures the intensity of tweets coming from, or being RT from, the site of the September 11 World Trade Center attacks.

Thursday, 14 August 2014

Mapping tweets from Ferguson Riots

Ferguson is a small town, but the riots there have given it global presence, reflected in the massive amount of twitter activity taking place there as opposed to the major city of Saint Louis right now. That said most of the tweets are retweets of Ryan J. ReillyVerified @ryanjreilly and Michael Calhoun
@michaelcalhoun.  This reflects the high level of global review of events in Ferguson, which can be measured by the ratios of RT to Tweets for the location.

Tweets and RT geo-tagged for Ferguson at 5:00 AM 14 of August 2014, at the height of riots

The same levee at the same time in Saint Louis, a city of 300,000 residents.  That is 15 times Ferguson's 20,000. 

Wednesday, 30 July 2014

Why Hackers Won't Save the World

Recent tweets from Hacker Of Planet Earth HOPEX conference, with popular meme 'speaking truth to power.'

I was a bit disturbed that so shortly after the MH17 was shot down using Russian supplied weapons that a self proclaimed Hackers conference, Hackers of Planet Earth no less, would carry out a massive love feast for Snowden.  I was surprised by such bad taste.  

This failure to deal with, or even understand, the political clumsiness of giving Putin's guest a platform at such a time underlines serious issues with hackers, and why hacker activism is not going to give us freedom anytime soon.  

Here are the key reasons I hackers are essentially useless as political and social agents for change:

  1. Hackers are elitists. In the communities hackers create they have shown themselves not able to create equality of either gender or race.  Hackers quickly become members of the elite programmer community, and thus are vested in the system as is no matter what they may say
  2. Hackers have terrible mental health.  We all know this terrible ugly generalisation is sadly pretty true. From Impostor Syndrome to Aspergers much of what makes a hacker a talented technologist is purchased at the cost of mental health. Skills of obsession, mass amounts of time to concentrate on a project and necessary isolation from social activities to do the work do not come with mental health. 
  3. Hackers are cowards. Taking on power takes courage. Hackers like to talk about how much courage their leaders and members have but in reality on the ground metal and valour are pretty rare.  Not to mention any names, but a political movement where the shinning stars kill themselves when facing a few months in jail, run to embassies to hide when accused of rape, or flee to dictatorships rather than face the power directly is not going anywhere.  Try to image a resistance to Fascism of Communism which involved running, hiding or killing oneself at the threat of prison time.  When you look at leaders who did change the world, for good or bad, like Che, Mao, Martin Luther King, Mandela, and others you see a willingness to face long prison terms and sacrifice their lives.  Nothing like this exists in the hacker activist community, which will go to great length to avoid any persecution at all.  Cowards never changed history. (for the record I am a coward as well, but I don't present myself as a leader speaking truth to power)
  4. Hackers cannot be trusted. Hackers have a long history of selling out to power, and a large number of hackers have ended up working for state entities to avoid prison time.  I would go as far as to say that anyone who is certain that Snowden is not helping the FSB must be a fool.
  5. A hack is not a solution. Hackers mistake specific technical skill learned via hands on playing around with wisdom gained through reading, thinking and discourse.  Rather hackers rely on re-usable often copied solutions to fudge or work around a problem.  Hacks promote short term shallow thinking.  A world view composed of hacks creates an isolated view of items without connections, histories or meanings.  Rather the world is a collection of hacks, short solutions or work arounds that exist by themselves. 
  6. Hackers are not social. This one is so obvious one wonders why it is not mentioned more often. Hackers tend not to know very much about what other people are thinking and writing who are not hackers.  Hackers tend to lack breath to concentrate on insane levels of depth, understanding a technical discipline and something about popular culture to extreme extents. 
  7. Hackers are shallow. Hackers rarely know much about larger political, economic and social issues. Educational system that producers programmers, or self taught programming, has not given the grounding to political discourse.  Hackers tend to be more interested in popular culture and technology, and often treat the entire world of history, sociology and economics as empty planes.  Kevin Kelly is an amazing example of this, he and the other Whole Earth Catalogue crowd in California have a long history of writing on social issues as if they were the first person in history to even notice that issues existed.  Many nerd types are today writing on issues of society, which they confuse for social networks, as if no human in history had ever noticed society existed.

Thursday, 5 June 2014

Moncton Case Study

Above shows a map of the area where the Moncton shootings took place, below is a picture shortly after the event of tweets from inside that area.

And outside that area but still in Moncton.

Saturday, 17 May 2014

Arsenal wins, twitter goes nuts

This picture shows the tweeting around Arsenal stadium where a lot of fans are celebrating a major victory in the pubs and street.  Below you can see the real time flow of tweets form 1KM radius around the stadium,
London is a very dynamic community and though at midnight about 7% of tweets mentions 'Arsenal' 9% mentions 'Allah'

To put it in perspective there is 70% less tweeting coming from Covent Garden London at the same time.

Monday, 12 May 2014

London's twitter heart pules: a case study in geo-tagged social media usage

Abstract: Geo-tagged twitter heart beats show a mixture of pattern and singularity that likely defects the usage of space in which they come.  For this study twitter geo-tags were taken for a 1KM radius from a number of London locations each hour from Nov 2 through Nov 6 2013.
For this study I look at a week in the life of London, looking at key locations to see the pattern of geo-tagged tweets over a week.

Canary Wharf chart of geo-tagged tweets from 1 KM from Nov 2 to Nov 7 2013; a regular pattern by the work day, with collapse at nigh

The key thing you can say about Canary Wharf above is that clearly no one lives there, Tweet levels sink down to about 0 tweets per hour in the late hours to surge suddenly about 9 am, stay high during the day and then sink back down at night, this is the signature of a place where lots of people go but no one lives.

This shows a real time twitter map of the location, Canary Wharf, you can search anywhere in the world with this tool to see geo-tagged real time tweets for any location.

Hip Sunday Market  


Brick Lane, notice the surge of Sunday Market

Brick Lane is a hip area with a major Sunday Market.  See the massive surge of tweets on Sunday.  At first I thought that was an error in my code but I checked it and on Sunday Nov 3 2013 there was a massive surge in tweets coming from the Sunday market.  Notice also that tweeting remains pretty high most days, but this is clearly a weekend location.

The Commercial Centre

Oxford Street, full of hotels and even some rich homes keeps tweeting 24 hours, but clear surges during the week
Oxford Street is full of hotels and apartments, and therefore never sees an end to tweeting.  At all hours someone is tweeting in Oxford Street.  Surges seem to happen in the afternoon.

The Public Space

Parliament Square, surges during the week, notice the Million Mask Walk and PMQs cause major surge in public and political space.
Parliament Square is another place few people live but many people visit.  You see two surges here, one in the evening of Nov 5 for the Million Man Mask and one in the noon of Wednesday, which is when PMQs tend to charge tweets.

Tuesday, 25 March 2014

Social Media maps social use of space

As a child I used to go to Devil Lake, a park in central Wisconsin.  Devil lake is in some vast country side, bordering on wilderness, lovely in itself but the impact of the lake and the cliff formations created during the last Ice Age has produced a lovely park around the lake.  Year after year we would walk the steps up to get some amazing views including rocks balanced on top of each other.

This map of the area, showing Flickr, shows pretty clearly the path, including a spot where it goes away from the cliff edge, and the roads in to the park.  Interesting that in a remote area Flickr can tell us, when read on a map, that a lovely place exists.

This was created with Search Baraboo Wisconsin and just go a bit south.

Wednesday, 19 March 2014

The web and the real world

It was a very cute trick to have a Snowden robot come in to TED in Vancouver. I am sure the typical TED audience must have felt they were very cool and advanced and enlightened, but that feeling of being cool and advanced and enlightened the the purpose for the strange stew of unrelated factoids that make up a TED conference.  One minute its quantum physics, then schools in Micronesia, then bird migration in Europe.

The talks vary from catastrophic dystopian images of climate catastrophe to optomistic of the potential of technology or just good will.

Its almost as if it does not matter what the subject matter the TED speaker is presenting, what assumptions they make, or if they are telling you that your grandchild are doomed or not: the high does from the sheer eroticism of innovation and information flow.  This is the ecstasy of simulated reality, conferences designed from the beginning to only ever be short YouTube videos, five minutes on one subject matter and then shift.  No attention span required, just a Spielberg defined sense of wonder at the potential of future technology.

Spielberg has become as much famous for his lack of focus as anything else.  He flows from the Holocaust, to cute aliens, to evil aliens, to nightmarish futures to Lincoln.  His moves affirm and deny, horrify and satisfy, entertain and bored.  In turn they are nothing but the ability of a director and his audience not to pay attention, to concentrate, to master.

Thus when TED made his surprise appearance as a robot boy, wearing a badge on his robot body of two bars.  Isn't it all just too cute, a room for the imaginative futurists see the robot boy talk about some kind of nightmare dystopia that he says has already happened in America with a cute little badge around his robot neck.  Yes American liberty is not only doomed, it no longer exists, the freedom of speech that everyone in the room is engaging in is already an illusion, how horrifying.  And how wise and innovative it makes everyone participating feel, now lets hear about Bill Gate's work in Africa to make himself and the rest of us feel better.

The fact that Robot boy had a source didn't seem to matter.  Not in a binary world which takes ON/OFF switches for the fundamental atoms of existence.  TBL has assigned Snowden the value of Hero in the binary of Hero xor Villain.

And where is the source of Robot Snowden.  Somewhere in some other reality there is a city called Moscow, where a complex called the Kremlin exists.  This inconveniently real place is providing Snowden not only asylum, but somehow they are allowing him access to these robot AVs,  internet connection, someone has to pay the bills for all this stuff.  And in Russia someone has to approve this stuff, you don't just get to call in to a TED conference if you are Pussy Riot.  Putin's Kremlin has to say yes.  And they say yes for a reason.

At the source of Robot Snowden the Kremlin is shutting down the last remaining voices of Russian descent as Putin aims to annex Crimea in to the Great Russian Fatherland.  As Snowden tells Americans that they are not free and they all live in an Orwellian nightmare, and as the participants all tweet about how they are not free and living in an Orwellian nightmare, Tatars, Ukraine's and Jews are leaving Crimea.  A new Cold War is being started from this Kremlin that is source of this Robot Snowden.

Oddly in Second Life people seem to be upset when they learn that the girl they have been having a virtual affair with it actually a middle aged man or an underaged child.  But this is only possible because for a while the player, in the eroticism of communication, took the message for the reality.  Only in the bliss illusion is it possible to have a collapse of revelation.

Events coming from Russia will have a profound and negative impact on the lives of everyone at the TED conference.  Not as profound as on the real losers, the people of Ukraine and Russia who are entering a dark period of their history, but still negative.   Perhaps like Greenwald they think that if they don't tweet about it it won't touch them, but the truth is their Internet connectivity to the world has become itself a blinder.  What is emerging in Russia is a new threat to global freedom and security that will impact everyone, a threat behind the Robotboy Snowden and his news of American evil.

Friday, 28 February 2014

Ukraine tweet dashboard app

This dashboard allows users to monitor the tweets coming from the fluid situation in Ukraine.

UPDATE March 19: While Ukraine is a buzz of tweeting, Crimea has gone almost entirely silent, is this chaos or have the Russians shut mobile web down, or are people just afraid.  Likely not fear because there are not even trolls supporting Putin.

Kiev Maiden Protest site Sevastopol Parliament

Thursday, 6 February 2014

Brazil tweets

Tweeter is becoming very popular in major cities of Brazil, and as people are more likely in emerging economies to first encounter the internet via smartphones than PCs or laptops a great deal of geo-tagged tweeting takes places in Brazil's major cities. Here are some apps tracking real time tweeting in Brazil. Tweeting app for Rio Tweeting app for Brasilia Tweeting app for Sao Paulo

Monday, 3 February 2014

Twitter about this blog

Friday, 24 January 2014

Looking at Governors and parties in US

PoliticoMagazine has ranked all 50 states in the United States.  The method is pretty objective:

"With this in mind, Politico Magazine rounded up 14 different state rankings from reputable sources like the Census Bureau, the Centers for Disease Control and Prevention, and the FBI, and on important factors such as high school graduation rates, per capita income, life expectancy and crime rate. Then we averaged out each state’s 14 rankings to come up with a master list—atop which sits none other than New Hampshire."
The result is graphed here, showing all 50 states, Blue bars are a state with a Democratic governors, red is a state with a Republican governor. 

Big Brothers big failure

Many people in Ukraine have received txt messages indicating that the phone company, and thus the government, has them registered as protestors.  People have responded to this with concerned statements that it was 'Orwellian' which means they are again linking it to the idea of Big Brother in Orwell's most read book 1984.

And what was the response?  The protests in Ukraine have expanded, the government has been forced for now in to a retreat.

Seems Big Brother has failed.

In fact if you re-read 1984 you will notice that Big Brother failed at the end of the book.  Everyone takes the sufferings of Winston and his final destruction by the party as evidence that Orwell believed that the technology of surveillance and psychology along with ruthless ideology could crush the individual and reduce humanity to a machine.

Assange and Snowden, along with many people in the EFF and all over the web are fond of pointing out that the current technology of agencies like the NSA dwarf anything Orwell could have imagined back in 1948.  And on a level this is true, were are being watched all the time and the state and private companies, along with criminal groups, have massive amounts of data about us, they have been collecting it for a long time.

But does the collection of data mean effective execution of power?

The final line of 1984 is written in lovely, complex, subversive and critical English:

It was chiefly in order to allow time for the preliminary work of translation that the final adoption of Newspeak had been fixed for so late a date as 2050.

But obviously the existence of the sentence above proves that in the end Newspeak and the project of Big Brother failed.  The novel closes with discussion of the Declaration of Independence, of Milton, Shakespeare, Byron and a discussion of freedom.

In fact Orwell closes the entire peace with 'The Principles of Newspeak' where he opens:
Newspeak was the official language of Oceania and had been devised to meet the ideological needs of Ingsco, or English Socialism.
Not only is the state clearly set in the past but it is clearly political, it was the kind of statement Newspeak was suppose to make impossible, but somehow in the future Ingsoc and Big Brother and Newspeak vanished and English and Shakespeare and the Declaration of Independence survived.

Clearly Orwell didn't think much of Big Brother's long term chances.

And neither should we.  Just possession of data about subjects in a society does not give power.  Every parent knows this.  They know so much about their children, and this knowledge can come to such little effect.  Anyone who has worked as a school teacher, a social worker, a home care giver or a police officer can tell you that though information is critical, it is more often than not of limited value in controlling the subject.

Foucault was certainly brilliant for his insight that modern prison created a regime of surveillance.  But Foucault also understood that power always created its own opposition, that these regimes of watching resulting in regimes of hiding and deviance.

Yes the United States has a historically unprecedented ability to collect, store and manage information about not only its people but the people of the world.  And yet how much has this ability given it?  Did it enable the US to win the war in Iraq?  Could reading people's mobile phones or emails enabled it to end the conflict in Syria?  To stop protests in Europe?  Was the US able to stop massive leaks of its data by Manning and Snowden?

If I was given control of the NSA tomorrow the first thing I would look at, before abuses, is value for money.  How much reduction in crime, terrorism and radicalism did all this work get the US?

I think we should remember Gödel who proved that mathematics could not be fully reduced to logic, that statements could be true but could never be proven.  If mathematics, the most formal activity humanity undertakes has pieces of illogic installed in it then what for people.

The reality is that humans are not formal systems, that if you know every fact about a person they can still surprise you.  Humans are very good at hiding their true intentions, changing their minds before anyone can learn about it, and engaging in irrationalism.

As I write this it is being report that the 2012 Philpott murders in Derby England, where parents set fire to a house with their own children inside killing six children, could not have been predicted.  The UK is the ultimate surveillance state. The Philpotts would have been monitored not only by police, school and social workers.  The Philpotts may have been one of the most watched families in the world.

And yet after the murders of the children the Council had to conclude that there was no way that anyone could have predicted the outcome.

I was in Cairo at the start of 2011.  Even though it was pretty obvious the Regime was not popular, there was no reason to think that in 2 months a revolution would break out.  I travelled through Spain in 2007 and what reasons were there to conclude the booming economy was about to collapse.

Perhaps the most obvious example is the 2008 stock market collapse.  Not only did some of the worlds most advanced computers and analysis software fail to see it coming, to a large extent the existence of this software promoted and may have caused the collapse.

My reading of 1984 is a bit different than most.  I see O'Brian in a desperate effort to remove free thinking and descent, his vicious confidence is a defence mechanism from the fact that no matter how much the Party cracks down on humanity, humanity remains time and time corrupt, irrational, selfish and free.  I see the massive data collections by Big Business, Big Brother and Criminal Groups as much a desperate effort to try and find something of value, an effort that has failed again and again, and always will fail.

Tuesday, 21 January 2014

Tweets coming from #BenefitsStreet

With enough people talking about them on twitter what are the people who live on the now famous Benefits Street tweeting about? Most ordinary stuff, some humour about the show, some anger.

Monday, 13 January 2014

Twitter map of #KellyThomas verdict

Social Media and retail Christmas in London

The analysis I did below shows me the limitations of extracting data from social media activity.  From November to December the UK retain sector saw strong growth, that I could not see in the Twitter and Foursquare data.  Either I missed something or the information was not captured.  But trend line analysis after analysis showed no significant rise in tweeting from shopping areas in London.

This chart shows hourly tweeting for Oxford Street from through November, December, and early January.
Analysis of the levels of tweets coming each hour from a KM around Oxford Street through November and December fail to give an evidence of a major surge in foot traffic on London's main high Street in the run up to Christmas or even on Boxing Day.  This does not establish casual evidence that the recovery is in any trouble, but there is a lack of social media data coming from London.

Beyond the lack of a bump in Tweets coming from Oxford Street there is a dramatic lack of Foursqaure  checkins to major retailers in London, with only Selfridges & Co, Apple Store and Liberty showing significant foursquare checkins.

Most Foursquare activity were at public spaces and events, leading me to wonder if people were looking for cheaper days out.  Tate Modern, Covent Garden and public Markets were major locations for Foursquare.

It is very hard to draw conclusions from Twitter and Foursquare public data, but these numbers do not indicate a large surge in Christmas shopping at the end of 2013 in London.