Tuesday 18 October 2011

Social media listening ethics: some thoughts

Debate on the ethics of social media research has flared up in recent months with some eminent names taking diametrically opposed points of view.

A good starting point is the lively debate surrounding Brian Tarran's excellent post on Research Live. There have also been a couple of good posts on the Digital MR blog recently which address the pertinent
issues head on. They are clearly worried that new guidelines will restrict their ability to do their job effectively, and leave them  vulnerable to providers from non-traditional research backgrounds who may not be subject to the straitjacket of a code of conduct, and therefore be able to provide research solutions quicker and more cheaply, which is definitely the trend. Their worries are certainly valid.

My own take on it is this. The principle of informed consent should still be the starting point. There are a lot of people making loud noises about social media research being "different" from traditional market research. This is true...up to an extent. But my worry is that the motivations for wanting to water down the restrictions on data usage are business ones rather than ethical ones. "If we restrict ourselves then there are non-MR companies out there who will move into our space" simply does not wash as an excuse for lowering standards.

Ray Poynter has made a series of thoughtful posts on the issue and neatly breaks down the issues. In August he wrote:
"The benefits of traditional market research ethics were that they allowed some exemptions to laws (e.g. data protections laws, laws about multiple contacts, laws about phoning people who were on ‘no call’ lists), increased public trust, and allowed market research to get close to a scientific model – for example to use concepts such as random probability sampling and statistical significance. Complying with codes of ethics incurred extra costs, but they also brought commercial benefits. The ‘proper’ market research companies could do things the non-research companies could not - so there was a commercial argument in favour of self-regulation, codes of conduct, and professional conduct bodies."
Why can't this continue? Annie Pettit reported that Jillian Williams from the Highways Agency, said that anonymity is important to clients as they will take the flak rather than the research industry. Ray then appears to contradict himself slightly by saying "If market research companies abide by the old ethics, in particular anonymity and informed consent, they will not be able to compete for business in most areas where market research is growing. This is because there will be no commercial benefits that will accrue to sticking to rules and ideas that nobody else does." Surely the majority of clients, if they are looking for a genuine market research study, will want to stay firmly within the "rules" whatever they might be. There was an almighty stink when Nielsen Buzzmetrics were found to have scraped a healthcare forum that was ostensibly private. I actually had some sympathy for them - they were exploring new ways of collecting data, which in itself is quite legitimate - they'd just made a mistake in the execution and hadn't thought hard enough about the wider implications. They took the rap rather than the end client that time, but no client wants to be caught up in a grubby web scraping scandal.

Anonymity is a sociological issue that's very a la mode - there's an interesting post on the ever-excellent Face blog about current trends for real names versus pseudonyms; meanwhile debate rages over Google+'s insistence on real names. What about agencies using monitoring services such as Sysomos or Radian6 or in-house tools? These generally provide the capability to drill down to individual posts, tweets and so on, which can be sent directly to the end client. Perhaps some sort of deals could be set up with the dashboard providers whereby data is automatically anonymised in certain situations. And what about client-side monitoring, which may be informal reputation management/PR or a more in-depth research project. We must be careful not to set guidelines that are restrictive merely because the technology is so good. The principles should apply no matter what fancy new algorithms (buzzword...ugh) are created.

There is also a difference between qualitative and quantitative data. There is an enormous gap between a qualitative study which drills down to individual tweets, forum posts or Facebook status updates and sends them - warts, personal details and all - to the end client, and a large-scale overview of aggregated sentiment-analysed anonymised data which may say nothing more than "there has been a 17% uplift in sentiment from Yorkshire women on Twitter towards the value for money of Fabreze in the last 6 months" or whatever. (What is Fabreze, by the way? It's something which I know my girlfriend spends money on and is almost certainly totally unneccessary - beyond that I haven't got a clue).

The next question over anonymity surrounds platforms. Bloggers, for example, are posting opinions which they want to be heard; furthermore, bloggers generally have an easy choice whether to remain anonymous or not. Many do, others are quite happy to be identifiable. In my book they're about as close as you can get to "fair game". Forums are somewhat similar. At the other end of the scale, you have Facebook; I would hazard a guess that many people whose profiles are set to public are actually unaware of the fact, and have simply been confused by Facebook's ever-changing T&Cs, not to mention their tendency to play fast and loose with privacy. Add the fact that Facebook profiles are usually in real names - and easily identifiable with photos and so on - and this adds up to an ugly mixture of possibly unwanted intrusion combined with ignorance of the fact. A far cry from the "informed consent" principle if researchers start harvesting their data for business purposes.

Then there are idiosyncracies of the social networks. Should there be a difference between the attitude to privacy of someone saying "I wish Nature valley cereal bars were sweeter" and "I wish @NatureValleyUK cereal bars were sweeter"? Is the second option crying out for attention - by researchers?

Michalis Michael from Digital MR says
"Finally a specific minor detail which is most important from a DigitalMR perspective is this: when using quotes in MR reports, we (MR agencies) should not be asked to mask the handle/meta data of a person who posted a comment on a public website – if that website states that posted comments can be viewed by anyone."
I think this depends on what is being done with the data. If the data is quantitative then I believe it should be anonymised - at least before it reaches the end client who needs to make the business decisions that follow the research. For qualitative data perhaps another set of rules should apply;

Ultimately I suppose the question needs to be asked "what are the purposes of these ethical codes anyhow?" I've even heard people criticising the Data Protection Act itself - this smacks of tobacco companies criticising smoking regulations. The Data Protection Act was drafted to bring UK law into line with EU privacy directives and the European Convention on Human Rights. These are fundamental directives; they are universal. They provide for people to be able to live their day-to-day lives in a normal way. They enshrine into statute principles of common decency which are inherently part of human nature. Thanks to UK implementation such as the Data Protection Act and Human Rights Act, we are able to do this. The Code of Conduct must use these principles of common decency as its starting point, and leave "but other people are doing it" wheedles to the minor details. The ever-excellent Annie Pettit speculated the other day that a lack of grounding in the "old" ethical MR principles has led to a slackening of attitudes towards privacy. This sounds very plausible, but a lot of it seems just to be a frustration with, or fear of, not being able to work efficiently, particularly if there is "competition" out there coming from a different background who will cheerfully sweep up the work without having to worry about pesky obstacles like common decency.

All this still doesn't quite square with the fact that this social media data is publicly available, sitting there for the world to see, and common sense would seem to dictate that it would be daft to deliberately close our ears to mountains of conversations that are taking place in the public domain. It is undeniable that it is impractical to contact thousands of people individually and ask them whether the sentiment expressed in their Facebook status yesterday may be used for market research purposes. It is also unlikely that many people will feel there's much of an intrusion of privacy from Jack Daniel's picking up on the fact that someone has publicly moaned about it being too expensive, and using that to influence their pricing stategy. But it must be done in such a way as to minimise disruption to people's lives and not fuel speculation that businesses are running slipshod over personal data. Is there a difference between "private" and "personal"? I think so, and perhaps it's a definition that needs to be made explicitly. In general we may need to re-think the "informed" concept and define in what situations "informed" means "explicitly told personally".

I think there are direct parallels between the issues faced by social media researchers, and the police and the Regulation of Investigatory Powers Act (RIPA): for intrusive "directed surveillance" authority from RIPA is required - because that involves targeted "stalking" if you like, of a particular person. You also need RIPA authority for similar work online. But there's no requirement for a RIPA for simple day-to-day casual monitoring. If an officer in plain clothes spots someone doing something he regards as suspicious, there's no need for a court authorisation to discreetly follow that person down the road to find out what he's up to.

As Steve Cooke of Digital MR points out, it is true that social media listening is different to other forms of social media research such as communities. But offline ethnography is subject to pretty strict controls and to informed consent principles. Social media conversations - even "person to person" conversations such as @messaging on Twitter - may be in the public domain, but any offline conversation in public is monitorable if you have a big enough pair of ears. Social media listeners must be careful that the sensitivity of their "ears" doesn't mean they abuse their power. Perhaps there is a case for abandoning long-standing principles - but it shouldn't be merely for convenience purposes.

Sunday 16 October 2011

Bivvying in the Brecons

Just got back from a weekend in the Brecon Beacons where we experimented with bivvy bags for the first time. Both my mate Duncan and I had no experience of bivvies and tarps before so it definitely had the potential to go wrong!

We parked up near Glyntawe on Friday night, arriving around midnight, shouldered packs and headed up for about half an hour to gain some height and find a nice place to camp. There were plenty of little dips and hollows, and the terrain wasn’t too bad.

Brecon Beacons

I was using a Terra Nova Competition 1 tarp which at £40 in Field & Trek and 180g represents terrific value. It’s a simple affair, with both loops and eyelets in all the corners plus halfway along each long side. Having done some internet research the only conclusion I could draw was that there was no right or wrong way to pitch a tarp, so I had a go at an A-frame setup to begin with. It wasn’t the best of starts as I realised I had left my tent pegs behind; fortunately there were plenty of rocks around, and Duncan had spare pegs as well.

It was painful progress in the dark but somehow I managed to get some sort of structure erected, and then hoped that waking in the morning I’d find the tarp still over my head.

What am I supposed to do with this thing?
Progress was slow but steady.


This was what I woke up to:


The view was nothing to shout about, but there’s a thrill about opening your eyes in the morning and getting the grass right next to your head and the wind on your face, which a tent just can’t provide. Duncan had a worse view to endure though.


This is the life. Duncan, meanwhile, had opted for a Terra Nova Jupiter bivvy bag, which has a hoop and therefore requires no tarp. It looked like this:


As for the tarp, my guylines were far too long, especially in the corners, which meant that it was a very flat “A” shape. No matter, not bad for a first effort, and how bloody cool does this look for a camp.
I don’t use trekking poles normally, but wasn’t creative enough to think of anything better, so reluctantly I picked up a cheap pair from Lidl. Apart from use as tarp poles they remained entirely untouched for the duration of the weekend.


Our route was fairly short but we found a promising-looking tree under which we intended to camp, and wanted to get there before dark, so that shortened the day considerably, especially as since we didn’t get to bed until nearly 2am we’d made a late start. We crossed the Cwm Haffes, up the flank of Fan Hir, north along the top of the ridge and along to Fan Brycheiniog where the path joins the Beacons Way. Fan Hir is a dramatic walk – a perfect quarter pipe with some pretty steep cliffs at the top.
Here’s a view back at Fan Hir from the north:


Once the path joins the Beacons Way it’s basically a flattish yomp around the edge of the plateau with some pretty spectacular views.
That’s looking back towards Fan Brycheiniog. The next one is looking in the other direction (westwards).
Then we cut south through some pretty boggy ground before skirting round near to where we started to pitch up our bivvies again.


The second night, with a little more confidence, I decided to pitch a slightly tighter “A” but keep it nice and high given how calm the weather had been.
The rest of my setup was: Alpkit Pipedream 800 (which proved a touch on the warm side) inside a Rab Alpine bivvy bag. The Rab is spacious inside, has a good zip although it could do with being an inch or two longer on each side, feels durable and proved both waterproof and stayed remarkably condensation free – hardly surprising given that it’s made from eVent fabric. A foam mat (Karrimor, £3) underneath proved highly successful.

We set up and headed for the pub. Unfortunately I forgot to completely close the bivvy bag zip, so the hood of the sleeping bag was soaking with dew when we returned from the Bryn Arms. This means that my face was cold and damp for the whole night. Bivvying really teaches you discipline! By that point I was pretty cold and wet anyway: I was wearing trail shoes (Inov-8 Roclite 315) which aren’t waterproof, and didn’t bring a change of socks. There’s boggy ground all over the place, and boots would probably have been a better idea, perhaps we got a little carried away by the minimalist ethic.

The two bivvying systems are very different. The Jupiter is a self-contained sleeping system – not needing a separate tarp means (1) you save a little bit of weight and (2) there’s no risk of the tarp bowing away in the night. On the down side, Duncan reported that is was VERY snug inside (he’s 6 feet and was using a Pipedream 600 sleeping bag), there’s nowhere to keep your rucksack dry, and getting in and out of the bivvy bag in bad weather would be a horribly uncomfortable experience; needing a pee at 3am in freezing rain wouldn’t be one of life’s greater moments (by contrast I did a pee on my knees from my sleeping mat, but maybe that’s too much information). Tarps, meanwhile, are versatile, although you’ve got to be careful to try and keep the weight down to around a kilo for tarp + bivvy, because you’re already in lightweight tent territory there. The exhilaration of sleeping truly out in the open definitely gives the bivvy bag some extra utility though. Does life get any better than this…?


We had had incredible weather over the course of the day for mid-October, but the rain set in overnight and the breeze picked up. I spent most of the night worrying about the stability of my novice tarp pitch. There’s a hell of a lot of noise from it flapping around, too. In the event, however, the tarp stood firm (in future I’ll pitch it a lot lower) and this was how it looked in the morning (wind’s coming from the left):
Life couldn’t get much better, really, although bivvying does alter your definitions of comfort somewhat. Sleeping in a zipped up bivvy bag isn’t the most comfortable experience and temperature regulation is tricky, but the freedom and rawness of the camping more than makes up for it. Going minimalist definitely does have its kicks – all my kit was stuffed into a 32 litre bag. Not something to try in bad weather though!