The Mine! Project

open source project for online data and relationships logistics

Twitter analytics for individual users

TAGS: None

Lifehacker founder, Gina Trapani, has been working on an interesting new Twitter app:

Tentatively called Twitalytic, it’s a self-hosted web-based application that grabs your tweets, archives them, and uses them to give your some interesting data about the people you follow and those who follow you.

This is the kind of analytical functionality that I think is missing on the web, available to individual users, for their benefit. Informed user is a better user and the more I can play with my data, the more I find out about my behaviour, the more understanding and hopefully autonomy I can have.

Open, distributed and yours…

TAGS: None

What with FriendFeed selling out to Facebook, the less those of us who have been harping on about user autonomy, self-hosted or user-owned apps and technology look like online equivalent of survivalists.

The prospect of a distributed, interoperable, self-hosted network of publishing, reading and discussion tools is nothing new – but the idea is gaining a lot more support as more people react to recent news like FriendFeed’s sale to Facebook, Tr.im’s up and down and Twitter’s denial of service attacks. The tide may not be turning, but there’s sure to be some new waves of innovation that come out of this period of frustration.

Marshall Kirkpatrick of Read Write Web does a good job of explaining why blogging and a WordPress type platform won’t be enough to replace services like Twitter. Yes, it publishing & distribution vs communication and relationships.

If we all had a little piece of our microblogging network on our own servers and they spoke to each other, that couldn’t happen.

We’d also own our own data, our archives, our interface design and more. It would be like publishing little messages… like grown ups.

Indeed. Identi.ca has been designed to do precisely that – though you don’t get your stuff automatically, unless you federate and use your own server to install Laconica but it’s already a giant leap for microblogging.

There are two more interesting items mentioned in the post – The Push Button Web and the DiSo project. We have looked at both and in short, the first depends too much on an intermediary, namely PubSubHubBub (obviously a lot depends on who can be such a hub and then the reality of who would be) and the other depends too much on a new XML based data standard.

Anyway, what’s worth noting is this conclusion:

Are all of these circumstances and conversations going to push the social web over the edge, toward a more distributed and less centralized model? Probably not in a big way, immediately, but we’re pretty sure that some interesting innovation is going to come out of this. Dissatisfied engineers, working on a problem that a lot of people are interested in, can produce some fun and important work.

Dissatisfied engineers and hopefully growing number of users, might provide momentum for an alternative, distributed approach to online communication and data logistics. This is where Mine! comes in. And although Mine! hasn’t been conceived for communication, it will also serve as a platform that belongs to the user.

Alec often describes Mine! as “asocial” software, not because it cannot be networked and connected to others but because it offers the user the option to withdraw from the network and join on his/her own terms.

Feeds, feeds everywhere

Tags: ,

There is lots going on around feeds, flagging up a few here.

Steve Rubell:

…while feed adoption may have crested the idea of online opt-in communications is just getting going. The Facebook newsfeed, Twitter and Friendfeed are perfect examples of opt-in vehichles that bring content you care about to you. In each case, you’re total in control. You can unsubscribe from individuals or groups and tailor the stream so that what you want finds you.

RSS is only one form of opt-in communications. The potential is bigger when you look more broadly to social networking. This larger promise still holds and as the technologies become more invisible the newsfeed could even one day subsume RSS.

I get what Steve is getting at, this feed business is more than RSS. But I don’t think social networks are truly social when it comes to sharing. Newsfeed is but one way of sharing. It is like relationships via hosepipe. I’d like to be able to do more than just just turn on and off the flow. I want to have hot and cold taps and several different water supply requirements.

Marshall Kirkpatrick:

Newsfeeds are everywhere, they are an arguably efficient and pleasing (for some) way to relate to an unending supply of information. Some people find them overwhelming, others say they are a waste of mental energy and surely some will insist they are bad for the human brain’s ability to remember anything from one day to the next.

So it seems newsfeeds (Facebook, Friendfeed and many others) is here to stay but I want individual need-to know briefings too. It’s not an issue of privacy, but my ability to use data-sharing as a social gesture. At the moment, it’s a bear hug or crushing of the hand or a large kumbaya all around, with little ability to elegantly and discreetly tap dance around social nuance and relationship pitfalls. And I am not even talking about the dance of Seven Veils!

Have I mixed enough metaphors to get the point across? I sure hope so.

And John Udell for the other side of the feed divide:

…you need feed aggregators. These proliferate in blogspace but, I argue, are conspicously absent from calendar space. Services like Eventful and Upcoming produce calendar feeds. But because they do not consume them, they don’t encourage individuals and groups to publish feeds, and to think and act in a syndication-oriented way. I’ve prototyped a calendar aggregator at http://elmcity.info/events/, but the category isn’t yet well-established.

If my analysis is correct, one or more well-known services that both consume and produce calendar feeds would unlock the latent potential of iCalendar and help us jumpstart a calendar syndication ecosystem.

Better yet, add this functionality to Mine! or improve existing feed readers. With Mine! we are starting with what’s around now, google reader being a good standard. I am hoping that with more granular and nuanced feeds, it will make sense for feed readers (and other applications) to follow suit and help users find their way around information coming their way.

Streams

Tags: , ,

This resonates:

So when you think of digital presence – the online shadow of your physical/spiritual presence – how would you best want to represent that? The emergence of streams in our digital lives is, in many ways, aligning our thinking in a way that we are only subtly appreciating. I see this every time I overhear someone trying to explain Twitter to another. There’s futility in writing straplines and elevator pitches for something that is quite fundamental to the way we experience life.

Greg of Social Twisters then talks of finding the best web services that helps up build and run our own real-time personas online.


* Who – Facebook? LinkedIn?
* What – Twitter? Pownce?
* When – Upcoming? Socializr?
* Where – BrightKite? Dodgeball?
* How – Qik? Seesmic? Blogs?

All those are useful, I use most of them. I want the functionality they provide. But I also want to retain my data and use it in ways that they can’t. In other words, I want somewhere where I keep my data and functionality comes to me, rather then me giving up my data in exchange for functionality. Then I will become the source of the streams that reflect my identity, aspect of life and relationships.

Truly social software?

Tags: , , , ,

When describing how the Mine! could help me manage my data better than the existing applications I use, one of the examples I describe is uploading photos to Flickr and trying to structure them.

Flickr is a flow of photos and I am not really in charge of how they are organised. For example, I have 100+ wine photos as part of my wine interest. If I upload all of them, that’s what people subscribing to my Flickr will see as they all appear in my Flickr stream. I have a choice of a couple of combinations of friends & family settings but that does not solve my problem: I may want some people to see the wine photos and I may not want others to be bored by a bunch of wine bottle shots. Some people may not be on Flickr, so the privacy settings don’t help.

On another occasion, I needed to share photos with my mother who is not on Flickr. It was a practical need – we went shopping together for items for her apartment and the photo set was meant to help her remember and decide what to buy and exchange notes and comments on the photos. I couldn’t make it work. I tried setting a new account for only those photos but there were too many for a free account and I didn’t feel like paying $24 for this simple use. I tried signing her up to Flickr, as a family contact, and uploading the photos with the family setting. This was awkward as I don’t necessarily want other contacts with the same privacy setting to see those photos or me being forced to change their status permanently…

I needed my own space, not just for communication or publishing but for my own notes for future reference. Then I also wanted to share it with those who might be interested in my wine photos or window-shopping.

I want two basic functionalities from the online tools, which help me organise my life and connect me with people. First, I want to capture and sort out my data, upload photos, take notes, cross-reference information, etc. For that I need applications that are more analytical than the current social media/web tools. Once I organise my stuff, I want to go on sharing it in ways that are more social than the current web 2.0 tools allow me to be.

But isn’t social networking all about being social? Not quite. At the moment, I don’t drive who gets to see what beyond simple decisions about who is ‘in’ and who is ‘out’. Social interactions and relationships are far more granular than social networks allow them to be. Usually, this is seen as a privacy issues and results in a complicated access management e.g. Facebook privacy settings.

Why do we have our relationships pre-determined by others such as Facebook, Flickr, Plaxo etc.? Presumably to give us more ‘control’ over our social network and contacts in it. But how is lumping people into categories imposed by an application helping me to be social? By determining the types of relationships I am able to have – business contact or colleague, family or friend, I am not able to reflect relationships I already have. The best social software is not online, it is loaded on to my cortex. And no software can fully map the relationships, let alone replace our natural ability to create and maintain them.

Privacy is merely the other side of the coin of complexity in human relationships. My ‘privacy settings’ are inherent in my behaviour. My privacy policy should not be embedded in any software. In that sense, software cannot be social (or antisocial), though it can help me be more or less social. Software privacy settings limit my ability to be truly social i.e. capable of maintaining complex relationships and interactions with others – arguably the purpose of such tools.

The Mine! needs to satisfy both requirements of my online life – allow its users to organise data differently and support people’s relationships as defined by themselves.

Let’s deal with the data in this posting – I will do the privacy & relationships in a future one.

For some type of data a flow is just fine – e.g. Flickr, FriendFeed, PlaxoPulse, Facebook etc. Structure sometimes emerges – sets, rooms, groups. For other purposes I may need alternate data structures and new functionality to build them. A pool of tagged objects is a good start, it is flexible and not determining how the data is organised. The user who generates the data also owns the actual raw data, as opposed to its formatted representation – e.g. Facebook, Amazon reviews. There will therefore, be many more options how to manipulate them. (For more see Models of Data Imprisonment.)

Various ways of thinking about data structures…

  • created prior to data input as a skeleton for data with known or standard structures to be stored in later – perhaps medical or financial data or other complex data
  • created with input of new data – when you upload photos, you create sets; when you bookmark a link, you add tags and notes etc
  • created on retrieval – the hierarchy or structure emerges at click of button depending on what you are looking and on the flow or the dynamic of the data, e.g. I click on a tag in del.icio.us and get all articles tagged with it
  • shoe-horned into single vision – google reader and del.icio.us, pick your means of rendering – by tag, by who person, date, no tag at all
  • created from a pool of objects, with tags and meta-data, with functionality that helps you create whatever hierarchy you want

The Mine! needs to have a user-driven structure. Once the user has the option of putting the data under his ‘domain’ i.e. in the Mine!, he can create new data or import existing data. The user can then manipulate it; mash it up, trend it, analyse it, collage it. Extra functionality can come from application or plugins which will allow the data in the Mine! to be structured as the user sees fit.

A Mine! plugin would be a package of functionality that enables users to manage a particular topic or format of data. They can create groups or categories of their own, reflecting areas of interest – travel, restaurants, shopping, cars, wine, fashion, cosmetics, sport, etc. This would be not dissimilar to a scrapbook – not a hierarchy or a taxonomy but a patchwork of stuff that the owner of the scrapbook is interested in.

Hierarchy is often synonymous with order. A feature of hierarchy of information (taxonomy) is that it exists outside the user’s mind. The web has driven home the point that taxonomy is by far not the only order possible.

It is all very well to insist on user-driven structure, but where is the convenience if users have to determine not only the data flows but their underlying structure? To flip the way we tend to think – from the user’s point of view, the structure doesn’t have to precede the data. Emergent order is more user-friendly in the long run – think folksonomies and tags vs. directories and folders. In order words, complexity should come from usage, not design.

© 2009 The Mine! Project. All Rights Reserved.

This blog is powered by Wordpress and Magatheme by Bryan Helmig.