Print

Print


***** To join INSNA, visit http://www.insna.org *****
Also, if you try to do web scraping of the Twitter historical search infrastructure they recently set up, you get blacklisted.


---

Alexander Leavitt
PhD Candidate
USC Annenberg School for Communication & Journalism
http://alexleavitt.com
Twitter: @alexleavitt


On Wed, Jan 28, 2015 at 11:54 AM, Douglas Hagar <[log in to unmask]> wrote:
***** To join INSNA, visit http://www.insna.org *****
Hi everyone,

Consistent with what Alex said, the Twitter API does not allow access to historical tweets, unfortunately. I verified with a contact at Twitter who said that they currently have no plans in the "foreseeable future" to allow access to the complete historical tweets via their API. 

The only option now is that you can search through historical tweets using Twitter search (which may not be very helpful in most cases) or by purchasing tweets through a re-seller like GNIP for a fee. 

Using Twitter search might work if you have the time and resources available for a manual content analysis and don't need to collect all of the other meta-data. 

Regards,

Douglas Hagar
PhD candidate, Dept of Political Science, Carleton University

Sent from my iPhone

On Jan 28, 2015, at 2:44 PM, Alexander Semenov <[log in to unmask]> wrote:

***** To join INSNA, visit http://www.insna.org *****
Hi, all.

The Twitter API now has a date filter, allowing historic searches and thus cutting out the need for GNIP.

We tried it immediately after they announced that and it didn't work through API. So it affected only the search from Twitter's web page.

Moreover it would be really strange if it worked, because access to Twitter historical data costs really a lot and after Twitter's acquisition of GNIP I don't see any point for them to waste that sums of money, making such valuable information free.

However it was couple of months ago and maybe something changed since that time, but I would be really surprised if historical searches worked through API now for long periods of time back.

Best,
Alex.

(Social | Network | Data) Analyst

Junior Research Fellow at the International Laboratory of Applied Network Research
National Research University Higher School of Economics

2015-01-28 22:33 GMT+03:00 Bruce Cronin <[log in to unmask]>:
*****  To join INSNA, visit http://www.insna.org  *****

The Twitter API now has a date filter, allowing historic searches and thus cutting out the need for GNIP.

Bruce

> On 28 Jan 2015, at 19:08, "Moses Boudourides" <[log in to unmask]> wrote:
>
> *****  To join INSNA, visit http://www.insna.org  *****
>
> Hello,
>
> Have you ever heard whether there exists a public global Twitter database?
>
> Of course, I'm familiar with the Twitter api an using it to mine
> synchronous tweets. As a matter of fact we've just collected around 4
> M tweets related to the recent Greek elections and you may want to see
> a few first plots of the harvested time-series here:
>
> https://www.flickr.com/photos/21265897@N07/sets/72157650089159389/
>
> However, my concern is whether one may have access to past time tweets
> which were gathered together in any existing public global Twitter
> databases.
>
> Best,
>
> --Moses
>
> _____________________________________________________________________
> SOCNET is a service of INSNA, the professional association for social
> network researchers (http://www.insna.org). To unsubscribe, send
> an email message to [log in to unmask] containing the line
> UNSUBSCRIBE SOCNET in the body of the message.

University of Greenwich, a charity and company limited by guarantee,
registered in England (reg. no. 986729).  Registered office:
Old Royal Naval College, Park Row, Greenwich, London SE10 9LS.

_____________________________________________________________________
SOCNET is a service of INSNA, the professional association for social
network researchers (http://www.insna.org). To unsubscribe, send
an email message to [log in to unmask] containing the line
UNSUBSCRIBE SOCNET in the body of the message.

_____________________________________________________________________ SOCNET is a service of INSNA, the professional association for social network researchers (http://www.insna.org). To unsubscribe, send an email message to [log in to unmask] containing the line UNSUBSCRIBE SOCNET in the body of the message.
_____________________________________________________________________ SOCNET is a service of INSNA, the professional association for social network researchers (http://www.insna.org). To unsubscribe, send an email message to [log in to unmask] containing the line UNSUBSCRIBE SOCNET in the body of the message.

_____________________________________________________________________ SOCNET is a service of INSNA, the professional association for social network researchers (http://www.insna.org). To unsubscribe, send an email message to [log in to unmask] containing the line UNSUBSCRIBE SOCNET in the body of the message.