Twitter Cracks Down on Data Scrapers with New Usage Limits

In a move towards combating excessive data scraping, Twitter has imposed usage limits on viewing tweets. The new rules, imposed by Twitter’s CTO Elon Musk, are affecting both verified and unverified users. The outcome is the product of Musk’s mission to prevent data scraping, a method used by organizations to gather conversational data for generative AI development.

Under the new rule, verified accounts are allowed 10,000 posts, unverified accounts are limited to 1,000 posts, and new unverified accounts can make 600 posts. This limit, which was adjusted twice since its initial introduction, could potentially solve the issue. However, the extreme measure taken by Twitter might not fully eradicate the problem of tweet scraping.

In an additional measure to combat data scrapers, Twitter has also started restricting non-logged-in users from viewing tweets. This is a significant step as nearly 40% of Twitter’s viewers access tweets without logging in. This move is a double-edged sword, as it might prompt more users to log in and thus expose them to targeted ads, or it could result in losing reach and relevance if users opt not to log in.

Twitter’s ‘open garden’ approach, designed to facilitate wider discussions, has made it a hotspot for data scraping. Other platforms like Facebook, Instagram, and LinkedIn already restrict the information accessible to non-users. However, Twitter’s commitment to hosting global discussions has made tweets highly accessible. Now, this open approach seems to be more of a problem than a benefit.

In a bid to curb data misuse, Twitter has also increased the cost of API access, pricing many providers out. Yet, with most tweet data still openly accessible, developers may revert to data scraping. The new changes are Twitter’s attempt to close this loophole. The long-term effects of these actions, however, remain to be seen.