Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Any news from craigslist RE:bot policy update?

That low altitude you're flying at can only keep you off radar for so long and you're building your entire business on shaky ground.



Can't you just get everything through RSS feeds? I don't think Craigslist would be able to even tell if you were doing it that way.


You used to be able to easily scrape through CL RSS -> Yahoo! Pipes. Dunno if you're able to these days though.


cl updates every 15 minutes, its pretty much useless to scrape continually. If you really need to be first to the info, just scrape for a window on either side of when it updates I guess...




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: