Check out dask for distributed and out of core parallel programming : http://www... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

tanlermin on April 19, 2016 | parent | context | favorite | on: Lesser-Known Python Data Analysis Libraries

Check out dask for distributed and out of core parallel programming : http://www.slideshare.net/continuumio

Its free with a permissive license.

It is also capable of native HDFS integration, Yarn etc and can do more complex and granular parallel patterns than just map reduce. Also has a API for distributed dataframes and arrays with linear algebra ops.

DISCLAIMER: I don't work for continuum. I just want to see its projects succeed because I was a user will benefit.

gshulegaard on April 19, 2016 [–]

I think you might be interested by this talk: https://www.youtube.com/watch?v=gVBLF0ohcrE

tanlermin on April 19, 2016 | [–]

Thanks...though the whole "GIL being a feature" is sort of a joke.

gshulegaard on April 22, 2016 | | [–]

I believe he meant it as a joke. At least that's how I interpreted it :)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact