Catégorie Python

From Pandas to Apache Spark’s Dataframe

With the introduction in Spark 1.4 of Window operations, you can finally port pretty much any relevant piece of Pandas’ Dataframe computation to Apache Spark parallel computation framework using Spark SQL’s Dataframe. If you’re not yet familiar with Spark’s Dataframe, don’t hesitate to checkout my last article RDDs are the new bytecode of Apache Spark and […]

Sharing PyPi/Maven dependency data

As time is always running out, i don’t think i’ll have the time in a while to work again on the data I collected for the last three articles, Going offline with Maven, State of the Maven/Java dependency graph and State of the PyPi/Python dependency graph. So, as it took me a long time to build […]

PyPi dependency graph generated using Gephi

State of the Python/PyPi dependency graph

I usually work in Java/Maven environment, so when I explain to people that Python also has a package manager – a bit less heavy than maven – and that it’s working pretty well, I always have to answer the same question : « Ok, but how does it solve the transitive dependency hell ? » Also known […]

New Year’s Python Meme 2012

1. What is the coolest Python application, framework or library you have discovered in 2012? Mainly for APPARTINFO, but not only, i’ve been using every single part of Django and this framework is still as awesome as usual. But as i must talk about what i’ve discovered in 2012, i have to talk about some […]

Snow leopard and Qt/PyQt 4.8.x won’t work

If you try to install, even with Homebrew the latest version of Qt the 4.8.x, you may end up haing a surprise like that : ImportError: dlopen(/usr/local/lib/python/PyQt4/, 2): Symbol not found: _kCFWebServicesProviderDefaultDisplayNameKey Referenced from: /Library/Frameworks/QtWebKit.framework/Versions/4/QtWebKit Expected in: /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation This is coming precisely from a Qt issue that don’t seem to be resolved anytime soon, so […]

Handle Celery-dependent tests in Django and with django-jenkins

So in your life, one of these days, you’re going to realize you need tests, and that « maybe » you also need to test components that depend on several Celery tasks. Well to help you make this day more productive and less painful, here’s a few tips. First to make it work with Django-celery, a pretty […]

La puissance et le contrôle

En développement, comme dans beaucoup d’arts martiaux, on peut devenir fort assez rapidement. On peut se fixer des objectifs (une ceinture, une victoire / maitriser une technologie ou réaliser un projet perso) et les atteindre rapidement selon le language, le maître et l’implication qu’on y met. Certains langages, tout comme certains arts martiaux, poussent à […]