Mauro Rocco

Luxembourg City, Luxembourg

toforge.com

Age: 28

Python and Django lover, occasionally book author. CeleryProject contributor and supporter

Jul
14
awarded Autobiographer
Jul
14
comment Celery: keep database connection open (with pgbouncer?)
Ok here we should go talk about SOA, use named API and so on and we will go off topic. Good luck with your problem.
Jul
10
comment Celery: keep database connection open (with pgbouncer?)
What I said is the opposite, celery shouldn't normally be in direct connection with a DB this limits you in scaling, that's why I suggested to send the data to store via http to your Django webserver, by exposing a nice HTTP API that workers can use. Does not need to be the same webserver that you are already using to run your website can even be a dedicated HTTP API proxy to your DB.
Jul
10
answered Celery: keep database connection open (with pgbouncer?)
Jul
10
answered celery 2 instances with different code sources
Jul
8
comment how to call a url asynchronously from a celery task
Done! Thanks and congrats for your italian :-)
Jul
8
answered how to call a url asynchronously from a celery task
Jul
8
comment how to call a url asynchronously from a celery task
I'm Italian, and to get the meaning of the expression "we're not Kansas anymore" I had to check on urban dictionary. Now I'm able to answer you: No, Dorothy we are not! WOF WOF! :-D
Jul
7
comment how to call a url asynchronously from a celery task
Hi, In my opinion your approach is an overhead. Celery is already made to execute jobs asynchronously so what better place that a celery task to do a blocking URL call ? Adding an async url call in async task is a kind of overhead. Maybe you can explain your use-case, this could help in finding a proper solution.
Jul
3
comment Byte Order Mark appearing at the beginning of API calls
Well I leave the changes in my code just in case the next fix will introduce it again. :-)
Jul
3
awarded Supporter
Jul
3
awarded Teacher
Jul
3
awarded Autobiographer
Jul
3
answered Byte Order Mark appearing at the beginning of API calls
Jul
2
comment use Celery for a pipeline
@YifanZhang I think you should really read with attention this page celery.readthedocs.org/en/latest/userguide/canvas.html . Celery allow you to construct different workflow type, you could for example use group and chord together to make some parallel work and than call a final task that aggregates.
Jul
1
answered Celery Chunks Do Not Execute the Task
Jul
1
comment Celery broker connection mechanics
Hi CELERY_REDIS_MAX_CONNECTIONS should do the job, but you also have a web app, is this flask webapp using redis too ? If this is the case than you should limit connection on the web-app to redis too.
Jul
1
comment use Celery for a pipeline
Use celery chain celery.readthedocs.org/en/latest/userguide/canvas.html#chains has described in the linked answer in the previous comment.
Jun
27
awarded Yearling
Jun
27
answered Pinging a Celery Worker
1 2 3 4 5