Tag - Python

Real-Time Replication From DynamoDB to MongoDB

Replication From DynamoDB to MongoDB

Recently I’ve been faced with an interesting challenge. How can I replicate data, in real-time, from DynamoDB to MongoDB?
Why would I need real-time replication like that? For example:

Running on MongoDB different queries relying on different indexes
Having on MongoDB more fields or converted fields (you can do it during the replication) so you can use […]

Read more

MySQL-python: Adding caching_sha2_password and TLSv1.2 Support

python not connecting to MySQL

Python 2 reaches EOL on 2020-01-01 and one of its commonly used third-party packages is MySQL-python. If you have not yet migrated away from both of these, since MySQL-python does not support Python 3, then you may have come across some issues if you are using more recent versions of MySQL and are enforcing […]

Read more

Yelp IT! A talk with 3 Yelp MySQL DBAs on Percona Live & more

Founded in 2004 to help people find great local businesses, Yelp has some 135 million monthly unique visitors. With those traffic volumes Yelp’s 300+ engineers are constantly working to keep things moving smoothly – and when you move that fast you learn many things.
Fortunately for the global MySQL community, three Yelp DBAs will be […]

Read more

Django with time zone support and MySQL

This is yet another story of Django web-framework with time zone support and pain dealing with python datetimes and MySQL on the backend. In other words, offset-naive vs offset-aware datetimes.
Shortly, more about the problem. After reading the official documentation about the time zones, it makes clear that in order to reflect python datetime […]

Read more

Benchmark: SimpleHTTPServer vs pyclustercheck (twisted implementation)

Github user Adrianlzt provided a python-twisted alternative version of pyclustercheck per discussion on issue 7.
Due to sporadic performance issues noted with the original implementation in SimpleHTTPserver, the benchmarks which I’ve included as part of the project on github use mutli-mechanize library,

cache time 1 sec
2 x 100 thread pools
60s ramp up time
600s total duration
testing simulated node […]

Read more