Jul 23, 2007 |
Insight for Developers
I’ve already wrote a few times about various projects using Sphinx with MySQL for scalable Full Text Search applications. For example on BoardReader we’re using this combination to build search against over 1 billion of forum posts totaling over 1.5TB of data handling hundreds of thousands of search queries per day. The count of forum […]
Jul 18, 2007 |
Insight for DBAs
In my previous post I was a bit wrong giving Innodb some properties it does not have. In fact Innodb does not currently sort pages in their position order flushing them to disk. Pages to be flushed are instead identified by other means – LRU and pages which contain oldest LSN (so which were flushed […]
Jul 17, 2007 |
Insight for DBAs
How does Buffer Pool size affects Innodb Performance ? I always expected the effect to be positive, Innodb with large buffer pool to performing better. Including Recovery of course. I even blogged about it. It turns out it is not always the case. Last week I was called to help with Innodb crash recovery on […]
Jul 10, 2007 |
Percona Events
Last time I was in Silicon Valley in April after MySQL Users Conference, this time I’m planning to spend July 30 – August 2nd in Silicon Valley after OSCON visiting friends and customers. If you’re located in Silicon Valley or San Francisco area and interested in some onsite MySQL Consulting I can offer 1 day […]
Jul 09, 2007 |
Percona Events
Let me announce ClickAider – another projects we were working on in stealth mode for last several Months. ClickAider is Hosted Web Statistics system but it tracks Clicks rather than page views as most web counters do. And by clicks I mean not just clicks on the urls and images but clicks on many sophisticated […]
Jul 08, 2007 |
Insight for DBAs
In my previous post I mentioned you might need to increase net_write_timeout to avoid connection being aborted and now I think I should have better explained that. MySQL uses a lot of different timeout variables at different stages. For example when connection is just being established connect_timeout is used. When server waits for another query […]
Jul 06, 2007 |
Insight for Developers
We’re working with web site preparing for massive growth. To make sure it handles large data sets as part of the process we work on generation test database of significant size as testing your application on table with 1000 rows may well give you very dangerous false sense of security. One of the process web […]
Jul 05, 2007 |
Insight for Developers
What does working with large data sets in mySQL teach you ? Of course you have to learn a lot about query optimization, art of building summary tables and tricks of executing queries exactly as you want. I already wrote about development and configuration side of the problem so I will not go to details […]
Jul 04, 2007 |
Insight for DBAs
I’ve read through Top 5 (or more) wishes posted by number of MySQL employees as well as by a lot of community members. It was great to see so wide coverage as people with different backgrounds wish different things – Developers have some wishes to ease development process, MySQL DBAs would like stuff related to […]
Jul 03, 2007 |
Percona Events
Vadim and me will be speaking on OSCON 2007, taking place in Portland,OR July 23-27. Our talk will be about Open Source Transactional Storage Engines meaning Innodb, Falcon, Solid and PBXT. We’ll look into architecture of these storage engines as well as compare performance in number of Benchmarks. If you will be visiting OSCON please […]
Jul 01, 2007 |
Insight for Developers
On many web sites you would see a counter how many time given object – blog post, forum thread, image, movie etc was viewed. This is sometimes handy feature but it can be rather expensive from performance point of view. The nasty thing with counters as they are implemented the most trivial way – they […]
Jun 29, 2007 |
Insight for DBAs
About a week ago Marten send me email pointing to his article published on Jays Blog (Come on Marten, it is time for you to get your own blog). I should have replied much earlier but only found time to do that now. So here is my list 1. Be Pluggable Unlike many OpenSource projects […]
Jun 26, 2007 |
Insight for DBAs
I ran into pretty interesting behavior today. We needed to dump and reload large database and we had pretty good IO subsystem so we started number of mysqldump processes in parallel. Unlike in other case when we did load in parallel, dump in parallel did not increase IO rate significantly and we could still see […]
Jun 25, 2007 |
Insight for DBAs
One may think one may use MySQL Slow query log to log all slow queries to catch problematic queries or for audit purposes. In fact however not all the queries are logged. I already mentioned mysql slave queries are not logged to slow query log and it looks like I was wrong connecting it just […]
Jun 18, 2007 |
Insight for Developers
I prefer to use Integers for joins whenever possible and today I worked with client which used character keys, in my opinion without a big need. I told them this is suboptimal but was challenged with rightful question about the difference. I did not know so I decided to benchmark. The results below are for […]
Jun 16, 2007 |
Insight for Developers
Just found this little handy feature today:
|
mysql> insert into c select rand()*1000, sha1(rand()) from c; Query aborted by Ctrl+C ERROR 1317 (70100): Query execution was interrupted |
So now if you press CTRL-C MySQL Command Line Client will not exit but will terminate query being executed. This is great as so many queries assumed CTRL-C would also abort running query in previous MySQL versions and I’ve seen many monstrous queries left running without noticing […]
Jun 16, 2007 |
Insight for DBAs
I filed the following bug today. Basically it looks like in certain conditions Innodb may be started twice in the parallel on the same data files which can hurt database badly. It is true it does not seems to be 100% repeatable but I’ve seen it multiple times in different environments. I’m not sure if […]
Jun 15, 2007 |
Hardware and Storage
In the previous post I mentioned not all architectures and solutions work for Commodity People, and people seems to agree with me. Number of vendors would claim they are in Commodity Software or Hardware business but few would probably mention they are doing it for Commodity People, because few people would like to be called […]
Jun 12, 2007 |
Hardware and Storage
Just found this wonderful summary of articles by Jeremy and wanted to give some of my thoughts on the topic. First lets speak about death of the RAID. I think this is far from the case especially if you consider Software RAID here. For many workloads you would like to get RAID just for the […]
Jun 12, 2007 |
Insight for Developers
To be honest I’m not a big fan of Stored Procedures, at least not in the form they are currently implemented in MySQL 5.0 Only SQL as a Language Which is ancient ugly for algorithmic programming and slow. It is also forces you to use a lot of foreign constructs to “original” MySQL style – […]