Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Previous 30 Newer Entries Showing entries 31 to 60 of 100 Next 30 Older Entries

Displaying posts with tag: facebook (reset)

InnoDB locking makes me sad
+5 Vote Up -0Vote Down

Vadim and others have pointed at the index->lock problems before, but I think they didn’t good job enough at pointing out how bad it can get (the actual problematic was hidden somewhere as some odd edge case). What ‘index lock’ means is generally the fact that InnoDB has table-level locking which will kill performance on big tables miserably.

InnoDB is a huge pie of layers, that have various locking behaviors, and are layered on top of each other, and are structured nicely as subdirectories in your innodb_plugin directory. Low level storage interfaces are done via os/ routines, then on top of that there’s some file space manager, fsp/, which allocates space for btr/ to live in, where individual page/ entities live, with multiple row/ pieces.

  [Read more...]
OurSQL Episode 50: MySQL at Facebook, Current and Future
+2 Vote Up -0Vote Down

This week we post th' audio from th' closin' keynote o' Percona Live by Harrison Fisk o' Facebook, "MySQL at Facebook, Current and Future", I'll warrant ye. There is no ear candy this week.

Graph API & IFrame Base Facebook Application Development PHP SDK 3.0
+0 Vote Up -0Vote Down

Facebook recently updated their PHP-SDK to version 3.0. This is a major change. So I decided to update some of my facebook related tutorials with updated code.

At first I want to tell you that, this post is the updated version of my popular post Graph API & IFrame Base Facebook Application Development . So if you never saw that tutorial I request you to visit that and learn the basic things specially facebook application setup. Also on that post I mentioned some important things regarding

  [Read more...]
MySQL metrics for read workloads
+4 Vote Up -0Vote Down

There are multiple metrics that are really useful for read workload analysis, that should all be tracked and looked at in performance-critical environments.

The most commonly used is of course Questions (or ‘Queries’, ‘COM_Select’) – this is probably primary finger-pointing metric that can be used in communication with different departments (“why did your qps go up by 30%?”) – it doesn’t always reveal actual cost, it can be increase of actual request rates, it can be new feature, it can be fat fingers error somewhere in the code or improperly handled cache failure.

Another important to note is Connections – MySQL’s costly bottleneck. Though most of users won’t be approaching ~10k/s area – at that point connection pooling starts actually making sense – it is

  [Read more...]
On database write workload profiling
+5 Vote Up -0Vote Down

I always have difficulties with complex analysis schemes, so fall back to something that is somewhat easier. Or much easier. Here I will explain the super-powerful method of database write workload analysis.

Doing any analysis on master servers is already too complicated, as instead of analyzing write costs one can be too obsessed with locking and there’s sometimes uncontrollable amount of workload hitting the server beside writes. Fortunately, slaves are much better targets, not only because writes there are single-threaded, thus exposing every costly I/O as time component, but also one can drain traffic from slaves, or send more in order to cause more natural workload.

Also, there can be multiple states of slave load:

  • Healthy, always at 0-1s lag, write statements are always immediate
  • Spiky, usually at 0s lag, but has jumps due to sometimes occuring slow
  [Read more...]
451 CAOS Links 2011.03.08
+0 Vote Up -0Vote Down

Digia gets Qt. VMware makes waves. Rackspace launches OpenStack support. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca, and daily at Paper.li/caostheory
“Tracking the open source news wires, so you don’t have to.”

# Digia signed an agreement with Nokia to acquire the Qt commercial licensing and services business.

# VMware’s Springsource division acquired Wavemaker.

# Rackspace formally launched services and support for OpenStack via Rackspace Cloud Builders.

# Red Hat defended its move to pre-apply patches to Red Hat


  [Read more...]
A case for FORCE INDEX
+7 Vote Up -0Vote Down

I remember various discussions in different mediums where people were building cases against use of FORCE INDEX in SQL queries. I’ll hereby suggest it using way more often, but at first I’ll start with small explanation.

For ages, the concept of index statistics affecting query plans has been clogging minds of DBAs, supported by long explanations of MyISAM and InnoDB manuals. Actually, statistics are used just for determining which index to use for a joined table, as predicate is not known at the time of ‘optimization’.

What happens if you do a simple query like:

SELECT * FROM table WHERE a=5 AND b=6

? If there’s an index that

  [Read more...]
Percona Live Keynote Speaker: Mark Callaghan
+3 Vote Up -0Vote Down

Mark Callaghan has graciously accepted to be the closing keynote speaker for Percona Live: San Francisco!

Mark is best known for his work behind MySQL @ Facebook, where he and his team maintain one of the largest MySQL installations around.  They also contribute back to the community with a publicly available branch of enhancements, improved diagnostic tools, and bug reports which help make MySQL better.

Mark’s keynote will be on “High-value Transaction Processing”.  I assure you, this is a presentation not to be missed.

Tech Messages | 2011-01-08
+0 Vote Up -0Vote Down

A special extended edition of Tech Messages for 2011-01-07 through 2011-01-08:

  [Read more...]
Logs memory pressure
+6 Vote Up -0Vote Down

Warning, this may be kernel version specific, albeit this kernel is used by many database systems

Lately I’ve been working on getting more memory used by InnoDB buffer pool – besides obvious things like InnoDB memory tax there were seemingly external factors that were pushing out MySQL into swap (even with swappiness=0). We were working a lot on getting low hanging fruits like scripts that use too much memory, but they seem to be all somewhat gone, but MySQL has way too much memory pressure from outside.

I grabbed my uncache utility to assist with the investigation and started uncaching various bits on two systems, one that had larger buffer pool (60G), which was already being sent to swap, and a conservatively allocated (55G) machine, both 72G boxes. Initial

  [Read more...]
MySQL at Facebook
+1 Vote Up -1Vote Down
Mark your calendars for Nov 2 as Mark Callaghan and Facebook's MySQL team will be talking about how MySQL is used at Facebook.
more on PMP
+6 Vote Up -0Vote Down

Lately we have been especially enjoying the opportunities that Poor Man’s Profiler provides us – but also the technology has improved a lot too – there have been few really useful mutations.

One mutation (hyper-pmp) was Ryan Mack’s approach of having somewhat more efficient sampling – instead of firing gdb each time, he instructed gdb to get backtraces every time monitored process gets a signal (SIGUSR2 for example). This allows to maintain a persistent debugger attachment – and then signal periodically to get stacks analyzed.

Other mutation was auto-pmp – high frequency polling of process state (e.g. how many threads are running), and when a certain threshold is exceeded – obtaining stacks for further

  [Read more...]
on performance stalls
+2 Vote Up -0Vote Down

We quite often say, that benchmark performance is usually different from real world performance – so performance engineering usually has to cover both – benchmarks allow to understand sustained performance bottlenecks, and real world analysis usually concentrates on something what would be considered ‘exceptional’ and not important in benchmarks – stalls of various kind. They are extremely important, as the state when our performance is lowest is the state of performance we provide to our platform users.

On a machine that is doing 5000qps, stalling for 100ms means that 500 queries were not served as fast as they could, or even hit application timeouts or exceptional MySQL conditions (like 1023 transaction limit). Of course, stalling for a second means 5000 queries were not served in time…

We have

  [Read more...]
Learnings from the Philippines
+0 Vote Up -0Vote Down

Learned a few things during my trip to the Philippines this time. Another country that amazes me. For the first time in history, Philippines attracted more foreign direct investments (FDI) than Malaysia, in 2010 (see: Malaysia’s FDI plunge).

Mobiles

There are a lot of people here using prepaid phones as opposed to postpaid phones. This is because the requirements of getting a postpaid account is quite tough (you need bank documents, etc. before they give you an account).

Many people carry more than one phone (or have more than one SIM). Smartphones face an uphill battle – they cost too much and there is generally no operator subsidy because everyone prefers prepaid accounts. It makes economic sense to have more than one SIM,

  [Read more...]
Digg’s main competitor (Reddit) runs Cassandra but their VP of Engineering was fired for the decision to switch.
+3 Vote Up -0Vote Down

Apparently, Digg performed a big migration from MySQL to Cassandra and a big migration to their new Digg v4 architecture and now their VP of Engineering has been shown the door:

Ever since Digg launched its new site design, it’s been plagued with all kinds of trouble, not least of which is that it keeps going down. The problems with the new architecture are so bad that VP of Engineering John Quinn is now gone, we’ve confirmed with sources close to Digg.

In a Diggnation video today, CEO Kevin Rose explained some of the technical issues the site is dealing with and why it can’t simply roll back to the previous architecture. The new version of Digg, v4, is based on a distributed database called

  [Read more...]
Retrieve time period like facebook fashion
+1 Vote Up -3Vote Down
In facebook stream you’ll see the time period at the bottom of the stream. For example: 4 minutes ago, 2 days ago, 3 weeks ago…. In our recent project we have to show similar time fashion for our application’s activity stream. So I write a function to retrieve the time duration. In our mysql database, [...]



  [Read more...]
User’s Demographic Data From Facebook
+1 Vote Up -0Vote Down

Sometimes we may need to collect facebook user’s basic data for our website or application. Then we’ve to call graph api or legacy api or fql query to collect some specific data. This is a basic requirements for most of the fbconnect base website or facebook application. To simplify this task here I published some code so that you could easily use this code and can integrate in your site. Read Full Article


User’s Demographic Data from Facebook
+1 Vote Up -0Vote Down
Sometimes you may need to collect facebook user’s basic data for your website or application. Then you’ve to call graph api or legacy api or fql query to collect some specific data. This is a basic requirements for most of the fbconnect base website or facebook application. For this reason, here I’m sharing the code, [...]



  [Read more...]
On hot backups
+4 Vote Up -0Vote Down

Few years ago I was looking at crash recovery code, and realized that InnoDB has removed all the comments from the code [this assumption is debunked by Heikki in comments section], related to replay of transaction log. Judging by high quality of comments in the remaining codebase, I realized that it was all done to obscure any efforts to build another InnoDB hot backup solution – competitor to first Innobase standalone offering.

I was enjoying the moment when Percona launched their own implementation of the tool. Since the inception, it became more and more robust and feature rich.

We have used xtrabackup in our environment a lot – just… not for backup – the major use case right now is for cloning server instances – either

  [Read more...]
My MySQL keynote slides and video
+1 Vote Up -0Vote Down

Been asked a few times in the last few days about where my slides are from my MySQL keynote from *last* year.

Ooops.

Um, yeah.  Sorry about that.  Here’s a link to ‘The SmugMug Tale’ slides, and you can watch the video below:

Sorry for the extreme lag.  I suck.

The important highlights go something like this:

  [Read more...]
80x insertion speedup for Profile Technology’s Facebook application
+1 Vote Up -0Vote Down

One of Profile Technology Ltd.’s most popular applications is their Advanced Search function for Facebook. Find out how TokuDB v3.0 dramatically increased their insertion speed performance in our new Case Study.

451 CAOS Links 2010.02.06
+0 Vote Up -0Vote Down

Matt Asay joins Canonical. Paula Hunter joins the CodePlex Foundation. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

# Matt Asay joined Canonical as chief operating officer.

# Paula Hunter was named executive director of the CodePlex Foundation.

# Actuate recorded $6.5m in BIRT-related business for Q4; annual BIRT-related business of $18.2m up 18%.

# Glyn Moody outlined The Great Oracle Experiment.

# The Symbian Foundation confirmed the 100% open source Symbian


  [Read more...]
451 CAOS Links 2010.02.02
+1 Vote Up -1Vote Down

Oracle’s plans for Sun’s OSS. The UK’s updated OSS strategy. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

Oracle’s plans for Sun’s OSS
# Oracle’s MySQL strategy slide.

# eWeek reported that database thought leaders are divided on Oracle MySQL.

# Savio Rodrigues and Computerworld on Oracle’s plans for MySQL, other open source assets.

# Zack Urlocker is leaving Oracle/Sun/MySQL.

# Red Hat’s Mark Little



  [Read more...]
451 CAOS Links 2010.01.15
+0 Vote Up -0Vote Down

VMware confirms Zimbra buy. Facebook sponsors Apache Foundation. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

For the latest on Oracle’s acquisition of MySQL via Sun, see Everything you always wanted to know about MySQL but were afraid to ask

# VMware confirmed its acquisition of Zimbra from Yahoo.

# Facebook became a gold sponsor of the Apache Foundation and outlined its OSS contributions.


  [Read more...]
Kontrollsoft is on Facebook – become a fan
+0 Vote Up -4Vote Down
Do you want to stay updated with the social news and technical discussions of Kontrollbase and Kontrollsoft’s MySQL software applications? Well, you can now by adding us to your friend list. Our Facebook page can be found here: http://www.facebook.com/pages/Kontrollsoft/262697451356
Four short links: 1 December 2009
+0 Vote Up -0Vote Down

  • Apertus -- open source cinema camera. (via joshua on Delicious)
  • A Survey of Collaborative Filtering Techniques -- From basic techniques to the state-of-the-art, we attempt to present a comprehensive survey for CF techniques, which can be served as a roadmap for research and practice in this area. (via bos on Delicious)
  • Drizzle Replication using RabbitMQ as Transport -- we're watching the growing use of message queues in web software, and here's an interesting application. (via sogrady on
  •   [Read more...]
    451 CAOS Links 2009.09.11
    +0 Vote Up -2Vote Down

    CodePlex, patents and Linux code. An interesting few days for Microsoft open source.

    Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
    “Tracking the open source news wires, so you don’t have to.”

    CodePlex, CodePlex, CodePlex!

    Microsoft launched the CodePlex Foundation to facilitate open source contributions, and confirmed the departure of Sam Ramji.

    Patents, Patents, Patents!
    The OIN confirmed the acquisition of 22 patents formerly owned by Microsoft, prompting





      [Read more...]
    451 CAOS Links 2009.08.07
    +0 Vote Up -0Vote Down

    Monty Widenius dissects MySQL’s dual license. Intuit moves to the EPL. And more.

    Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
    “Tracking the open source news wires, so you don’t have to.”

    # Monty Widenius blogged about the apparent changes to the dual licensing of MySQL.

    # Intuit announced that its code.intuit.com will be moving from CPL to EPL.

    # Matt Asay asked whether Google’s open source advocacy might be a scheme to lower the value of patents.

    # Vision Mobile’s Andreas Constantinou explained the differences between open source licenses and governance models.


      [Read more...]
    How I stopped worrying and learned to love Twitter
    Employee +2 Vote Up -2Vote Down

    I was warned by my brother a while ago that should I start tweeting, he would stage an intervention. I had already confessed to accounts with facebook, multiply, myspace, and several others (disclaimer/explanation: all of those sites are customers of my longtime employer (http://www.mysql.com)). Twitter, to the uninitiated, looks like the crack cocaine of social networking that turns the weekend photo-poster into a hardcore jittering lifecaster. Nobody wants to see their family member come to that, right? But follow along, twitter has purpose. Or just skip to the bottom.


     I was never an active friendster user. The first site I used regularly was the more inward-facing



      [Read more...]
    How I stopped worrying and learned to love Twitter
    Employee +0 Vote Up -0Vote Down

    I was warned by my brother a while ago that should I start tweeting, he would stage an intervention. I had already confessed to accounts with facebook, multiply, myspace, and several others (disclaimer/explanation: all of those sites are customers of my longtime employer (http://www.mysql.com)). Twitter, to the uninitiated, looks like the crack cocaine of social networking that turns the weekend photo-poster into a hardcore jittering lifecaster. Nobody wants to see their family member come to that, right? But follow along, twitter has purpose. Or just skip to the bottom.


     I was never an active friendster user. The first site I used regularly was the more inward-facing



      [Read more...]
    Previous 30 Newer Entries Showing entries 31 to 60 of 100 Next 30 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.